2022-04-03T04:18:25.763 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-03T04:18:25.764 INFO:teuthology.results:subset: '21811/99999' 2022-04-03T04:18:25.765 INFO:teuthology.results:seed: '9363' 2022-04-03T14:30:32.575 INFO:root:teuthology version: 1.1.0-d877b023 2022-04-03T14:30:32.612 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-04-03T17:57:52.051 INFO:teuthology.results:Tests finished! gathering results... 2022-04-03T17:58:23.622 INFO:scrape:Found 417 jobs 2022-04-03T17:58:29.714 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:29.718 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:29.721 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:29.723 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:29.724 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:29.725 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:29.725 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:29.726 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:29.726 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:29.727 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:29.728 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:29.729 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:29.730 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:29.734 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:29.735 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:29.736 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:29.736 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:29.737 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:30.013 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:30.018 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:30.020 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:30.022 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:30.023 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:30.024 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:30.024 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:30.025 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.025 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:30.027 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:30.027 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:30.028 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.029 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:30.032 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:30.033 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:30.034 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:30.034 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:30.035 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:30.294 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:30.296 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:30.299 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:30.301 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:30.301 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:30.302 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:30.303 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:30.303 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.304 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:30.304 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:30.305 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:30.306 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.306 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:30.309 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:30.311 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:30.311 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:30.312 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:30.312 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:30.575 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:30.578 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:30.581 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:30.583 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:30.583 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:30.584 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:30.585 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:30.585 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.586 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:30.586 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:30.587 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:30.588 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.589 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:30.592 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:30.593 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:30.594 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:30.595 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:30.595 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:30.856 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:30.859 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:30.862 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:30.864 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:30.864 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:30.865 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:30.866 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:30.866 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.867 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:30.868 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:30.868 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:30.869 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:30.870 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:30.873 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:30.874 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:30.875 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:30.876 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:30.876 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:31.150 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:31.153 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:31.156 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:31.158 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:31.158 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:31.159 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:31.160 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:31.160 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:31.161 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:31.161 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:31.162 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:31.163 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:31.163 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:31.166 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:31.168 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:31.168 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:31.169 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:31.170 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:31.474 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:31.476 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:31.479 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:31.481 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:31.481 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:31.482 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:31.483 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:31.483 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:31.484 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:31.484 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:31.485 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:31.486 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:31.486 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:31.489 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:31.491 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:31.491 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:31.492 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:31.492 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:31.750 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:31.753 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:31.756 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:31.758 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:31.758 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:31.759 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:31.759 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:31.760 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:31.761 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:31.761 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:31.762 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:31.762 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:31.763 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:31.766 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:31.767 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:31.768 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:31.769 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:31.769 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:32.025 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:32.028 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:32.031 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:32.033 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:32.033 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:32.034 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:32.035 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:32.035 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.036 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:32.036 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:32.037 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:32.038 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.038 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:32.042 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:32.043 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:32.044 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:32.044 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:32.045 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:32.303 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:32.306 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:32.308 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:32.310 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:32.311 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:32.312 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:32.312 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:32.313 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.313 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:32.314 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:32.315 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:32.316 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.316 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:32.320 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:32.321 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:32.322 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:32.322 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:32.323 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:32.587 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:32.590 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:32.593 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:32.595 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:32.595 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:32.596 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:32.596 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:32.597 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.598 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:32.598 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:32.599 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:32.600 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.600 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:32.603 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:32.605 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:32.605 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:32.606 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:32.607 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:32.865 WARNING:scrape:Ignoring malparsed backtrace: ceph version 16.2.7-824-gf5e8c20e (f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460) pacific (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe0) [0x7f1bc8c75495] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x15bf) [0x561c121efbbf] 2022-04-03T17:58:32.867 WARNING:scrape:Ignoring malparsed backtrace: noscrub is unset , 2022-04-03T06:40:58.710 INFO:teuthology.orchestra.run.smithi166.stdout:ERROR: (22) Invalid argument , 2022-04-03T06:40:58.711 INFO:teuthology.orchestra.run.smithi166.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2022-04-03T17:58:32.870 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:41:40.612 INFO:teuthology.orchestra.run.smithi141.stdout:{"pg_ready":true,"pg_map":{"version":429,"stamp":"2022-04-03T06:41:40.493647+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":1988338222,"num_objects":760,"num_object_clones":142,"num_object_copies":1520,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":662,"num_whiteouts":34,"num_read":3119,"num_read_kb":2220446,"num_write":3807,"num_write_kb":1716178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":539,"num_bytes_recovered":922883419,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":7233,"ondisk_log_size":7233,"up":34,"acting":34,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":29,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":562196280,"kb_used":8125064,"kb_used_data":554105500,"kb_used_omap":13758,"kb_used_meta":0,"kb_avail":554071216,"statfs":{"total":575688990720,"available":567368925184,"internally_reserved":35106816,"allocated":567404032000,"data_stored":567404032000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":14088809,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":4,"commit_latency_ns":0,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.001652"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":72,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.545500+0000","last_change":"2022-04-03T06:41:35.545500+0000","last_active":"2022-04-03T06:41:35.545500+0000","last_peered":"2022-04-03T06:41:35.545500+0000","last_clean":"2022-04-03T06:41:35.545500+0000","last_became_active":"2022-04-03T06:41:35.544721+0000","last_became_peered":"2022-04-03T06:41:35.544721+0000","last_unstale":"2022-04-03T06:41:35.545500+0000","last_undegraded":"2022-04-03T06:41:35.545500+0000","last_fullsized":"2022-04-03T06:41:35.545500+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.895404+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:25.788240+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.895404+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":260,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544426+0000","last_change":"2022-04-03T06:40:35.758727+0000","last_active":"2022-04-03T06:41:34.544426+0000","last_peered":"2022-04-03T06:41:34.544426+0000","last_clean":"2022-04-03T06:41:34.544426+0000","last_became_active":"2022-04-03T06:36:02.731326+0000","last_became_peered":"2022-04-03T06:36:02.731326+0000","last_unstale":"2022-04-03T06:41:34.544426+0000","last_undegraded":"2022-04-03T06:41:34.544426+0000","last_fullsized":"2022-04-03T06:41:34.544426+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:35.758581+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:35.758581+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"251'1153","reported_seq":1922,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545160+0000","last_change":"2022-04-03T06:40:56.672058+0000","last_active":"2022-04-03T06:41:34.545160+0000","last_peered":"2022-04-03T06:41:34.545160+0000","last_clean":"2022-04-03T06:41:34.545160+0000","last_became_active":"2022-04-03T06:36:14.788431+0000","last_became_peered":"2022-04-03T06:36:14.788431+0000","last_unstale":"2022-04-03T06:41:34.545160+0000","last_undegraded":"2022-04-03T06:41:34.545160+0000","last_fullsized":"2022-04-03T06:41:34.545160+0000","mapping_epoch":21,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":22,"parent":"0.0","parent_split_bits":0,"last_scrub":"230'983","last_scrub_stamp":"2022-04-03T06:40:36.354107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:36.354107+0000","log_size":1153,"ondisk_log_size":1153,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":393906103,"num_objects":144,"num_object_clones":26,"num_object_copies":288,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":144,"num_whiteouts":2,"num_read":589,"num_read_kb":383251,"num_write":694,"num_write_kb":380971,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":274,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550076+0000","last_change":"2022-04-03T06:41:35.550076+0000","last_active":"2022-04-03T06:41:35.550076+0000","last_peered":"2022-04-03T06:41:35.550076+0000","last_clean":"2022-04-03T06:41:35.550076+0000","last_became_active":"2022-04-03T06:41:35.549686+0000","last_became_peered":"2022-04-03T06:41:35.549686+0000","last_unstale":"2022-04-03T06:41:35.550076+0000","last_undegraded":"2022-04-03T06:41:35.550076+0000","last_fullsized":"2022-04-03T06:41:35.550076+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:49.788750+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:49.788750+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"251'1035","reported_seq":1775,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540137+0000","last_change":"2022-04-03T06:40:56.696191+0000","last_active":"2022-04-03T06:41:34.540137+0000","last_peered":"2022-04-03T06:41:34.540137+0000","last_clean":"2022-04-03T06:41:34.540137+0000","last_became_active":"2022-04-03T06:36:32.966581+0000","last_became_peered":"2022-04-03T06:36:32.966581+0000","last_unstale":"2022-04-03T06:41:34.540137+0000","last_undegraded":"2022-04-03T06:41:34.540137+0000","last_fullsized":"2022-04-03T06:41:34.540137+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"189'891","last_scrub_stamp":"2022-04-03T06:40:23.610152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.610152+0000","log_size":1035,"ondisk_log_size":1035,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":348542345,"num_objects":131,"num_object_clones":22,"num_object_copies":262,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":131,"num_whiteouts":9,"num_read":456,"num_read_kb":240608,"num_write":561,"num_write_kb":335516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":208,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545650+0000","last_change":"2022-04-03T06:41:34.545877+0000","last_active":"2022-04-03T06:41:33.751099+0000","last_peered":"2022-04-03T06:41:19.534566+0000","last_clean":"2022-04-03T06:41:19.534566+0000","last_became_active":"2022-04-03T06:40:27.586259+0000","last_became_peered":"2022-04-03T06:40:27.586259+0000","last_unstale":"2022-04-03T06:41:34.545650+0000","last_undegraded":"2022-04-03T06:41:34.545650+0000","last_fullsized":"2022-04-03T06:41:34.545650+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:28.521121+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:28.521121+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[4],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"251'1251","reported_seq":2050,"reported_epoch":263,"state":"peering","last_fresh":"2022-04-03T06:41:34.545661+0000","last_change":"2022-04-03T06:41:34.546090+0000","last_active":"2022-04-03T06:41:33.751178+0000","last_peered":"2022-04-03T06:40:56.711402+0000","last_clean":"2022-04-03T06:40:56.711402+0000","last_became_active":"2022-04-03T06:40:27.591808+0000","last_became_peered":"2022-04-03T06:40:27.591808+0000","last_unstale":"2022-04-03T06:41:34.545661+0000","last_undegraded":"2022-04-03T06:41:34.545661+0000","last_fullsized":"2022-04-03T06:41:34.545661+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"222'932","last_scrub_stamp":"2022-04-03T06:40:27.695097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:27.695097+0000","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":380909062,"num_objects":148,"num_object_clones":32,"num_object_copies":296,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":148,"num_whiteouts":3,"num_read":657,"num_read_kb":446477,"num_write":683,"num_write_kb":407574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":278,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:36.787317+0000","last_change":"2022-04-03T06:41:36.787317+0000","last_active":"2022-04-03T06:41:36.787317+0000","last_peered":"2022-04-03T06:41:36.787317+0000","last_clean":"2022-04-03T06:41:36.787317+0000","last_became_active":"2022-04-03T06:36:32.971363+0000","last_became_peered":"2022-04-03T06:36:32.971363+0000","last_unstale":"2022-04-03T06:41:36.787317+0000","last_undegraded":"2022-04-03T06:41:36.787317+0000","last_fullsized":"2022-04-03T06:41:36.787317+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:36.787176+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:39:14.080187+0000","last_clean_scrub_stamp":"2022-04-03T06:41:36.787176+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"251'1146","reported_seq":2313,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539435+0000","last_change":"2022-04-03T06:40:56.659245+0000","last_active":"2022-04-03T06:41:34.539435+0000","last_peered":"2022-04-03T06:41:34.539435+0000","last_clean":"2022-04-03T06:41:34.539435+0000","last_became_active":"2022-04-03T06:40:36.699745+0000","last_became_peered":"2022-04-03T06:40:36.699745+0000","last_unstale":"2022-04-03T06:41:34.539435+0000","last_undegraded":"2022-04-03T06:41:34.539435+0000","last_fullsized":"2022-04-03T06:41:34.539435+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":247,"parent":"0.0","parent_split_bits":0,"last_scrub":"170'1025","last_scrub_stamp":"2022-04-03T06:40:16.491655+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:13.784551+0000","last_clean_scrub_stamp":"2022-04-03T06:40:16.491655+0000","log_size":1146,"ondisk_log_size":1146,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":401940267,"num_objects":145,"num_object_clones":26,"num_object_copies":290,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":145,"num_whiteouts":5,"num_read":583,"num_read_kb":399585,"num_write":684,"num_write_kb":358238,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.2","version":"251'766","reported_seq":1419,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540141+0000","last_change":"2022-04-03T06:40:59.906973+0000","last_active":"2022-04-03T06:41:34.540141+0000","last_peered":"2022-04-03T06:41:34.540141+0000","last_clean":"2022-04-03T06:41:34.540141+0000","last_became_active":"2022-04-03T06:36:32.959189+0000","last_became_peered":"2022-04-03T06:36:32.959189+0000","last_unstale":"2022-04-03T06:41:34.540141+0000","last_undegraded":"2022-04-03T06:41:34.540141+0000","last_fullsized":"2022-04-03T06:41:34.540141+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'766","last_scrub_stamp":"2022-04-03T06:40:59.906716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.906716+0000","log_size":766,"ondisk_log_size":766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108329164,"num_objects":46,"num_object_clones":11,"num_object_copies":92,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":197,"num_read_kb":156270,"num_write":326,"num_write_kb":76366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":62,"num_flush_kb":163718,"num_evict":40,"num_evict_kb":95820,"num_promote":77,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":43,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.551839+0000","last_change":"2022-04-03T06:41:35.551839+0000","last_active":"2022-04-03T06:41:35.551839+0000","last_peered":"2022-04-03T06:41:35.551839+0000","last_clean":"2022-04-03T06:41:35.551839+0000","last_became_active":"2022-04-03T06:41:35.551349+0000","last_became_peered":"2022-04-03T06:41:35.551349+0000","last_unstale":"2022-04-03T06:41:35.551839+0000","last_undegraded":"2022-04-03T06:41:35.551839+0000","last_fullsized":"2022-04-03T06:41:35.551839+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:58.809684+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:38:36.016795+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.809684+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"251'464","reported_seq":1299,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.540142+0000","last_change":"2022-04-03T06:40:58.928000+0000","last_active":"2022-04-03T06:41:34.540142+0000","last_peered":"2022-04-03T06:41:34.540142+0000","last_clean":"2022-04-03T06:41:34.540142+0000","last_became_active":"2022-04-03T06:40:36.695599+0000","last_became_peered":"2022-04-03T06:40:36.695599+0000","last_unstale":"2022-04-03T06:41:34.540142+0000","last_undegraded":"2022-04-03T06:41:34.540142+0000","last_fullsized":"2022-04-03T06:41:34.540142+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":238,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'464","last_scrub_stamp":"2022-04-03T06:40:58.927916+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:40:58.927916+0000","log_size":464,"ondisk_log_size":464,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":111205515,"num_objects":48,"num_object_clones":9,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":7,"num_read":135,"num_read_kb":116110,"num_write":245,"num_write_kb":45244,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":82,"num_bytes_recovered":138140231,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":42,"num_flush_kb":124861,"num_evict":33,"num_evict_kb":89139,"num_promote":72,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":103,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545220+0000","last_change":"2022-04-03T06:40:29.621277+0000","last_active":"2022-04-03T06:41:34.545220+0000","last_peered":"2022-04-03T06:41:34.545220+0000","last_clean":"2022-04-03T06:41:34.545220+0000","last_became_active":"2022-04-03T06:40:29.620638+0000","last_became_peered":"2022-04-03T06:40:29.620638+0000","last_unstale":"2022-04-03T06:41:34.545220+0000","last_undegraded":"2022-04-03T06:41:34.545220+0000","last_fullsized":"2022-04-03T06:41:34.545220+0000","mapping_epoch":223,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":224,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:23.510848+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:23.510848+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"251'746","reported_seq":2128,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.545183+0000","last_change":"2022-04-03T06:40:59.152935+0000","last_active":"2022-04-03T06:41:34.545183+0000","last_peered":"2022-04-03T06:41:34.545183+0000","last_clean":"2022-04-03T06:41:34.545183+0000","last_became_active":"2022-04-03T06:40:48.578424+0000","last_became_peered":"2022-04-03T06:40:48.578424+0000","last_unstale":"2022-04-03T06:41:34.545183+0000","last_undegraded":"2022-04-03T06:41:34.545183+0000","last_fullsized":"2022-04-03T06:41:34.545183+0000","mapping_epoch":242,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":243,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'746","last_scrub_stamp":"2022-04-03T06:40:59.152843+0000","last_deep_scrub":"180'556","last_deep_scrub_stamp":"2022-04-03T06:39:13.698385+0000","last_clean_scrub_stamp":"2022-04-03T06:40:59.152843+0000","log_size":746,"ondisk_log_size":746,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":123370302,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":1,"num_read":254,"num_read_kb":221089,"num_write":337,"num_write_kb":61601,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":265,"num_bytes_recovered":394533953,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":67,"num_flush_kb":183171,"num_evict":60,"num_evict_kb":153984,"num_promote":112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":283,"reported_epoch":264,"state":"active+clean","last_fresh":"2022-04-03T06:41:35.550377+0000","last_change":"2022-04-03T06:41:35.550377+0000","last_active":"2022-04-03T06:41:35.550377+0000","last_peered":"2022-04-03T06:41:35.550377+0000","last_clean":"2022-04-03T06:41:35.550377+0000","last_became_active":"2022-04-03T06:41:35.549682+0000","last_became_peered":"2022-04-03T06:41:35.549682+0000","last_unstale":"2022-04-03T06:41:35.550377+0000","last_undegraded":"2022-04-03T06:41:35.550377+0000","last_fullsized":"2022-04-03T06:41:35.550377+0000","mapping_epoch":263,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":264,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:41:04.075187+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:41:04.075187+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1","version":"251'672","reported_seq":1379,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.539262+0000","last_change":"2022-04-03T06:41:20.494075+0000","last_active":"2022-04-03T06:41:34.539262+0000","last_peered":"2022-04-03T06:41:34.539262+0000","last_clean":"2022-04-03T06:41:34.539262+0000","last_became_active":"2022-04-03T06:36:16.810506+0000","last_became_peered":"2022-04-03T06:36:16.810506+0000","last_unstale":"2022-04-03T06:41:34.539262+0000","last_undegraded":"2022-04-03T06:41:34.539262+0000","last_fullsized":"2022-04-03T06:41:34.539262+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'672","last_scrub_stamp":"2022-04-03T06:41:20.493954+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:15.790371+0000","last_clean_scrub_stamp":"2022-04-03T06:41:20.493954+0000","log_size":672,"ondisk_log_size":672,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120135464,"num_objects":49,"num_object_clones":8,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":4,"num_read":248,"num_read_kb":257056,"num_write":277,"num_write_kb":50668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":47,"num_flush_kb":131642,"num_evict":46,"num_evict_kb":115112,"num_promote":97,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":270,"reported_epoch":263,"state":"active+clean","last_fresh":"2022-04-03T06:41:34.544786+0000","last_change":"2022-04-03T06:40:46.788840+0000","last_active":"2022-04-03T06:41:34.544786+0000","last_peered":"2022-04-03T06:41:34.544786+0000","last_clean":"2022-04-03T06:41:34.544786+0000","last_became_active":"2022-04-03T06:40:36.688257+0000","last_became_peered":"2022-04-03T06:40:36.688257+0000","last_unstale":"2022-04-03T06:41:34.544786+0000","last_undegraded":"2022-04-03T06:41:34.544786+0000","last_fullsized":"2022-04-03T06:41:34.544786+0000","mapping_epoch":230,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":231,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-04-03T06:40:46.788732+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-04-03T06:36:01.698422+0000","last_clean_scrub_stamp":"2022-04-03T06:40:46.788732+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":463040445,"num_objects":192,"num_object_clones":36,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":15,"num_read":834,"num_read_kb":750525,"num_write":1185,"num_write_kb":233879,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":347,"num_bytes_recovered":532674184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":218,"num_flush_kb":603392,"num_evict":179,"num_evict_kb":454055,"num_promote":358,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2648,"ondisk_log_size":2648,"up":8,"acting":8,"num_store_stats":0},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":1525297777,"num_objects":568,"num_object_clones":106,"num_object_copies":1136,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":568,"num_whiteouts":19,"num_read":2285,"num_read_kb":1469921,"num_write":2622,"num_write_kb":1482299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":192,"num_bytes_recovered":390209235,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4585,"ondisk_log_size":4585,"up":8,"acting":8,"num_store_stats":0},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":2,"acting":2,"num_store_stats":0}],"osd_stats":[{"osd":7,"up_from":221,"seq":949187772431,"num_pgs":3,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1136212,"kb_used_data":92563168,"kb_used_omap":581,"kb_used_meta":0,"kb_avail":92563168,"statfs":{"total":95948165120,"available":94784684032,"internally_reserved":0,"allocated":94784684032,"data_stored":94784684032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":595900,"internal_metadata":0},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":1.123,"5min":1.123,"15min":1.123},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.84099999999999997,"15min":0.84099999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":1.429,"5min":1.429,"15min":1.429},"last":0.88300000000000001}]},{"osd":1,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.83699999999999997,"5min":0.83699999999999997,"15min":0.83699999999999997},"min":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"max":{"1min":1.3740000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"last":0.78400000000000003},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"min":{"1min":0.40500000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":1.153,"5min":1.153,"15min":1.153},"last":0.94999999999999996}]},{"osd":2,"last update":"Sun Apr 3 06:41:32 2022","interfaces":[{"interface":"back","average":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"min":{"1min":0.46999999999999997,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":1.1719999999999999,"5min":1.1719999999999999,"15min":1.1719999999999999},"last":0.97099999999999997},{"interface":"front","average":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"min":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":1.391,"5min":1.391,"15min":1.391},"last":0.67400000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89300000000000002,"5min":0.89300000000000002,"15min":0.89300000000000002},"min":{"1min":0.48299999999999998,"5min":0.48299999999999998,"15min":0.48299999999999998},"max":{"1min":1.1819999999999999,"5min":1.1819999999999999,"15min":1.1819999999999999},"last":0.80200000000000005},{"interface":"front","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.2749999999999999,"5min":1.2749999999999999,"15min":1.2749999999999999},"last":1.016}]},{"osd":4,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"min":{"1min":0.51500000000000001,"5min":0.51500000000000001,"15min":0.51500000000000001},"max":{"1min":1.137,"5min":1.137,"15min":1.137},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.89800000000000002,"5min":0.89800000000000002,"15min":0.89800000000000002},"min":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"max":{"1min":1.53,"5min":1.53,"15min":1.53},"last":0.86399999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.244,"5min":1.244,"15min":1.244},"last":1.117},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"max":{"1min":1.7,"5min":1.7,"15min":1.7},"last":0.83299999999999996}]},{"osd":6,"last update":"Sun Apr 3 06:41:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":1.0229999999999999,"15min":1.0229999999999999},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.5049999999999999,"5min":1.5049999999999999,"15min":1.5049999999999999},"last":1.044},{"interface":"front","average":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":1.587,"5min":1.587,"15min":1.587},"last":1.2629999999999999}]}]},{"osd":6,"up_from":36,"seq":154618822718,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1317588,"kb_used_data":92381820,"kb_used_omap":2740,"kb_used_meta":0,"kb_avail":92381792,"statfs":{"total":95948165120,"available":94598955008,"internally_reserved":28672,"allocated":94598983680,"data_stored":94598983680,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2806315,"internal_metadata":0},"hb_peers":[0,1,2,3,4,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.79700000000000004,"5min":0.747,"15min":0.73299999999999998},"min":{"1min":0.47299999999999998,"5min":0.377,"15min":0.377},"max":{"1min":1.125,"5min":1.3180000000000001,"15min":1.3180000000000001},"last":1.02},{"interface":"front","average":{"1min":0.76300000000000001,"5min":0.82099999999999995,"15min":0.83699999999999997},"min":{"1min":0.51200000000000001,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.0629999999999999,"5min":1.3100000000000001,"15min":1.3100000000000001},"last":0.86199999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.72999999999999998,"5min":0.73699999999999999,"15min":0.73899999999999999},"min":{"1min":0.435,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.98899999999999999,"5min":1.0880000000000001,"15min":1.0880000000000001},"last":0.88700000000000001},{"interface":"front","average":{"1min":0.76200000000000001,"5min":0.78800000000000003,"15min":0.80200000000000005},"min":{"1min":0.51600000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.03,"5min":1.1559999999999999,"15min":1.1559999999999999},"last":0.78600000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.77900000000000003,"5min":0.77200000000000002,"15min":0.77500000000000002},"min":{"1min":0.47499999999999998,"5min":0.47199999999999998,"15min":0.47199999999999998},"max":{"1min":1.1080000000000001,"5min":1.1439999999999999,"15min":1.1439999999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":0.70799999999999996,"5min":0.81299999999999994,"15min":0.83899999999999997},"min":{"1min":0.54300000000000004,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":0.93500000000000005,"5min":3.1539999999999999,"15min":3.1539999999999999},"last":0.91500000000000004}]},{"osd":3,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":0.80400000000000005,"15min":0.78800000000000003},"min":{"1min":0.70199999999999996,"5min":0.41499999999999998,"15min":0.41499999999999998},"max":{"1min":1.0620000000000001,"5min":1.151,"15min":1.151},"last":1.0600000000000001},{"interface":"front","average":{"1min":0.92800000000000005,"5min":0.90800000000000003,"15min":0.90800000000000003},"min":{"1min":0.66200000000000003,"5min":0.54600000000000004,"15min":0.54600000000000004},"max":{"1min":1.1160000000000001,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.94999999999999996}]},{"osd":4,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.94199999999999995,"5min":0.84999999999999998,"15min":0.81599999999999995},"min":{"1min":0.56899999999999995,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":1.3500000000000001,"5min":1.395,"15min":1.395},"last":0.56499999999999995},{"interface":"front","average":{"1min":0.999,"5min":0.88600000000000001,"15min":0.85099999999999998},"min":{"1min":0.68100000000000005,"5min":0.46600000000000003,"15min":0.46600000000000003},"max":{"1min":1.323,"5min":1.323,"15min":1.323},"last":0.96799999999999997}]},{"osd":5,"last update":"Sun Apr 3 06:40:42 2022","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.51800000000000002,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.087,"5min":3.274,"15min":3.274},"last":0.77100000000000002},{"interface":"front","average":{"1min":1.032,"5min":1.0009999999999999,"15min":1.026},"min":{"1min":0.73899999999999999,"5min":0.58499999999999996,"15min":0.58499999999999996},"max":{"1min":1.2090000000000001,"5min":2.363,"15min":2.363},"last":1.111}]},{"osd":7,"last update":"Sun Apr 3 06:41:27 2022","interfaces":[{"interface":"back","average":{"1min":0.98399999999999999,"5min":0.98399999999999999,"15min":0.98399999999999999},"min":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.4730000000000001,"5min":1.4730000000000001,"15min":1.4730000000000001},"last":0.63900000000000001},{"interface":"front","average":{"1min":1.044,"5min":1.044,"15min":1.044},"min":{"1min":0.66400000000000003,"5min":0.66400000000000003,"15min":0.66400000000000003},"max":{"1min":1.3380000000000001,"5min":1.3380000000000001,"15min":1.3380000000000001},"last":0.70199999999999996}]}]},{"osd":5,"up_from":0,"seq":0,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1666156,"kb_used_data":92033260,"kb_used_omap":2885,"kb_used_meta":0,"kb_avail":92033224,"statfs":{"total":95948165120,"available":94242021376,"internally_reserved":36864,"allocated":94242058240,"data_stored":94242058240,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2954903,"internal_metadata":0},"hb_peers":[0,1,2,3,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.749,"5min":0.753,"15min":0.74099999999999999},"min":{"1min":0.38800000000000001,"5min":0.311,"15min":0.311},"max":{"1min":1.1819999999999999,"5min":1.6299999999999999,"15min":1.6299999999999999},"last":0.79200000000000004},{"interface":"front","average":{"1min":0.71899999999999997,"5min":0.77000000000000002,"15min":0.76600000000000001},"min":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.048,"5min":1.2370000000000001,"15min":1.2370000000000001},"last":0.91000000000000003}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.78000000000000003,"5min":0.80200000000000005,"15min":0.81299999999999994},"min":{"1min":0.62,"5min":0.505,"15min":0.505},"max":{"1min":1.1000000000000001,"5min":1.2410000000000001,"15min":1.2410000000000001},"last":0.88100000000000001},{"interface":"front","average":{"1min":0.85399999999999998,"5min":0.83599999999999997,"15min":0.83899999999999997},"min":{"1min":0.628,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.1619999999999999,"5min":1.2869999999999999,"15min":1.2869999999999999},"last":0.60699999999999998}]},{"osd":2,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.92300000000000004,"5min":0.84999999999999998,"15min":0.84599999999999997},"min":{"1min":0.65200000000000002,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.802,"5min":1.802,"15min":1.802},"last":0.58299999999999996},{"interface":"front","average":{"1min":0.96599999999999997,"5min":0.90500000000000003,"15min":0.88},"min":{"1min":0.54200000000000004,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":1.4319999999999999},"last":0.96299999999999997}]},{"osd":3,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.97799999999999998,"5min":0.86799999999999999,"15min":0.92200000000000004},"min":{"1min":0.64200000000000002,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.4730000000000001,"5min":2.3519999999999999,"15min":2.3519999999999999},"last":1.008},{"interface":"front","average":{"1min":0.93000000000000005,"5min":0.871,"15min":0.82399999999999995},"min":{"1min":0.69999999999999996,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.234,"5min":1.716,"15min":1.716},"last":0.67300000000000004}]},{"osd":5,"last update":"Sun Apr 3 06:41:02 2022","interfaces":[{"interface":"back","average":{"1min":0.79200000000000004,"5min":0.82599999999999996,"15min":0.85799999999999998},"min":{"1min":0.496,"5min":0.442,"15min":0.442},"max":{"1min":1.137,"5min":1.294,"15min":1.294},"last":0.68999999999999995},{"interface":"front","average":{"1min":1.0529999999999999,"5min":0.97399999999999998,"15min":0.96499999999999997},"min":{"1min":0.52100000000000002,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.407,"5min":1.556,"15min":1.556},"last":1.002}]},{"osd":6,"last update":"Sun Apr 3 06:41:36 2022","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.93300000000000005,"15min":0.88200000000000001},"min":{"1min":0.66700000000000004,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.3680000000000001,"5min":1.4370000000000001,"15min":1.4370000000000001},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.097,"5min":0.997,"15min":0.95499999999999996},"min":{"1min":0.73599999999999999,"5min":0.437,"15min":0.437},"max":{"1min":1.5109999999999999,"5min":1.5109999999999999,"15min":1.5109999999999999},"last":0.73599999999999999}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":0.94899999999999995,"5min":0.94899999999999995,"15min":0.94899999999999995},"min":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.534,"5min":1.534,"15min":1.534},"last":0.70599999999999996},{"interface":"front","average":{"1min":1.131,"5min":1.131,"15min":1.131},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.502,"5min":1.502,"15min":1.502},"last":0.83999999999999997}]}]},{"osd":3,"up_from":13,"seq":55834574919,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":1045484,"kb_used_data":92653960,"kb_used_omap":2064,"kb_used_meta":0,"kb_avail":92653896,"statfs":{"total":95948165120,"available":94877589504,"internally_reserved":65536,"allocated":94877655040,"data_stored":94877655040,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2114140,"internal_metadata":0},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.57799999999999996,"5min":0.64400000000000002,"15min":0.72699999999999998},"min":{"1min":0.44900000000000001,"5min":0.307,"15min":0.307},"max":{"1min":0.90700000000000003,"5min":1.581,"15min":1.581},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.71299999999999997,"5min":0.69299999999999995,"15min":0.66200000000000003},"min":{"1min":0.47899999999999998,"5min":0.37,"15min":0.37},"max":{"1min":1.071,"5min":1.1839999999999999,"15min":1.1839999999999999},"last":0.84499999999999997}]},{"osd":1,"last update":"Sun Apr 3 06:41:24 2022","interfaces":[{"interface":"back","average":{"1min":0.63300000000000001,"5min":0.64900000000000002,"15min":0.65000000000000002},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.84299999999999997,"5min":0.93300000000000005,"15min":0.93300000000000005},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.72599999999999998,"5min":0.71699999999999997,"15min":0.70199999999999996},"min":{"1min":0.34799999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":0.97699999999999998,"5min":1.0920000000000001,"15min":1.0920000000000001},"last":0.65500000000000003}]},{"osd":2,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.66800000000000004,"5min":0.71399999999999997,"15min":0.73199999999999998},"min":{"1min":0.44700000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.871,"5min":1.421,"15min":1.421},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.76600000000000001,"5min":0.748,"15min":0.81000000000000005},"min":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"max":{"1min":1.089,"5min":1.627,"15min":1.627},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.91200000000000003,"5min":0.93799999999999994,"15min":0.94199999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.135,"5min":1.466,"15min":1.466},"last":0.95199999999999996},{"interface":"front","average":{"1min":0.88200000000000001,"5min":0.92900000000000005,"15min":0.91900000000000004},"min":{"1min":0.496,"5min":0.496,"15min":0.496},"max":{"1min":1.25,"5min":1.5609999999999999,"15min":1.5609999999999999},"last":0.86899999999999999}]},{"osd":5,"last update":"Sun Apr 3 06:40:57 2022","interfaces":[{"interface":"back","average":{"1min":0.94099999999999995,"5min":0.95799999999999996,"15min":0.98899999999999999},"min":{"1min":0.48599999999999999,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.3029999999999999,"5min":1.575,"15min":1.575},"last":0.78200000000000003},{"interface":"front","average":{"1min":0.97199999999999998,"5min":0.999,"15min":1.0409999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.2809999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"last":0.97899999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":1.042,"15min":1.0680000000000001},"min":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"max":{"1min":1.599,"5min":1.599,"15min":1.599},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.038,"5min":1.0269999999999999,"15min":1.022},"min":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"max":{"1min":1.506,"5min":1.506,"15min":1.506},"last":1.044}]},{"osd":7,"last update":"Sun Apr 3 06:41:29 2022","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":1.0980000000000001,"15min":1.0980000000000001},"min":{"1min":0.64100000000000001,"5min":0.64100000000000001,"15min":0.64100000000000001},"max":{"1min":1.6559999999999999,"5min":1.6559999999999999,"15min":1.6559999999999999},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":1.1040000000000001,"15min":1.1040000000000001},"min":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.4590000000000001,"5min":1.4590000000000001,"15min":1.4590000000000001},"last":1.097}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":2018996,"kb_used_data":91714540,"kb_used_omap":4382,"kb_used_meta":0,"kb_avail":91680384,"statfs":{"total":95948165120,"available":93880713216,"internally_reserved":34975744,"allocated":93915688960,"data_stored":93915688960,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4488049,"internal_metadata":0},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.57099999999999995,"5min":0.57899999999999996,"15min":0.59999999999999998},"min":{"1min":0.246,"5min":0.246,"15min":0.246},"max":{"1min":0.80300000000000005,"5min":0.89300000000000002,"15min":0.89300000000000002},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.61699999999999999,"5min":0.64800000000000002,"15min":0.66300000000000003},"min":{"1min":0.45200000000000001,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":0.91600000000000004,"5min":1.1930000000000001,"15min":1.1930000000000001},"last":1.0669999999999999}]},{"osd":1,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":0.68100000000000005,"5min":0.64500000000000002,"15min":0.63700000000000001},"min":{"1min":0.24199999999999999,"5min":0.24199999999999999,"15min":0.24199999999999999},"max":{"1min":0.96699999999999997,"5min":1.0349999999999999,"15min":1.0349999999999999},"last":0.53100000000000003},{"interface":"front","average":{"1min":0.84999999999999998,"5min":0.66800000000000004,"15min":0.64400000000000002},"min":{"1min":0.39600000000000002,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":1.248,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":0.81999999999999995}]},{"osd":3,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.58099999999999996,"5min":0.59199999999999997,"15min":0.60399999999999998},"min":{"1min":0.34100000000000003,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.77500000000000002,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.55500000000000005},{"interface":"front","average":{"1min":0.68700000000000006,"5min":0.72999999999999998,"15min":0.78600000000000003},"min":{"1min":0.27900000000000003,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":1.0620000000000001,"5min":1.2090000000000001,"15min":1.2090000000000001},"last":0.73199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.81899999999999995,"5min":0.84499999999999997,"15min":0.88300000000000001},"min":{"1min":0.53700000000000003,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.081,"5min":1.7470000000000001,"15min":1.7470000000000001},"last":1.133},{"interface":"front","average":{"1min":0.878,"5min":0.88300000000000001,"15min":0.92900000000000005},"min":{"1min":0.61199999999999999,"5min":0.498,"15min":0.498},"max":{"1min":1.1180000000000001,"5min":1.3089999999999999,"15min":1.3089999999999999},"last":0.88600000000000001}]},{"osd":5,"last update":"Sun Apr 3 06:41:04 2022","interfaces":[{"interface":"back","average":{"1min":0.90800000000000003,"5min":0.92600000000000005,"15min":1.0169999999999999},"min":{"1min":0.60399999999999998,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.2050000000000001,"5min":1.734,"15min":1.734},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.052,"5min":0.99099999999999999,"15min":1.0009999999999999},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":2.4809999999999999,"5min":2.4809999999999999,"15min":2.4809999999999999},"last":1.1890000000000001}]},{"osd":6,"last update":"Sun Apr 3 06:40:40 2022","interfaces":[{"interface":"back","average":{"1min":0.90500000000000003,"5min":0.90900000000000003,"15min":0.92100000000000004},"min":{"1min":0.64000000000000001,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":1.1990000000000001,"5min":1.222,"15min":1.222},"last":0.97799999999999998},{"interface":"front","average":{"1min":0.98799999999999999,"5min":0.995,"15min":0.997},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.3999999999999999,"5min":2.1320000000000001,"15min":2.1320000000000001},"last":0.94499999999999995}]},{"osd":7,"last update":"Sun Apr 3 06:41:28 2022","interfaces":[{"interface":"back","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.627},{"interface":"front","average":{"1min":1.071,"5min":1.071,"15min":1.071},"min":{"1min":0.48099999999999998,"5min":0.48099999999999998,"15min":0.48099999999999998},"max":{"1min":1.571,"5min":1.571,"15min":1.571},"last":1.0529999999999999}]}]},{"osd":1,"up_from":140,"seq":601295421481,"num_pgs":2,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93699380,"kb_used":940628,"kb_used_data":92758752,"kb_used_omap":1103,"kb_used_meta":0,"kb_avail":92758752,"statfs":{"total":95948165120,"available":94984962048,"internally_reserved":0,"allocated":94984962048,"data_stored":94984962048,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1129502,"internal_metadata":0},"hb_peers":[0,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.58499999999999996,"5min":0.57799999999999996,"15min":0.56100000000000005},"min":{"1min":0.252,"5min":0.252,"15min":0.252},"max":{"1min":0.83099999999999996,"5min":0.98599999999999999,"15min":0.98599999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":0.66200000000000003,"5min":0.622,"15min":0.60299999999999998},"min":{"1min":0.35599999999999998,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.94399999999999995,"5min":1.2030000000000001,"15min":1.2030000000000001},"last":0.80800000000000005}]},{"osd":2,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.68999999999999995,"5min":0.68700000000000006,"15min":0.67600000000000005},"min":{"1min":0.314,"5min":0.314,"15min":0.314},"max":{"1min":1.139,"5min":1.3680000000000001,"15min":1.3680000000000001},"last":0.53000000000000003},{"interface":"front","average":{"1min":0.72199999999999998,"5min":0.68200000000000005,"15min":0.66000000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":1.1599999999999999,"5min":1.1599999999999999,"15min":1.1599999999999999},"last":0.72599999999999998}]},{"osd":3,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.73499999999999999,"5min":0.70099999999999996,"15min":0.68100000000000005},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":1.123,"5min":1.1850000000000001,"15min":1.1850000000000001},"last":0.92900000000000005},{"interface":"front","average":{"1min":0.71199999999999997,"5min":0.70999999999999996,"15min":0.70699999999999996},"min":{"1min":0.251,"5min":0.251,"15min":0.251},"max":{"1min":0.98499999999999999,"5min":1.111,"15min":1.111},"last":0.85199999999999998}]},{"osd":4,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.876,"5min":0.86899999999999999,"15min":0.86599999999999999},"min":{"1min":0.61799999999999999,"5min":0.56499999999999995,"15min":0.56499999999999995},"max":{"1min":1.2130000000000001,"5min":1.3360000000000001,"15min":1.3360000000000001},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.91700000000000004,"5min":0.89800000000000002,"15min":0.88400000000000001},"min":{"1min":0.442,"5min":0.442,"15min":0.442},"max":{"1min":1.27,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":0.999}]},{"osd":5,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.90900000000000003,"5min":0.91400000000000003,"15min":0.89800000000000002},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":1.1859999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.95699999999999996},{"interface":"front","average":{"1min":0.94899999999999995,"5min":0.94799999999999995,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.60299999999999998,"15min":0.60299999999999998},"max":{"1min":1.2989999999999999,"5min":1.3069999999999999,"15min":1.3069999999999999},"last":0.73099999999999998}]},{"osd":6,"last update":"Sun Apr 3 06:41:23 2022","interfaces":[{"interface":"back","average":{"1min":0.996,"5min":1.008,"15min":1.0029999999999999},"min":{"1min":0.52300000000000002,"5min":0.52300000000000002,"15min":0.52300000000000002},"max":{"1min":1.2509999999999999,"5min":1.3720000000000001,"15min":1.3720000000000001},"last":1.1479999999999999},{"interface":"front","average":{"1min":0.97099999999999997,"5min":0.95699999999999996,"15min":0.94399999999999995},"min":{"1min":0.70699999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":1.3169999999999999,"5min":1.4339999999999999,"15min":1.4339999999999999},"last":0.95699999999999996}]},{"osd":7,"last update":"Sun Apr 3 06:41:30 2022","interfaces":[{"interface":"back","average":{"1min":1.0089999999999999,"5min":1.0089999999999999,"15min":1.0089999999999999},"min":{"1min":0.54000000000000004,"5min":0.54000000000000004,"15min":0.54000000000000004},"max":{"1min":1.2450000000000001,"5min":1.2450000000000001,"15min":1.2450000000000001},"last":1.0429999999999999},{"interface":"front","average":{"1min":1.0640000000000001,"5min":1.0640000000000001,"15min":1.0640000000000001},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.2809999999999999,"5min":1.2809999999999999,"15min":1.2809999999999999},"last":1.075}]}]},{"osd":0,"up_from":0,"seq":55834574918,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]}],"pool_statfs":[]}} , 2022-04-03T06:41:43.615 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-04-03T06:41:43.897 INFO:teuthology.orchestra.run.smithi141.stdout: 2022-04-03T17:58:32.872 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: "sortbitwise" , 2022-04-03T06:42:45.153 INFO:teuthology.orchestra.run.smithi141.stdout: ], , 2022-04-03T06:42:45.154 INFO:teuthology.orchestra.run.smithi141.stdout: "crush_version": 9, 2022-04-03T17:58:32.873 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.177 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_barrier": 0, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "peering_crush_bucket_mandatory_member": 2147483647, , 2022-04-03T06:42:45.178 INFO:teuthology.orchestra.run.smithi141.stdout: "object_hash": 2, 2022-04-03T17:58:32.873 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "quota_max_objects": 0, , 2022-04-03T06:42:45.201 INFO:teuthology.orchestra.run.smithi141.stdout: "tiers": [ , 2022-04-03T06:42:45.202 INFO:teuthology.orchestra.run.smithi141.stdout: 4 2022-04-03T17:58:32.874 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "hit_set_search_last_n": 0, , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: "grade_table": [ , 2022-04-03T06:42:45.225 INFO:teuthology.orchestra.run.smithi141.stdout: 1000000, 2022-04-03T17:58:32.875 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.248 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addrs": { , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: "addrvec": [ , 2022-04-03T06:42:45.249 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.875 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_begin": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "last_clean_end": 0, , 2022-04-03T06:42:45.273 INFO:teuthology.orchestra.run.smithi141.stdout: "up_from": 13, 2022-04-03T17:58:32.876 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "cluster_addr": "172.21.15.166:6801/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_back_addr": "172.21.15.166:6803/13910", , 2022-04-03T06:42:45.296 INFO:teuthology.orchestra.run.smithi141.stdout: "heartbeat_front_addr": "172.21.15.166:6802/13910", 2022-04-03T17:58:32.876 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "addr": "172.21.15.166:6814", , 2022-04-03T06:42:45.319 INFO:teuthology.orchestra.run.smithi141.stdout: "nonce": 15019 , 2022-04-03T06:42:45.320 INFO:teuthology.orchestra.run.smithi141.stdout: } 2022-04-03T17:58:32.877 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: "dead_epoch": 88 , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: }, , 2022-04-03T06:42:45.343 INFO:teuthology.orchestra.run.smithi141.stdout: { 2022-04-03T17:58:32.878 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "degraded_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "recovering_stretch_mode": 0, , 2022-04-03T06:42:45.367 INFO:teuthology.orchestra.run.smithi141.stdout: "stretch_mode_bucket": 0 2022-04-03T17:58:32.881 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:12.910 INFO:teuthology.orchestra.run.smithi141.stdout:55834574940 , 2022-04-03T06:43:12.923 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574939 got 55834574940 for osd.3 , 2022-04-03T06:43:12.923 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2022-04-03T17:58:32.882 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:43:30.189 INFO:teuthology.orchestra.run.smithi141.stdout:} , 2022-04-03T06:43:30.200 DEBUG:teuthology.orchestra.run.smithi141:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub 2022-04-03T17:58:32.883 WARNING:scrape:Ignoring malparsed backtrace: 2022-04-03T06:44:13.995 DEBUG:tasks.ceph.osd.1:waiting for process to exit , 2022-04-03T06:44:13.995 INFO:teuthology.orchestra.run:waiting for 300 , 2022-04-03T06:44:14.013 INFO:tasks.ceph.osd.1:Stopped 2022-04-03T17:58:32.884 WARNING:scrape:Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/contextutil.py", line 33, in nested , yield vars 2022-04-03T17:58:32.884 WARNING:scrape:Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_d877b023166308f282187444de8e8e725ffb27d2/teuthology/orchestra/run.py", line 479, in wait , proc.wait() 2022-04-03T17:58:33.525 INFO:scrape:Found 11 distinct failure reasons 2022-04-03T17:58:33.527 INFO:scrape:Failure: expected valgrind issues and found none 2022-04-03T17:58:33.528 INFO:scrape:1 jobs: ['6774550'] 2022-04-03T17:58:33.528 INFO:scrape:suites: ['2-inject-leak/mon', 'centos_latest}', 'rados/valgrind-leaks/{1-start'] 2022-04-03T17:58:33.528 INFO:scrape: 2022-04-03T17:58:33.529 INFO:scrape:Failure: Command failed on smithi149 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" 2022-04-03T17:58:33.529 INFO:scrape:12 jobs: ['6774611', '6774601', '6774639', '6774595', '6774570', '6774586', '6774600', '6774553', '6774620', '6774555', '6774615', '6774610'] 2022-04-03T17:58:33.530 INFO:scrape:suites intersection: [] 2022-04-03T17:58:33.530 INFO:scrape:suites union: ['1-ranks/1', '1-ranks/2', '1-start', '1-volume/{0-create', '2-allow_standby_replay/no', '2-allow_standby_replay/yes', '2-client', '2-thrash', '3-inline/no', '3-inline/yes', '3-tasks/rados_api_tests', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'fixed-2', 'mds', 'mon', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/many', 'msgr-failures/none', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'osd}', 'overrides/{pg-warn', 'rados', 'rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'rados/singleton/{all/mon-config-key-caps', 'rados/singleton/{all/mon-config-keys', 'roles', 'root}', 'supported-random-distro$/{centos_8}}', 'task/test_adoption}', 'task/test_cephadm_repos}', 'task/test_cephadm}', 'task/test_e2e}', 'task/test_iscsi_pids_limit/{centos_8.stream_container_tools', 'tasks/{0-from/v16.2.4', 'test_iscsi_pids_limit}}', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-03T17:58:33.531 INFO:scrape: 2022-04-03T17:58:33.531 INFO:scrape:Dead: b'2022-04-03T13:37:25.101 DEBUG:teuthology.exit:Finished running handlers' 2022-04-03T17:58:33.532 INFO:scrape:5 jobs: ['6774347', '6774281', '6774488', '6774377', '6774470'] 2022-04-03T17:58:33.532 INFO:scrape:suites intersection: [] 2022-04-03T17:58:33.533 INFO:scrape:suites union: ['0-nvme-loop', '1-bootstrap/16.2.4', '1-bootstrap/octopus', '1-start', '2-nfs', '2-ops/rm-zap-flag}', '3-upgrade-with-workload', '4-final}', 'ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/cephadm/osds/{0-distro/ubuntu_18.04', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] 2022-04-03T17:58:33.533 INFO:scrape: 2022-04-03T17:58:33.534 INFO:scrape:Failure: SSH connection to smithi184 was lost: 'uname -r' 2022-04-03T17:58:33.534 INFO:scrape:8 jobs: ['6774542', '6774420', '6774315', '6774368', '6774445', '6774338', '6774255', '6774476'] 2022-04-03T17:58:33.535 INFO:scrape:suites intersection: [] 2022-04-03T17:58:33.535 INFO:scrape:suites union: ['0-nvme-loop', '1-install/luminous', '1-install/luminous-v1only', '1-install/mimic', '1-install/nautilus', '1-start', '2-partial-upgrade/firsthalf', '2-services/rgw-ingress', '3-final}', '3-thrash/default', '4-workload/{rbd-cls', '5-workload/{radosbench', '6-finish-upgrade', '7-pacific', '8-workload/{rbd-python', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'bluestore-bitmap', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'distro$/{ubuntu_18.04}', 'distro/ubuntu_18.04', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04', 'rados/cephadm/smoke/{0-nvme-loop', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack', 'rbd-import-export', 'rbd_api}', 'readwrite', 'snaps-few-objects}', 'snaps-many-objects}', 'start}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/pggrow', 'thrashosds-health', 'three-plus-one}', 'ubuntu_18.04}', 'workloads/cache-snaps}', 'workloads/snaps-few-objects}'] 2022-04-03T17:58:33.536 INFO:scrape: 2022-04-03T17:58:33.536 INFO:scrape:Failure: Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f0fd890e-b350-11ec-8c36-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' 2022-04-03T17:58:33.537 INFO:scrape:1 jobs: ['6774576'] 2022-04-03T17:58:33.537 INFO:scrape:suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'rados/cephadm/osds/{0-distro/ubuntu_18.04'] 2022-04-03T17:58:33.538 INFO:scrape: 2022-04-03T17:58:33.539 INFO:scrape:Failure: Command failed on smithi139 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 422658c0-b30a-11ec-8c36-001a4aab830c -- ceph orch daemon add osd smithi139:vg_nvme/lv_4' 2022-04-03T17:58:33.539 INFO:scrape:1 jobs: ['6774243'] 2022-04-03T17:58:33.540 INFO:scrape:suites: ['1-ranks/2', '1-volume/{0-create', '2-allow_standby_replay/no', '2-client', '3-inline/no', '3-upgrade-with-workload', '4-verify}', '4-verify}}', 'centos_8.stream_container_tools', 'conf/{client', 'mds', 'mon', 'osd}', 'overrides/{pg-warn', 'rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap', 'roles', 'tasks/{0-from/v16.2.4', 'whitelist_health', 'whitelist_wrongly_marked_down}'] 2022-04-03T17:58:33.540 INFO:scrape: 2022-04-03T17:58:33.541 INFO:scrape:Failure: [Errno 2] Cannot find file on the remote 'ubuntu@smithi165.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' 2022-04-03T17:58:33.541 INFO:scrape:2 jobs: ['6774531', '6774272'] 2022-04-03T17:58:33.542 INFO:scrape:suites intersection: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-04-03T17:58:33.542 INFO:scrape:suites union: ['0-kubeadm', '1-rook', '2-workload/none', '3-final', 'cluster/1-node', 'cluster/3-node', 'k8s/1.21', 'net/calico', 'rados/rook/smoke/{0-distro/ubuntu_20.04', 'rook/master}'] 2022-04-03T17:58:33.543 INFO:scrape: 2022-04-03T17:58:33.543 INFO:scrape:Failure: Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' 2022-04-03T17:58:33.544 INFO:scrape:4 jobs: ['6774635', '6774556', '6774629', '6774557'] 2022-04-03T17:58:33.544 INFO:scrape:suites intersection: [] 2022-04-03T17:58:33.544 INFO:scrape:suites union: ['1-bootstrap/16.2.4', '1-bootstrap/16.2.5', '1-start', '2-nfs', '3-upgrade-with-workload', '4-final}', 'ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async', 'msgr/async-v2only', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/valgrind}'] 2022-04-03T17:58:33.545 INFO:scrape: 2022-04-03T17:58:33.545 INFO:scrape:Failure: "2022-04-03T07:30:08.799616+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Degraded data redundancy: 1/52 objects degraded (1.923%), 1 pg degraded (PG_DEGRADED)" in cluster log 2022-04-03T17:58:33.546 INFO:scrape:1 jobs: ['6774362'] 2022-04-03T17:58:33.546 INFO:scrape:suites: ['mon_election/connectivity', 'rados', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'supported-random-distro$/{centos_8}}'] 2022-04-03T17:58:33.547 INFO:scrape: 2022-04-03T17:58:33.548 INFO:scrape:Failure: Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) 2022-04-03T17:58:33.548 INFO:scrape:1 jobs: ['6774633'] 2022-04-03T17:58:33.548 INFO:scrape:suites: ['mon_election/classic', 'rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools', 'task/test_nfs}'] 2022-04-03T17:58:33.549 INFO:scrape: 2022-04-03T17:58:33.549 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op cache_flush 50 --op cache_try_flush 50 --op cache_evict 50 --op write_excl 50 --pool base' 2022-04-03T17:58:33.550 INFO:scrape:1 jobs: ['6774297'] 2022-04-03T17:58:33.550 INFO:scrape:suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{default}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/cache-snaps}'] 2022-04-03T17:58:33.551 INFO:scrape: 2022-04-03T17:58:33.566 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi ================================================================= info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/ logs: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/ failed: 24 dead: 13 running: 0 waiting: 0 queued: 0 passed: 380 Fail ================================================================= [6774243] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774243/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774243/ sentry: https://sentry.ceph.com/organizations/ceph/?query=610d236c34464e128822cc8e7447c403 Command failed on smithi139 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image docker.io/ceph/ceph:v16.2.4 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 422658c0-b30a-11ec-8c36-001a4aab830c -- ceph orch daemon add osd smithi139:vg_nvme/lv_4' [6774272] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/3-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774272/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774272/ sentry: https://sentry.ceph.com/organizations/ceph/?query=543dfa14b2d54596b5f0d319d426ad05 [Errno 2] Cannot find file on the remote 'ubuntu@smithi038.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6774297] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:14:25 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774297/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774297/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op copy_from 50 --op cache_flush 50 --op cache_try_flush 50 --op cache_evict 50 --op write_excl 50 --pool base' [6774362] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:12:16 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774362/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774362/ "2022-04-03T07:30:08.799616+0000 mon.a (mon.0) 169 : cluster [WRN] Health check failed: Degraded data redundancy: 1/52 objects degraded (1.923%), 1 pg degraded (PG_DEGRADED)" in cluster log [6774531] rados/rook/smoke/{0-distro/ubuntu_20.04 0-kubeadm 1-rook 2-workload/none 3-final cluster/1-node k8s/1.21 net/calico rook/master} ----------------------------------------------------------------- time: 00:05:47 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774531/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774531/ sentry: https://sentry.ceph.com/organizations/ceph/?query=3e6fef51578f4f0d822d5517a4233d56 [Errno 2] Cannot find file on the remote 'ubuntu@smithi165.front.sepia.ceph.com': 'rook/cluster/examples/kubernetes/ceph/operator.yaml' [6774550] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} ----------------------------------------------------------------- time: 01:07:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774550/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774550/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4aeb82c311974bf0b505d54996f4f7af expected valgrind issues and found none [6774553] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} ----------------------------------------------------------------- time: 00:09:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774553/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774553/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ea468be827dd440685809e2039227704 Command failed on smithi149 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6774555] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:33 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774555/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774555/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0b4b60484b1f46e5ab7ebc0ea93ef7b3 Command failed on smithi116 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6774556] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} ----------------------------------------------------------------- time: 01:07:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774556/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774556/ sentry: https://sentry.ceph.com/organizations/ceph/?query=37c1c967d2ed4e059e773e9100e8912d Command failed on smithi073 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' [6774557] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774557/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774557/ sentry: https://sentry.ceph.com/organizations/ceph/?query=351fd6e91e854a0da175a74d368230c9 Command failed on smithi026 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6774570] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} ----------------------------------------------------------------- time: 00:05:59 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774570/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774570/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f539125cd31c489e8947c4db8ad455cd Command failed on smithi059 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774576] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} ----------------------------------------------------------------- time: 00:11:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774576/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774576/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b0f056f7b28b4729940fe5d144014dcf Command failed on smithi038 with status 22: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph- ci/ceph:f5e8c20edf1fd6ce9fe4d0f2c8790aa6d1433460 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid f0fd890e-b350-11ec-8c36-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nceph orch device ls\nDEVID=$(ceph device ls | grep osd.1 | awk \'"\'"\'{print $1}\'"\'"\')\nHOST=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $1}\'"\'"\')\nDEV=$(ceph orch device ls | grep $DEVID | awk \'"\'"\'{print $2}\'"\'"\')\necho "host $HOST, dev $DEV, devid $DEVID"\nceph orch osd rm 1\nwhile ceph orch osd rm status | grep ^1 ; do sleep 5 ; done\nceph orch device zap $HOST $DEV --force\nwhile ! ceph osd dump | grep osd.1 | grep up ; do sleep 5 ; done\n\'' [6774586] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} ----------------------------------------------------------------- time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774586/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774586/ sentry: https://sentry.ceph.com/organizations/ceph/?query=f292138fbd084f0fb12e33e0bbb9ce81 Command failed on smithi055 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774595] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:13:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774595/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774595/ sentry: https://sentry.ceph.com/organizations/ceph/?query=4e6bd2d8f4e144229175aca3a73dfee6 Command failed on smithi186 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" [6774600] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} ----------------------------------------------------------------- time: 00:04:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774600/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774600/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ae6de1b0e0224ac8a2737aefb5b11b19 Command failed on smithi184 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774601] rados/singleton/{all/mon-config-key-caps mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774601/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774601/ sentry: https://sentry.ceph.com/organizations/ceph/?query=05df3e2a5ab1444c96a6dd901d67d93c Command failed on smithi165 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774610] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v2only root} ----------------------------------------------------------------- time: 00:15:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774610/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774610/ sentry: https://sentry.ceph.com/organizations/ceph/?query=9889bfdf3b18443cbef9d3c68ba905e1 Command failed on smithi043 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774611] rados/singleton/{all/mon-config-keys mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}} ----------------------------------------------------------------- time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774611/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774611/ sentry: https://sentry.ceph.com/organizations/ceph/?query=04e46d677b234311a62a41036af6c381 Command failed on smithi149 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774615] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774615/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774615/ sentry: https://sentry.ceph.com/organizations/ceph/?query=df51cfeae2024aee95250c879b24a7f8 Command failed on smithi084 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774620] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} ----------------------------------------------------------------- time: 00:10:31 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774620/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774620/ sentry: https://sentry.ceph.com/organizations/ceph/?query=33f67406825e40c9978019c7715e9c09 Command failed on smithi083 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.0" [6774629] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:08:31 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774629/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774629/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e25574f80fc49848bcea96a4093bb8d Command failed on smithi116 with status 5: "sudo TESTDIR=/home/ubuntu/cephtest bash -ex -c 'systemctl stop nfs-server'" [6774633] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} ----------------------------------------------------------------- time: 00:11:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774633/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774633/ sentry: https://sentry.ceph.com/organizations/ceph/?query=5e96d65b0db64042914264cb8ba37f25 Test failure: test_cluster_set_reset_user_config (tasks.cephfs.test_nfs.TestNFS) [6774635] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 01:07:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774635/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774635/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b02f7470f1684ad884c46fafa91fec85 Command failed on smithi026 with status 1: 'sudo ceph --cluster ceph osd crush tunables default' [6774639] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} ----------------------------------------------------------------- time: 00:12:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774639/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774639/ sentry: https://sentry.ceph.com/organizations/ceph/?query=eee9bfc91db14bbcb242697ebd39c7cd Command failed on smithi107 with status 2: "cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\\0' >/home/ubuntu/cephtest/workunits.list.client.1" Dead ================================================================= [6774255] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774255/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774255/ sentry: https://sentry.ceph.com/organizations/ceph/?query=293d3baab2274021be5c8c53bf8e5377 SSH connection to smithi064 was lost: 'uname -r' [6774281] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774281/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774281/ hit max job timeout [6774315] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774315/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774315/ sentry: https://sentry.ceph.com/organizations/ceph/?query=957a651de1ba4abcb705b28baeccea86 SSH connection to smithi117 was lost: 'uname -r' [6774338] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_18.04} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774338/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774338/ sentry: https://sentry.ceph.com/organizations/ceph/?query=324dc9ab172c42c49c2c1ca8b11fd985 SSH connection to smithi117 was lost: 'uname -r' [6774347] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.4 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774347/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774347/ hit max job timeout [6774368] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774368/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774368/ sentry: https://sentry.ceph.com/organizations/ceph/?query=07a41222b8a34c779250852dcdcab691 SSH connection to smithi040 was lost: 'uname -r' [6774377] rados/cephadm/osds/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-ops/rm-zap-flag} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774377/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774377/ hit max job timeout [6774420] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774420/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774420/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e12499ec5c244a9852ce6184667b1ee SSH connection to smithi039 was lost: 'uname -r' [6774445] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774445/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774445/ sentry: https://sentry.ceph.com/organizations/ceph/?query=51add86c282f406fb50ee6eba0e6ad27 SSH connection to smithi077 was lost: 'uname -r' [6774470] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/rados_api_tests validater/valgrind} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774470/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774470/ hit max job timeout [6774476] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774476/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774476/ sentry: https://sentry.ceph.com/organizations/ceph/?query=96d023e06a6f48d7ad23ababb484ca8e SSH connection to smithi082 was lost: 'uname -r' [6774488] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/octopus 1-start 2-nfs 3-upgrade-with-workload 4-final} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774488/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774488/ hit max job timeout [6774542] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774542/ log: http://qa-proxy.ceph.com/teuthology/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774542/ sentry: https://sentry.ceph.com/organizations/ceph/?query=a5a9248b18d94b1d8e31d8b173e3e1e2 SSH connection to smithi184 was lost: 'uname -r' Pass ================================================================= [6774238] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:53:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774238/ [6774239] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:12:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774239/ [6774240] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:08:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774240/ [6774241] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-radosbench} time: 02:27:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774241/ [6774242] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:16:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774242/ [6774244] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:13:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774244/ [6774245] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:21:41 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774245/ [6774246] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774246/ [6774247] rados/standalone/{supported-random-distro$/{rhel_8} workloads/mgr} time: 00:20:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774247/ [6774248] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:32:06 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774248/ [6774249] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/rgw 3-final} time: 00:15:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774249/ [6774250] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:24:48 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774250/ [6774251] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:10:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774251/ [6774252] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:24:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774252/ [6774253] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/sync workloads/pool-create-delete} time: 00:25:03 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774253/ [6774254] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:11:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774254/ [6774256] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:41 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774256/ [6774257] rados/singleton/{all/peer mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774257/ [6774258] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v1only root} time: 00:30:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774258/ [6774259] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774259/ [6774260] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:23:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774260/ [6774261] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:36:08 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774261/ [6774262] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/readwrite} time: 00:14:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774262/ [6774263] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_cls_all validater/lockdep} time: 00:16:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774263/ [6774264] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774264/ [6774265] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774265/ [6774266] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:27:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774266/ [6774267] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{rhel_8}} time: 02:20:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774267/ [6774268] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:21:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774268/ [6774269] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774269/ [6774270] rados/singleton/{all/pg-autoscaler-progress-off mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:12:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774270/ [6774271] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:16:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774271/ [6774273] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:59:10 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774273/ [6774274] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/workunits} time: 00:18:59 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774274/ [6774275] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:29:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774275/ [6774276] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774276/ [6774277] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} tasks/mon_clock_with_skews} time: 00:16:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774277/ [6774278] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:29:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774278/ [6774279] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:18:33 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774279/ [6774280] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8}} time: 00:23:52 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774280/ [6774282] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:19:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774282/ [6774283] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-small-objects-balanced} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774283/ [6774284] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774284/ [6774285] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:48 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774285/ [6774286] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774286/ [6774287] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:15:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774287/ [6774288] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:33 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774288/ [6774289] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774289/ [6774290] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:28:06 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774290/ [6774291] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:09:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774291/ [6774292] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v2only root} time: 00:36:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774292/ [6774293] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:22 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774293/ [6774294] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_5925} time: 00:11:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774294/ [6774295] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/sample_fio} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774295/ [6774296] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:25:59 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774296/ [6774298] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/repair_test} time: 00:18:13 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774298/ [6774299] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:32 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774299/ [6774300] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:07:17 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774300/ [6774301] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:29:08 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774301/ [6774302] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:10:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774302/ [6774303] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774303/ [6774304] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:13:25 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774304/ [6774305] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/repave-all} time: 00:15:13 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774305/ [6774306] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/mon_recovery validater/valgrind} time: 00:31:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774306/ [6774307] rados/standalone/{supported-random-distro$/{rhel_8} workloads/misc} time: 00:40:57 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774307/ [6774308] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774308/ [6774309] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:17:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774309/ [6774310] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774310/ [6774311] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:21:17 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774311/ [6774312] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:29:06 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774312/ [6774313] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:14:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774313/ [6774314] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:37:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774314/ [6774316] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:09:50 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774316/ [6774317] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774317/ [6774318] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:14:03 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774318/ [6774319] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774319/ [6774320] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:12:31 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774320/ [6774321] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:14:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774321/ [6774322] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-small-objects-fast-read} time: 00:31:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774322/ [6774323] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:06:57 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774323/ [6774324] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:22:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774324/ [6774325] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:26:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774325/ [6774326] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async root} time: 00:33:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774326/ [6774327] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:33:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774327/ [6774328] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/scrub_test} time: 00:13:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774328/ [6774329] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:18:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774329/ [6774330] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:07 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774330/ [6774331] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774331/ [6774332] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:13:17 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774332/ [6774333] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:38:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774333/ [6774334] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:31 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774334/ [6774335] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_api_tests} time: 00:31:32 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774335/ [6774336] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/connectivity random-objectstore$/{bluestore-hybrid} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774336/ [6774337] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:19:47 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774337/ [6774339] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:26:54 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774339/ [6774340] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:26:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774340/ [6774341] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:16:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774341/ [6774342] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774342/ [6774343] rados/cephadm/dashboard/{0-distro/centos_8.stream_container_tools task/test_e2e} time: 00:21:13 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774343/ [6774344] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:07:06 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774344/ [6774345] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:16 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774345/ [6774346] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/lockdep} time: 00:24:19 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774346/ [6774348] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774348/ [6774349] rados/cephadm/orchestrator_cli/{0-random-distro$/{centos_8.stream_container_tools} 2-node-mgr orchestrator_cli} time: 00:14:32 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774349/ [6774350] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{rhel_8} workloads/ceph_iscsi} time: 00:37:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774350/ [6774351] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774351/ [6774352] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:31:13 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774352/ [6774353] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:46:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774353/ [6774354] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:10:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774354/ [6774355] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:14:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774355/ [6774356] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/failover} time: 00:14:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774356/ [6774357] rados/cephadm/smoke-singlehost/{0-distro$/{rhel_8.4_container_tools_3.0} 1-start 2-services/basic 3-final} time: 00:13:48 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774357/ [6774358] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/libcephsqlite} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774358/ [6774359] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:28:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774359/ [6774360] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774360/ [6774361] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews} time: 00:18:06 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774361/ [6774363] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_adoption} time: 00:10:45 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774363/ [6774364] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:15:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774364/ [6774365] rados/singleton/{all/test-noautoscale-flag mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774365/ [6774366] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:28:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774366/ [6774367] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mon} time: 00:40:13 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774367/ [6774369] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/radosbench} time: 01:35:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774369/ [6774370] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v1only root} time: 00:47:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774370/ [6774371] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:38:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774371/ [6774372] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:41:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774372/ [6774373] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:33:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774373/ [6774374] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:17:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774374/ [6774375] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm} time: 00:15:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774375/ [6774376] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:16:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774376/ [6774378] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_mon_osdmap_prune} time: 01:02:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774378/ [6774379] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 00:42:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774379/ [6774380] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774380/ [6774381] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:17:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774381/ [6774382] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:08:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774382/ [6774383] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:20:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774383/ [6774384] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:19:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774384/ [6774385] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774385/ [6774386] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774386/ [6774387] rados/singleton/{all/thrash-backfill-full mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 01:09:54 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774387/ [6774388] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench} time: 01:32:59 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774388/ [6774389] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/valgrind} time: 02:13:56 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774389/ [6774390] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:18:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774390/ [6774391] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/rados_api_tests} time: 00:26:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774391/ [6774392] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm_repos} time: 00:07:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774392/ [6774393] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774393/ [6774394] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:15:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774394/ [6774395] rados/singleton/{all/thrash-eio mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:27:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774395/ [6774396] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:12:22 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774396/ [6774397] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:06:32 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774397/ [6774398] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/insights} time: 00:23:21 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774398/ [6774399] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async-v2only root} time: 00:30:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774399/ [6774400] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:43:21 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774400/ [6774401] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774401/ [6774402] rados/rook/smoke/{0-distro/ubuntu_18.04 0-kubeadm 1-rook 2-workload/radosbench 3-final cluster/3-node k8s/1.21 net/calico rook/1.6.2} time: 00:29:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774402/ [6774403] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rm-zap-wait} time: 00:14:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774403/ [6774404] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{centos_8}} time: 00:14:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774404/ [6774405] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:21:04 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774405/ [6774406] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774406/ [6774407] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects} time: 00:21:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774407/ [6774408] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}} time: 00:21:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774408/ [6774409] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:24:58 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774409/ [6774410] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:09:56 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774410/ [6774411] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:09:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774411/ [6774412] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:13:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774412/ [6774413] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774413/ [6774414] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:21:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774414/ [6774415] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:09:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774415/ [6774416] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:33:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774416/ [6774417] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls} time: 00:29:04 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774417/ [6774418] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:15:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774418/ [6774419] rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 00:34:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774419/ [6774421] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_mon_workunits} time: 00:25:16 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774421/ [6774422] rados/cephadm/mgr-nfs-upgrade/{0-distro/centos_8.stream_container_tools 1-bootstrap/16.2.5 1-start 2-nfs 3-upgrade-with-workload 4-final} time: 00:23:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774422/ [6774423] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:10:57 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774423/ [6774424] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all} time: 00:16:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774424/ [6774425] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:12:52 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774425/ [6774426] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_nfs} time: 00:25:41 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774426/ [6774427] rados/standalone/{supported-random-distro$/{rhel_8} workloads/osd} time: 03:15:50 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774427/ [6774428] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:14:17 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774428/ [6774429] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/set-chunks-read} time: 00:15:22 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774429/ [6774430] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774430/ [6774431] rados/singleton/{all/watch-notify-same-primary mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8}} time: 00:09:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774431/ [6774432] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/mon_recovery validater/lockdep} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774432/ [6774433] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects} time: 00:46:03 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774433/ [6774434] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async root} time: 00:36:12 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774434/ [6774435] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774435/ [6774436] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:24:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774436/ [6774437] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:17:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774437/ [6774438] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/module_selftest} time: 00:30:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774438/ [6774439] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:08:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774439/ [6774440] rados/singleton/{all/admin-socket mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}} time: 00:17:22 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774440/ [6774441] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774441/ [6774442] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/small-objects-balanced} time: 00:20:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774442/ [6774443] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} tasks/mon_recovery} time: 00:11:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774443/ [6774444] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:13:57 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774444/ [6774446] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:35 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774446/ [6774447] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api} time: 00:27:38 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774447/ [6774448] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:45:58 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774448/ [6774449] rados/singleton/{all/backfill-toofull mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}} time: 00:27:04 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774449/ [6774450] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:16:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774450/ [6774451] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{rhel_8}} time: 00:32:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774451/ [6774452] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:30:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774452/ [6774453] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/rados_python} time: 00:16:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774453/ [6774454] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:37:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774454/ [6774455] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:07 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774455/ [6774456] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-localized} time: 00:23:10 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774456/ [6774457] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/connectivity start} time: 00:14:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774457/ [6774458] rados/cephadm/smoke-singlehost/{0-distro$/{centos_8.stream_container_tools} 1-start 2-services/rgw 3-final} time: 00:12:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774458/ [6774459] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:10:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774459/ [6774460] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/sync workloads/snaps-few-objects} time: 00:34:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774460/ [6774461] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:30:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774461/ [6774462] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:09:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774462/ [6774463] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_adoption} time: 00:11:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774463/ [6774464] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:21:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774464/ [6774465] rados/cephadm/osds/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774465/ [6774466] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774466/ [6774467] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:08:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774467/ [6774468] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:24:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774468/ [6774469] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/small-objects} time: 00:25:03 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774469/ [6774471] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/rados_api_tests fixed-2 msgr/async-v1only root} time: 00:33:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774471/ [6774472] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:22 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774472/ [6774473] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:15:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774473/ [6774474] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests} time: 00:37:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774474/ [6774475] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_cephadm} time: 00:15:28 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774475/ [6774477] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/none msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:29:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774477/ [6774478] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/classic start} time: 00:17:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774478/ [6774479] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_8} tasks/progress} time: 00:32:10 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774479/ [6774480] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774480/ [6774481] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/yes 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:28:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774481/ [6774482] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:24:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774482/ [6774483] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:06:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774483/ [6774484] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-balanced} time: 00:36:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774484/ [6774485] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:15:54 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774485/ [6774486] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub} time: 01:43:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774486/ [6774487] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch} time: 00:17:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774487/ [6774489] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:25:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774489/ [6774490] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_cephadm_repos} time: 00:07:12 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774490/ [6774491] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:08:09 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774491/ [6774492] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/iscsi 3-final} time: 00:14:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774492/ [6774493] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/connectivity start} time: 00:15:33 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774493/ [6774494] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}} time: 00:19:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774494/ [6774495] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:20:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774495/ [6774496] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774496/ [6774497] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:06:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774497/ [6774498] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench} time: 01:05:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774498/ [6774499] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_8}} time: 04:44:35 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774499/ [6774500] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/snaps-few-objects-localized} time: 00:33:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774500/ [6774501] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-ops/rm-zap-add} time: 00:14:58 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774501/ [6774502] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects} time: 00:38:08 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774502/ [6774503] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async-v2only root} time: 00:46:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774503/ [6774504] rados/singleton/{all/ec-inconsistent-hinfo mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}} time: 01:01:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774504/ [6774505] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:13:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774505/ [6774506] rados/cephadm/with-work/{0-distro/centos_8.stream_container_tools fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python} time: 00:22:11 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774506/ [6774507] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/yes 3-inline/no 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:31:25 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774507/ [6774508] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:07:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774508/ [6774509] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:28:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774509/ [6774510] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} time: 00:24:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774510/ [6774511] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_iscsi_pids_limit/{centos_8.stream_container_tools test_iscsi_pids_limit}} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774511/ [6774512] rados/singleton/{all/ec-lost-unfound mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8}} time: 01:20:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774512/ [6774513] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774513/ [6774514] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/mirror 3-final} time: 00:14:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774514/ [6774515] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/classic start} time: 00:17:10 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774515/ [6774516] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} tasks/rados_striper} time: 00:10:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774516/ [6774517] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls} time: 00:31:57 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774517/ [6774518] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:41:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774518/ [6774519] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/prometheus} time: 00:21:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774519/ [6774520] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-bucket 3-final} time: 00:15:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774520/ [6774521] rados/singleton/{all/erasure-code-nonregression mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:17:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774521/ [6774522] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_nfs} time: 00:25:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774522/ [6774523] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:06:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774523/ [6774524] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:06:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774524/ [6774525] rados/cephadm/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} overrides/{pg-warn whitelist_health whitelist_wrongly_marked_down} roles tasks/{0-from/v16.2.4 1-volume/{0-create 1-ranks/1 2-allow_standby_replay/no 3-inline/yes 4-verify} 2-client 3-upgrade-with-workload 4-verify}} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774525/ [6774526] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed} time: 00:15:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774526/ [6774527] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:27:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774527/ [6774528] rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-ops/rm-zap-flag} time: 00:14:08 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774528/ [6774529] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:24:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774529/ [6774530] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/nfs-ingress-rgw-user 3-final} time: 00:13:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774530/ [6774532] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{centos_8}} time: 00:13:03 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774532/ [6774533] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/small-objects fixed-2 msgr/async root} time: 00:30:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774533/ [6774534] rados/singleton/{all/lost-unfound-delete mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 01:01:58 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774534/ [6774535] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_3.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests} time: 00:44:48 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774535/ [6774536] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:39:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774536/ [6774537] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:30:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774537/ [6774538] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/connectivity start} time: 00:17:27 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774538/ [6774539] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/classic task/test_orch_cli} time: 00:13:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774539/ [6774540] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests} time: 00:32:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774540/ [6774541] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/many workloads/pool-create-delete} time: 00:18:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774541/ [6774543] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:57 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774543/ [6774544] rados/dashboard/{centos_8.stream_container_tools clusters/{2-node-mgr} debug/mgr mon_election/classic random-objectstore$/{bluestore-bitmap} supported-random-distro$/{centos_8} tasks/dashboard} time: 01:11:52 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774544/ [6774545] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}} time: 00:18:32 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774545/ [6774546] rados/rest/{mgr-restful supported-random-distro$/{rhel_8}} time: 00:22:45 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774546/ [6774547] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:26:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774547/ [6774548] rados/standalone/{supported-random-distro$/{centos_8} workloads/crush} time: 00:10:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774548/ [6774549] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-pacific 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_18.04} time: 03:00:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774549/ [6774551] rados/singleton/{all/lost-unfound mon_election/connectivity msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 01:23:10 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774551/ [6774552] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/nfs-ingress 3-final} time: 00:16:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774552/ [6774554] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:27:54 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774554/ [6774558] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:05:45 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774558/ [6774559] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:06:20 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774559/ [6774560] rados/cephadm/orchestrator_cli/{0-random-distro$/{ubuntu_20.04} 2-node-mgr orchestrator_cli} time: 00:09:47 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774560/ [6774561] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:21 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774561/ [6774562] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big} time: 01:02:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774562/ [6774563] rados/cephadm/rbd_iscsi/{base/install cluster/{fixed-3 openstack} pool/datapool supported-random-distro$/{centos_8} workloads/ceph_iscsi} time: 00:19:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774563/ [6774564] rados/cephadm/smoke/{0-nvme-loop distro/centos_8.stream_container_tools fixed-2 mon_election/classic start} time: 00:09:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774564/ [6774565] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/workunits} time: 00:05:51 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774565/ [6774566] rados/cephadm/smoke-singlehost/{0-distro$/{ubuntu_18.04} 1-start 2-services/basic 3-final} time: 00:10:16 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774566/ [6774567] rados/cephadm/upgrade/{1-start-distro/1-start-centos_8.stream_container-tools 2-repo_digest/defaut 3-start-upgrade 4-wait 5-upgrade-ls mon_election/classic} time: 00:20:55 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774567/ [6774568] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}} time: 00:10:25 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774568/ [6774569] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_recovery} time: 00:31:07 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774569/ [6774571] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:18:38 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774571/ [6774572] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/nfs-ingress2 3-final} time: 00:14:52 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774572/ [6774573] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small} time: 00:20:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774573/ [6774574] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-radosbench} time: 00:52:59 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774574/ [6774575] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api} time: 00:24:38 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774575/ [6774577] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}} time: 00:19:54 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774577/ [6774578] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}} time: 00:38:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774578/ [6774579] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:19:29 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774579/ [6774580] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-dispatch-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:27:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774580/ [6774581] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/snaps-few-objects fixed-2 msgr/async-v1only root} time: 00:31:21 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774581/ [6774582] rados/cephadm/with-work/{0-distro/rhel_8.4_container_tools_rhel8 fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python} time: 00:29:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774582/ [6774583] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774583/ [6774584] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mix} time: 00:16:50 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774584/ [6774585] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack scheduler/dmclock_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:05:28 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774585/ [6774587] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925} time: 00:17:44 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774587/ [6774588] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:19:09 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774588/ [6774589] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/nfs 3-final} time: 00:12:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774589/ [6774590] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:17:30 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774590/ [6774591] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:35:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774591/ [6774592] rados/singleton/{all/mon-auth-caps mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8}} time: 00:17:28 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774592/ [6774593] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_3.0 fixed-2 mon_election/connectivity start} time: 00:16:01 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774593/ [6774594] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{centos_8}} time: 00:10:53 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774594/ [6774596] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:08:56 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774596/ [6774597] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:35:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774597/ [6774598] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:37 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774598/ [6774599] rados/cephadm/smoke-roleless/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-services/nfs2 3-final} time: 00:12:47 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774599/ [6774602] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:22:33 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774602/ [6774603] rados/cephadm/smoke/{0-nvme-loop distro/rhel_8.4_container_tools_rhel8 fixed-2 mon_election/classic start} time: 00:13:45 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774603/ [6774604] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/rmdir-reactivate} time: 00:15:19 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774604/ [6774605] rados/standalone/{supported-random-distro$/{centos_8} workloads/erasure-code} time: 00:38:08 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774605/ [6774606] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/disable mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:08:04 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774606/ [6774607] rados/cephadm/smoke-roleless/{0-distro/centos_8.stream_container_tools 0-nvme-loop 1-start 2-services/rgw-ingress 3-final} time: 00:12:54 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774607/ [6774608] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:05:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774608/ [6774609] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:00 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774609/ [6774612] rados/cephadm/with-work/{0-distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests} time: 00:34:23 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774612/ [6774613] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack scheduler/wpq_default_shards settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:05:24 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774613/ [6774614] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:30:21 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774614/ [6774616] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects-balanced} time: 00:27:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774616/ [6774617] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/osd-dispatch-delay msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:33:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774617/ [6774618] rados/cephadm/upgrade/{1-start-distro/1-start-ubuntu_20.04-15.2.9 2-repo_digest/repo_digest 3-start-upgrade 4-wait 5-upgrade-ls mon_election/connectivity} time: 00:26:40 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774618/ [6774619] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}} time: 00:15:59 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774619/ [6774621] rados/singleton/{all/mon-config mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:06:22 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774621/ [6774622] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:32:48 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774622/ [6774623] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:36:19 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774623/ [6774624] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench} time: 01:27:15 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774624/ [6774625] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_3.0 0-nvme-loop 1-start 2-services/rgw 3-final} time: 00:15:42 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774625/ [6774626] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-dispatch-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:32 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774626/ [6774627] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_18.04 fixed-2 mon_election/connectivity start} time: 00:15:25 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774627/ [6774628] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests} time: 00:24:04 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774628/ [6774630] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} 3-scrub-overrides/{max-simultaneous-scrubs-3} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/on mon_election/classic msgr-failures/fastclose msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:20:56 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774630/ [6774631] rados/singleton/{all/osd-backfill mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}} time: 00:47:45 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774631/ [6774632] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}} time: 00:06:26 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774632/ [6774634] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls} time: 00:18:34 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774634/ [6774636] rados/cephadm/osds/{0-distro/ubuntu_20.04 0-nvme-loop 1-start 2-ops/repave-all} time: 00:12:17 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774636/ [6774637] rados/objectstore/{backends/filejournal supported-random-distro$/{ubuntu_latest}} time: 00:05:14 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774637/ [6774638] rados/cephadm/smoke-roleless/{0-distro/rhel_8.4_container_tools_rhel8 0-nvme-loop 1-start 2-services/basic 3-final} time: 00:11:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774638/ [6774640] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack scheduler/dmclock_1Shard_16Threads settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:20:05 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774640/ [6774641] rados/singleton/{all/osd-recovery-incomplete mon_election/classic msgr-failures/none msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8}} time: 00:35:47 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774641/ [6774642] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}} time: 00:05:43 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774642/ [6774643] rados/cephadm/thrash/{0-distro/centos_8.stream_container_tools 1-start 2-thrash 3-tasks/radosbench fixed-2 msgr/async root} time: 00:45:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774643/ [6774644] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} 3-scrub-overrides/{max-simultaneous-scrubs-2} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache} time: 00:20:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774644/ [6774645] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:09:33 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774645/ [6774646] rados/cephadm/with-work/{0-distro/ubuntu_20.04 fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python} time: 00:23:49 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774646/ [6774647] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:23:08 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774647/ [6774648] rados/mgr/{clusters/{2-node-mgr} debug/mgr mgr_ttl_cache/enable mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/failover} time: 00:21:46 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774648/ [6774649] rados/cephadm/smoke/{0-nvme-loop distro/ubuntu_20.04 fixed-2 mon_election/classic start} time: 00:16:02 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774649/ [6774650] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:39 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774650/ [6774651] rados/cephadm/workunits/{0-distro/centos_8.stream_container_tools mon_election/connectivity task/test_orch_cli} time: 00:10:18 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774651/ [6774652] rados/singleton/{all/osd-recovery mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8}} time: 00:24:36 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774652/ [6774653] rados/cephadm/smoke-roleless/{0-distro/ubuntu_18.04 0-nvme-loop 1-start 2-services/client-keyring 3-final} time: 00:12:07 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774653/ [6774654] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{rhel_8}} time: 00:16:58 info: http://pulpito.ceph.com/teuthology-2022-04-03_03:31:03-rados-pacific-distro-default-smithi/6774654/