2021-02-16T16:11:07.842 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-16T16:11:07.842 INFO:teuthology.results:subset: '111/120000' 2021-02-16T16:11:07.842 INFO:teuthology.results:seed: '4637' 2021-02-16T16:30:33.695 INFO:root:teuthology version: 1.1.0-071a4df2 2021-02-16T16:30:33.730 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2021-02-16T17:11:34.488 INFO:teuthology.results:Tests finished! gathering results... 2021-02-16T17:11:36.883 INFO:scrape:Found 38 jobs 2021-02-16T17:11:36.884 WARNING:scrape:Missing teuthology log /home/teuthworker/archive/yuriw-2021-02-16_16:01:09-rados-wip-yuri-testing-2021-02-08-1109-octopus-distro-basic-gibba/5887606/teuthology.log 2021-02-16T17:11:39.607 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:39.609 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:39.609 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:39.609 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:39.727 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:39.733 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:39.734 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:39.734 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:39.869 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:39.884 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:39.884 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:39.884 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:40.014 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:40.015 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:40.015 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:40.016 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:40.127 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:40.198 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:40.199 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:40.199 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:40.331 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:40.484 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:40.485 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:40.485 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:40.622 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:40.623 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:40.623 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:40.624 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:40.742 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.8-349-g519abe3e (519abe3e4b47f5c65c84a1097653bbd2fea95358) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f834617b7da] , 2: (()+0x27a9f4) [0x7f834617b9f4] 2021-02-16T17:11:40.743 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:42:25.217 INFO:teuthology.orchestra.run.gibba028.stdout: , dumped all , 2021-02-16T16:42:25.225 INFO:teuthology.orchestra.run.gibba028.stdout:{"pg_ready":true,"pg_map":{"version":126,"stamp":"2021-02-16T16:42:23.674864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29586227877,"num_objects":9943,"num_object_clones":0,"num_object_copies":19886,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9922,"num_whiteouts":44,"num_read":29675,"num_read_kb":9071923,"num_write":52332,"num_write_kb":19452821,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45401,"ondisk_log_size":45401,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":36599588,"kb_used_data":491733188,"kb_used_omap":57271,"kb_used_meta":0,"kb_avail":491624668,"statfs":{"total":540901638144,"available":503423660032,"internally_reserved":111124480,"allocated":503534784512,"data_stored":503534784512,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58645879,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":3,"commit_latency_ns":1000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":169169730,"num_objects":74,"num_object_clones":0,"num_object_copies":148,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":24,"num_read":1162,"num_read_kb":1231403,"num_write":633,"num_write_kb":345903,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":20,"num_flush_kb":46295,"num_evict":20,"num_evict_kb":48725,"num_promote":120,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001994"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094850+0000","last_change":"2021-02-16T16:39:17.874077+0000","last_active":"2021-02-16T16:42:00.094850+0000","last_peered":"2021-02-16T16:42:00.094850+0000","last_clean":"2021-02-16T16:42:00.094850+0000","last_became_active":"2021-02-16T16:39:17.873589+0000","last_became_peered":"2021-02-16T16:39:17.873589+0000","last_unstale":"2021-02-16T16:42:00.094850+0000","last_undegraded":"2021-02-16T16:42:00.094850+0000","last_fullsized":"2021-02-16T16:42:00.094850+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094760+0000","last_change":"2021-02-16T16:39:17.059113+0000","last_active":"2021-02-16T16:42:00.094760+0000","last_peered":"2021-02-16T16:42:00.094760+0000","last_clean":"2021-02-16T16:42:00.094760+0000","last_became_active":"2021-02-16T16:39:17.058961+0000","last_became_peered":"2021-02-16T16:39:17.058961+0000","last_unstale":"2021-02-16T16:42:00.094760+0000","last_undegraded":"2021-02-16T16:42:00.094760+0000","last_fullsized":"2021-02-16T16:42:00.094760+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'2668","reported_seq":"3829","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.137652+0000","last_change":"2021-02-16T16:39:26.076980+0000","last_active":"2021-02-16T16:42:16.137652+0000","last_peered":"2021-02-16T16:42:16.137652+0000","last_clean":"2021-02-16T16:42:16.137652+0000","last_became_active":"2021-02-16T16:39:26.076651+0000","last_became_peered":"2021-02-16T16:39:26.076651+0000","last_unstale":"2021-02-16T16:42:16.137652+0000","last_undegraded":"2021-02-16T16:42:16.137652+0000","last_fullsized":"2021-02-16T16:42:16.137652+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2668,"ondisk_log_size":2668,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108199389,"num_objects":47,"num_object_clones":0,"num_object_copies":94,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":7,"num_read":829,"num_read_kb":45072,"num_write":2049,"num_write_kb":533571,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2286,"num_flush":440,"num_flush_kb":1095454,"num_evict":342,"num_evict_kb":886427,"num_promote":539,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'8658","reported_seq":"12326","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.827336+0000","last_change":"2021-02-16T16:39:24.089126+0000","last_active":"2021-02-16T16:42:19.827336+0000","last_peered":"2021-02-16T16:42:19.827336+0000","last_clean":"2021-02-16T16:42:19.827336+0000","last_became_active":"2021-02-16T16:39:24.088667+0000","last_became_peered":"2021-02-16T16:39:24.088667+0000","last_unstale":"2021-02-16T16:42:19.827336+0000","last_undegraded":"2021-02-16T16:42:19.827336+0000","last_fullsized":"2021-02-16T16:42:19.827336+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8658,"ondisk_log_size":8658,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7156643678,"num_objects":2388,"num_object_clones":0,"num_object_copies":4776,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2388,"num_whiteouts":0,"num_read":6441,"num_read_kb":2057563,"num_write":10992,"num_write_kb":4048071,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094732+0000","last_change":"2021-02-16T16:39:17.059339+0000","last_active":"2021-02-16T16:42:00.094732+0000","last_peered":"2021-02-16T16:42:00.094732+0000","last_clean":"2021-02-16T16:42:00.094732+0000","last_became_active":"2021-02-16T16:39:17.059143+0000","last_became_peered":"2021-02-16T16:39:17.059143+0000","last_unstale":"2021-02-16T16:42:00.094732+0000","last_undegraded":"2021-02-16T16:42:00.094732+0000","last_fullsized":"2021-02-16T16:42:00.094732+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"32'2239","reported_seq":"3268","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:15.943821+0000","last_change":"2021-02-16T16:39:26.842365+0000","last_active":"2021-02-16T16:42:15.943821+0000","last_peered":"2021-02-16T16:42:15.943821+0000","last_clean":"2021-02-16T16:42:15.943821+0000","last_became_active":"2021-02-16T16:39:26.842152+0000","last_became_peered":"2021-02-16T16:39:26.842152+0000","last_unstale":"2021-02-16T16:42:15.943821+0000","last_undegraded":"2021-02-16T16:42:15.943821+0000","last_fullsized":"2021-02-16T16:42:15.943821+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2239,"ondisk_log_size":2239,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":124952221,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":10,"num_read":747,"num_read_kb":19629,"num_write":1694,"num_write_kb":550989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2235,"num_flush":374,"num_flush_kb":892049,"num_evict":245,"num_evict_kb":630115,"num_promote":454,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'8765","reported_seq":"12454","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.841946+0000","last_change":"2021-02-16T16:39:24.071430+0000","last_active":"2021-02-16T16:42:19.841946+0000","last_peered":"2021-02-16T16:42:19.841946+0000","last_clean":"2021-02-16T16:42:19.841946+0000","last_became_active":"2021-02-16T16:39:24.071079+0000","last_became_peered":"2021-02-16T16:39:24.071079+0000","last_unstale":"2021-02-16T16:42:19.841946+0000","last_undegraded":"2021-02-16T16:42:19.841946+0000","last_fullsized":"2021-02-16T16:42:19.841946+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8765,"ondisk_log_size":8765,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7318718614,"num_objects":2438,"num_object_clones":0,"num_object_copies":4876,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2438,"num_whiteouts":0,"num_read":6336,"num_read_kb":1836507,"num_write":11071,"num_write_kb":4276975,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094752+0000","last_change":"2021-02-16T16:39:17.059455+0000","last_active":"2021-02-16T16:42:00.094752+0000","last_peered":"2021-02-16T16:42:00.094752+0000","last_clean":"2021-02-16T16:42:00.094752+0000","last_became_active":"2021-02-16T16:39:17.059261+0000","last_became_peered":"2021-02-16T16:39:17.059261+0000","last_unstale":"2021-02-16T16:42:00.094752+0000","last_undegraded":"2021-02-16T16:42:00.094752+0000","last_fullsized":"2021-02-16T16:42:00.094752+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"32'2465","reported_seq":"3537","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:16.143159+0000","last_change":"2021-02-16T16:39:26.785922+0000","last_active":"2021-02-16T16:42:16.143159+0000","last_peered":"2021-02-16T16:42:16.143159+0000","last_clean":"2021-02-16T16:42:16.143159+0000","last_became_active":"2021-02-16T16:39:26.785665+0000","last_became_peered":"2021-02-16T16:39:26.785665+0000","last_unstale":"2021-02-16T16:42:16.143159+0000","last_undegraded":"2021-02-16T16:42:16.143159+0000","last_fullsized":"2021-02-16T16:42:16.143159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2465,"ondisk_log_size":2465,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93043903,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":12,"num_read":770,"num_read_kb":39715,"num_write":1925,"num_write_kb":586899,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":4,"num_bytes_hit_set_archive":2447,"num_flush":413,"num_flush_kb":1042961,"num_evict":311,"num_evict_kb":801388,"num_promote":485,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'8909","reported_seq":"12919","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.896556+0000","last_change":"2021-02-16T16:39:24.088770+0000","last_active":"2021-02-16T16:42:19.896556+0000","last_peered":"2021-02-16T16:42:19.896556+0000","last_clean":"2021-02-16T16:42:19.896556+0000","last_became_active":"2021-02-16T16:39:24.088475+0000","last_became_peered":"2021-02-16T16:39:24.088475+0000","last_unstale":"2021-02-16T16:42:19.896556+0000","last_undegraded":"2021-02-16T16:42:19.896556+0000","last_fullsized":"2021-02-16T16:42:19.896556+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8909,"ondisk_log_size":8909,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7421714797,"num_objects":2481,"num_object_clones":0,"num_object_copies":4962,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2481,"num_whiteouts":0,"num_read":6927,"num_read_kb":2589862,"num_write":11239,"num_write_kb":4534282,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094663+0000","last_change":"2021-02-16T16:39:17.059345+0000","last_active":"2021-02-16T16:42:00.094663+0000","last_peered":"2021-02-16T16:42:00.094663+0000","last_clean":"2021-02-16T16:42:00.094663+0000","last_became_active":"2021-02-16T16:39:17.059110+0000","last_became_peered":"2021-02-16T16:39:17.059110+0000","last_unstale":"2021-02-16T16:42:00.094663+0000","last_undegraded":"2021-02-16T16:42:00.094663+0000","last_fullsized":"2021-02-16T16:42:00.094663+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"33'2982","reported_seq":"4447","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.149420+0000","last_change":"2021-02-16T16:39:26.077089+0000","last_active":"2021-02-16T16:42:19.149420+0000","last_peered":"2021-02-16T16:42:19.149420+0000","last_clean":"2021-02-16T16:42:19.149420+0000","last_became_active":"2021-02-16T16:39:26.076927+0000","last_became_peered":"2021-02-16T16:39:26.076927+0000","last_unstale":"2021-02-16T16:42:19.149420+0000","last_undegraded":"2021-02-16T16:42:19.149420+0000","last_fullsized":"2021-02-16T16:42:19.149420+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:25.067912+0000","last_clean_scrub_stamp":"2021-02-16T16:39:25.067912+0000","log_size":2982,"ondisk_log_size":2982,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":108375440,"num_objects":57,"num_object_clones":0,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":1028,"num_read_kb":120690,"num_write":2314,"num_write_kb":713452,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4614,"num_flush":509,"num_flush_kb":1319882,"num_evict":340,"num_evict_kb":898971,"num_promote":604,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'8715","reported_seq":"12481","reported_epoch":"33","state":"active+clean","last_fresh":"2021-02-16T16:42:19.814376+0000","last_change":"2021-02-16T16:39:24.088992+0000","last_active":"2021-02-16T16:42:19.814376+0000","last_peered":"2021-02-16T16:42:19.814376+0000","last_clean":"2021-02-16T16:42:19.814376+0000","last_became_active":"2021-02-16T16:39:24.088601+0000","last_became_peered":"2021-02-16T16:39:24.088601+0000","last_unstale":"2021-02-16T16:42:19.814376+0000","last_undegraded":"2021-02-16T16:42:19.814376+0000","last_fullsized":"2021-02-16T16:42:19.814376+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:23.062971+0000","last_clean_scrub_stamp":"2021-02-16T16:39:23.062971+0000","log_size":8715,"ondisk_log_size":8715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7254579835,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":6597,"num_read_kb":2362885,"num_write":11048,"num_write_kb":4208582,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094914+0000","last_change":"2021-02-16T16:39:17.058851+0000","last_active":"2021-02-16T16:42:00.094914+0000","last_peered":"2021-02-16T16:42:00.094914+0000","last_clean":"2021-02-16T16:42:00.094914+0000","last_became_active":"2021-02-16T16:39:17.058643+0000","last_became_peered":"2021-02-16T16:39:17.058643+0000","last_unstale":"2021-02-16T16:42:00.094914+0000","last_undegraded":"2021-02-16T16:42:00.094914+0000","last_fullsized":"2021-02-16T16:42:00.094914+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094918+0000","last_change":"2021-02-16T16:39:17.058980+0000","last_active":"2021-02-16T16:42:00.094918+0000","last_peered":"2021-02-16T16:42:00.094918+0000","last_clean":"2021-02-16T16:42:00.094918+0000","last_became_active":"2021-02-16T16:39:17.058730+0000","last_became_peered":"2021-02-16T16:39:17.058730+0000","last_unstale":"2021-02-16T16:42:00.094918+0000","last_undegraded":"2021-02-16T16:42:00.094918+0000","last_fullsized":"2021-02-16T16:42:00.094918+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"24","reported_epoch":"32","state":"active+clean","last_fresh":"2021-02-16T16:42:00.094672+0000","last_change":"2021-02-16T16:39:17.873952+0000","last_active":"2021-02-16T16:42:00.094672+0000","last_peered":"2021-02-16T16:42:00.094672+0000","last_clean":"2021-02-16T16:42:00.094672+0000","last_became_active":"2021-02-16T16:39:17.873571+0000","last_became_peered":"2021-02-16T16:39:17.873571+0000","last_unstale":"2021-02-16T16:42:00.094672+0000","last_undegraded":"2021-02-16T16:42:00.094672+0000","last_fullsized":"2021-02-16T16:42:00.094672+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-16T16:39:16.050772+0000","last_clean_scrub_stamp":"2021-02-16T16:39:16.050772+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":434570953,"num_objects":208,"num_object_clones":0,"num_object_copies":416,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":187,"num_whiteouts":44,"num_read":3374,"num_read_kb":225106,"num_write":7982,"num_write_kb":2384911,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":20,"num_bytes_hit_set_archive":11582,"num_flush":1736,"num_flush_kb":4350346,"num_evict":1238,"num_evict_kb":3216901,"num_promote":2082,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10354,"ondisk_log_size":10354,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29151656924,"num_objects":9735,"num_object_clones":0,"num_object_copies":19470,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9735,"num_whiteouts":0,"num_read":26301,"num_read_kb":8846817,"num_write":44350,"num_write_kb":17067910,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":35047,"ondisk_log_size":35047,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8550224,"kb_used_data":79531476,"kb_used_omap":11290,"kb_used_meta":0,"kb_avail":79487152,"statfs":{"total":90150273024,"available":81394843648,"internally_reserved":45387776,"allocated":81440231424,"data_stored":81440231424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11561668,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.55300000000000005,"5min":0.39100000000000001,"15min":0.36899999999999999},"min":{"1min":0.16800000000000001,"5min":0.155,"15min":0.155},"max":{"1min":0.995,"5min":0.995,"15min":0.995},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.57799999999999996,"5min":0.39200000000000002,"15min":0.36699999999999999},"min":{"1min":0.18099999999999999,"5min":0.13100000000000001,"15min":0.13100000000000001},"max":{"1min":1.008,"5min":1.008,"15min":1.008},"last":0.79400000000000004}]},{"osd":1,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.58399999999999996,"5min":0.39900000000000002,"15min":0.38100000000000001},"min":{"1min":0.191,"5min":0.13900000000000001,"15min":0.13900000000000001},"max":{"1min":1.056,"5min":1.056,"15min":1.056},"last":0.85499999999999998},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.38900000000000001,"15min":0.35899999999999999},"min":{"1min":0.22700000000000001,"5min":0.155,"15min":0.155},"max":{"1min":1.042,"5min":1.042,"15min":1.042},"last":0.84699999999999998}]},{"osd":2,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.57599999999999996,"5min":0.41499999999999998,"15min":0.40000000000000002},"min":{"1min":0.216,"5min":0.192,"15min":0.192},"max":{"1min":0.91800000000000004,"5min":0.95399999999999996,"15min":0.95399999999999996},"last":0.72099999999999997},{"interface":"front","average":{"1min":0.60099999999999998,"5min":0.40100000000000002,"15min":0.378},"min":{"1min":0.23300000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":1.026,"5min":1.026,"15min":1.026},"last":0.90100000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.28499999999999998,"5min":0.26200000000000001,"15min":0.26600000000000001},"min":{"1min":0.159,"5min":0.14299999999999999,"15min":0.14299999999999999},"max":{"1min":0.45400000000000001,"5min":0.58199999999999996,"15min":0.58199999999999996},"last":0.376},{"interface":"front","average":{"1min":0.25800000000000001,"5min":0.22800000000000001,"15min":0.22600000000000001},"min":{"1min":0.157,"5min":0.13600000000000001,"15min":0.13600000000000001},"max":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"last":0.42499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:17 2021","interfaces":[{"interface":"back","average":{"1min":0.26900000000000002,"5min":0.24399999999999999,"15min":0.23599999999999999},"min":{"1min":0.13700000000000001,"5min":0.126,"15min":0.126},"max":{"1min":0.48799999999999999,"5min":0.48799999999999999,"15min":0.48799999999999999},"last":0.28999999999999998},{"interface":"front","average":{"1min":0.29699999999999999,"5min":0.28399999999999997,"15min":0.28399999999999997},"min":{"1min":0.19,"5min":0.161,"15min":0.161},"max":{"1min":0.40899999999999997,"5min":0.51400000000000001,"15min":0.51400000000000001},"last":0.437}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980840,"kb_used_data":87056536,"kb_used_omap":5718,"kb_used_meta":0,"kb_avail":87056536,"statfs":{"total":90150273024,"available":89145892864,"internally_reserved":0,"allocated":89145892864,"data_stored":89145892864,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5855541,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.51300000000000001,"5min":0.42399999999999999,"15min":0.42199999999999999},"min":{"1min":0.23400000000000001,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":1.0029999999999999,"5min":1.022,"15min":1.022},"last":0.747},{"interface":"front","average":{"1min":0.51800000000000002,"5min":0.43099999999999999,"15min":0.42899999999999999},"min":{"1min":0.17699999999999999,"5min":0.16600000000000001,"15min":0.16600000000000001},"max":{"1min":0.82799999999999996,"5min":1.2689999999999999,"15min":1.2689999999999999},"last":0.91300000000000003}]},{"osd":1,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.433,"15min":0.438},"min":{"1min":0.22500000000000001,"5min":0.185,"15min":0.185},"max":{"1min":0.94199999999999995,"5min":1.25,"15min":1.25},"last":0.72799999999999998},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.46200000000000002,"15min":0.47099999999999997},"min":{"1min":0.248,"5min":0.214,"15min":0.214},"max":{"1min":1.0640000000000001,"5min":1.379,"15min":1.379},"last":0.81000000000000005}]},{"osd":2,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.47099999999999997,"15min":0.46999999999999997},"min":{"1min":0.23499999999999999,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.96799999999999997,"5min":1.343,"15min":1.343},"last":0.77400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.44500000000000001,"15min":0.44700000000000001},"min":{"1min":0.214,"5min":0.156,"15min":0.156},"max":{"1min":0.83399999999999996,"5min":1.3220000000000001,"15min":1.3220000000000001},"last":0.78000000000000003}]},{"osd":3,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.26500000000000001,"5min":0.23699999999999999,"15min":0.23400000000000001},"min":{"1min":0.14899999999999999,"5min":0.13,"15min":0.13},"max":{"1min":0.90700000000000003,"5min":0.90700000000000003,"15min":0.90700000000000003},"last":0.33600000000000002},{"interface":"front","average":{"1min":0.223,"5min":0.252,"15min":0.26600000000000001},"min":{"1min":0.13600000000000001,"5min":0.115,"15min":0.115},"max":{"1min":0.35399999999999998,"5min":0.443,"15min":0.443},"last":0.432}]},{"osd":5,"last update":"Tue Feb 16 16:42:14 2021","interfaces":[{"interface":"back","average":{"1min":0.28899999999999998,"5min":0.28999999999999998,"15min":0.29799999999999999},"min":{"1min":0.16,"5min":0.126,"15min":0.126},"max":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"last":0.36599999999999999},{"interface":"front","average":{"1min":0.251,"5min":0.26800000000000002,"15min":0.27400000000000002},"min":{"1min":0.13500000000000001,"5min":0.13,"15min":0.13},"max":{"1min":0.40400000000000003,"5min":0.44,"15min":0.44},"last":0.39500000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4626592,"kb_used_data":83426000,"kb_used_omap":4573,"kb_used_meta":0,"kb_avail":83410784,"statfs":{"total":90150273024,"available":85412642816,"internally_reserved":15581184,"allocated":85428224000,"data_stored":85428224000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4683712,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.38900000000000001,"15min":0.39500000000000002},"min":{"1min":0.22700000000000001,"5min":0.14099999999999999,"15min":0.14099999999999999},"max":{"1min":0.81899999999999995,"5min":1.0580000000000001,"15min":1.0580000000000001},"last":0.54000000000000004},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.38300000000000001,"15min":0.38100000000000001},"min":{"1min":0.20999999999999999,"5min":0.152,"15min":0.152},"max":{"1min":0.84299999999999997,"5min":0.997,"15min":0.997},"last":0.627}]},{"osd":1,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"min":{"1min":0.26600000000000001,"5min":0.13700000000000001,"15min":0.13700000000000001},"max":{"1min":0.98499999999999999,"5min":1.1000000000000001,"15min":1.1000000000000001},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.47099999999999997,"5min":0.38400000000000001,"15min":0.38800000000000001},"min":{"1min":0.26100000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.87,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":0.56599999999999995}]},{"osd":2,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.373,"15min":0.36899999999999999},"min":{"1min":0.248,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.76200000000000001,"5min":0.97999999999999998,"15min":0.97999999999999998},"last":0.59699999999999998},{"interface":"front","average":{"1min":0.47999999999999998,"5min":0.40200000000000002,"15min":0.40500000000000003},"min":{"1min":0.23499999999999999,"5min":0.17499999999999999,"15min":0.17499999999999999},"max":{"1min":0.84699999999999998,"5min":1.1299999999999999,"15min":1.1299999999999999},"last":0.55100000000000005}]},{"osd":4,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.25600000000000001,"15min":0.255},"min":{"1min":0.156,"5min":0.125,"15min":0.125},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.33800000000000002,"5min":0.313,"15min":0.313},"min":{"1min":0.17399999999999999,"5min":0.158,"15min":0.158},"max":{"1min":0.55300000000000005,"5min":0.60299999999999998,"15min":0.60299999999999998},"last":0.29299999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:21 2021","interfaces":[{"interface":"back","average":{"1min":0.28299999999999997,"5min":0.254,"15min":0.249},"min":{"1min":0.16400000000000001,"5min":0.127,"15min":0.127},"max":{"1min":0.41899999999999998,"5min":0.52200000000000002,"15min":0.52200000000000002},"last":0.374},{"interface":"front","average":{"1min":0.30499999999999999,"5min":0.26800000000000002,"15min":0.27300000000000002},"min":{"1min":0.16700000000000001,"5min":0.129,"15min":0.129},"max":{"1min":0.50800000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"last":0.50800000000000001}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8824752,"kb_used_data":79239500,"kb_used_omap":11642,"kb_used_meta":0,"kb_avail":79212624,"statfs":{"total":90150273024,"available":81113726976,"internally_reserved":27521024,"allocated":81141248000,"data_stored":81141248000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11921482,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.252,"5min":0.23999999999999999,"15min":0.248},"min":{"1min":0.096000000000000002,"5min":0.096000000000000002,"15min":0.096000000000000002},"max":{"1min":0.68100000000000005,"5min":0.68100000000000005,"15min":0.68100000000000005},"last":0.245},{"interface":"front","average":{"1min":0.255,"5min":0.23599999999999999,"15min":0.23100000000000001},"min":{"1min":0.123,"5min":0.123,"15min":0.123},"max":{"1min":0.52700000000000002,"5min":0.52700000000000002,"15min":0.52700000000000002},"last":0.223}]},{"osd":1,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.246,"5min":0.23899999999999999,"15min":0.24199999999999999},"min":{"1min":0.11799999999999999,"5min":0.10000000000000001,"15min":0.10000000000000001},"max":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"last":0.32800000000000001},{"interface":"front","average":{"1min":0.252,"5min":0.24199999999999999,"15min":0.24399999999999999},"min":{"1min":0.108,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"last":0.31900000000000001}]},{"osd":3,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.376,"5min":0.42199999999999999,"15min":0.45600000000000002},"min":{"1min":0.17299999999999999,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.65100000000000002,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.27900000000000003},{"interface":"front","average":{"1min":0.35399999999999998,"5min":0.40500000000000003,"15min":0.435},"min":{"1min":0.215,"5min":0.193,"15min":0.193},"max":{"1min":0.55400000000000005,"5min":1.022,"15min":1.022},"last":0.36499999999999999}]},{"osd":4,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.36099999999999999,"5min":0.40799999999999997,"15min":0.434},"min":{"1min":0.21199999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.628,"5min":1.038,"15min":1.038},"last":0.41699999999999998},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.438,"15min":0.47499999999999998},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.69699999999999995,"5min":0.998,"15min":0.998},"last":0.28899999999999998}]},{"osd":5,"last update":"Tue Feb 16 16:42:11 2021","interfaces":[{"interface":"back","average":{"1min":0.34200000000000003,"5min":0.40300000000000002,"15min":0.43099999999999999},"min":{"1min":0.188,"5min":0.188,"15min":0.188},"max":{"1min":0.55300000000000005,"5min":1.1379999999999999,"15min":1.1379999999999999},"last":0.38},{"interface":"front","average":{"1min":0.36899999999999999,"5min":0.42299999999999999,"15min":0.45800000000000002},"min":{"1min":0.24199999999999999,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56599999999999995,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.38700000000000001}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":980712,"kb_used_data":87056664,"kb_used_omap":5728,"kb_used_meta":0,"kb_avail":87056664,"statfs":{"total":90150273024,"available":89146023936,"internally_reserved":0,"allocated":89146023936,"data_stored":89146023936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5865602,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.218,"5min":0.24399999999999999,"15min":0.26400000000000001},"min":{"1min":0.10199999999999999,"5min":0.090999999999999998,"15min":0.090999999999999998},"max":{"1min":0.497,"5min":0.497,"15min":0.497},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.246,"5min":0.26800000000000002,"15min":0.28499999999999998},"min":{"1min":0.10299999999999999,"5min":0.10299999999999999,"15min":0.10299999999999999},"max":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"last":0.38200000000000001}]},{"osd":2,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.254,"5min":0.26600000000000001,"15min":0.27900000000000003},"min":{"1min":0.121,"5min":0.11700000000000001,"15min":0.11700000000000001},"max":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"last":0.34899999999999998},{"interface":"front","average":{"1min":0.27100000000000002,"5min":0.26800000000000002,"15min":0.28000000000000003},"min":{"1min":0.108,"5min":0.105,"15min":0.105},"max":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.47899999999999998,"15min":0.54700000000000004},"min":{"1min":0.17599999999999999,"5min":0.16400000000000001,"15min":0.16400000000000001},"max":{"1min":0.57899999999999996,"5min":1.0860000000000001,"15min":1.0860000000000001},"last":0.84699999999999998},{"interface":"front","average":{"1min":0.37,"5min":0.45400000000000001,"15min":0.51400000000000001},"min":{"1min":0.16900000000000001,"5min":0.16700000000000001,"15min":0.16700000000000001},"max":{"1min":0.59199999999999997,"5min":1.052,"15min":1.052},"last":0.71999999999999997}]},{"osd":4,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.503,"15min":0.56399999999999995},"min":{"1min":0.247,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.94199999999999995,"5min":1.1060000000000001,"15min":1.1060000000000001},"last":0.74399999999999999},{"interface":"front","average":{"1min":0.372,"5min":0.46600000000000003,"15min":0.52400000000000002},"min":{"1min":0.22,"5min":0.187,"15min":0.187},"max":{"1min":0.76200000000000001,"5min":1.0389999999999999,"15min":1.0389999999999999},"last":0.75700000000000001}]},{"osd":5,"last update":"Tue Feb 16 16:42:13 2021","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46999999999999997,"15min":0.52400000000000002},"min":{"1min":0.161,"5min":0.161,"15min":0.161},"max":{"1min":0.86599999999999999,"5min":1.127,"15min":1.127},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.502,"15min":0.56599999999999995},"min":{"1min":0.20300000000000001,"5min":0.20300000000000001,"15min":0.20300000000000001},"max":{"1min":0.61499999999999999,"5min":1.149,"15min":1.149},"last":0.81899999999999995}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12636468,"kb_used_data":75423012,"kb_used_omap":18318,"kb_used_meta":0,"kb_avail":75400908,"statfs":{"total":90150273024,"available":77210529792,"internally_reserved":22634496,"allocated":77233164288,"data_stored":77233164288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":18757874,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.221,"5min":0.217,"15min":0.222},"min":{"1min":0.097000000000000003,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.36599999999999999,"5min":0.432,"15min":0.432},"last":0.29599999999999999},{"interface":"front","average":{"1min":0.27900000000000003,"5min":0.22800000000000001,"15min":0.223},"min":{"1min":0.107,"5min":0.107,"15min":0.107},"max":{"1min":0.65500000000000003,"5min":0.65500000000000003,"15min":0.65500000000000003},"last":0.34399999999999997}]},{"osd":2,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.22800000000000001,"5min":0.22700000000000001,"15min":0.22900000000000001},"min":{"1min":0.107,"5min":0.097000000000000003,"15min":0.097000000000000003},"max":{"1min":0.35899999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"last":0.39400000000000002},{"interface":"front","average":{"1min":0.318,"5min":0.25700000000000001,"15min":0.249},"min":{"1min":0.14000000000000001,"5min":0.124,"15min":0.124},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.40200000000000002}]},{"osd":3,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.44800000000000001,"15min":0.48399999999999999},"min":{"1min":0.182,"5min":0.17299999999999999,"15min":0.17299999999999999},"max":{"1min":0.76700000000000002,"5min":1.1259999999999999,"15min":1.1259999999999999},"last":1.0129999999999999},{"interface":"front","average":{"1min":0.36199999999999999,"5min":0.42199999999999999,"15min":0.46400000000000002},"min":{"1min":0.17599999999999999,"5min":0.17000000000000001,"15min":0.17000000000000001},"max":{"1min":0.63800000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"last":1.101}]},{"osd":4,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.38800000000000001,"5min":0.45300000000000001,"15min":0.499},"min":{"1min":0.19900000000000001,"5min":0.17399999999999999,"15min":0.17399999999999999},"max":{"1min":0.55000000000000004,"5min":1.0309999999999999,"15min":1.0309999999999999},"last":1.075},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.44400000000000001,"15min":0.48299999999999998},"min":{"1min":0.223,"5min":0.19,"15min":0.19},"max":{"1min":0.621,"5min":1.022,"15min":1.022},"last":1.159}]},{"osd":5,"last update":"Tue Feb 16 16:42:15 2021","interfaces":[{"interface":"back","average":{"1min":0.40300000000000002,"5min":0.44900000000000001,"15min":0.48999999999999999},"min":{"1min":0.215,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.56899999999999995,"5min":1.0820000000000001,"15min":1.0820000000000001},"last":1.1200000000000001},{"interface":"front","average":{"1min":0.42799999999999999,"5min":0.45400000000000001,"15min":0.48999999999999999},"min":{"1min":0.246,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":0.78800000000000003,"5min":1.0289999999999999,"15min":1.0289999999999999},"last":1.0640000000000001}]}]}]}} 2021-02-16T17:11:40.744 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:09.644 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:09.644 DEBUG:teuthology.orchestra.run.gibba040:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 , 2021-02-16T16:43:09.715 INFO:tasks.ceph:Archiving mon data... 2021-02-16T17:11:40.744 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-16T16:43:30.295 DEBUG:teuthology.orchestra.run.gibba028:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 , 2021-02-16T16:43:30.349 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@gibba040.front.sepia.ceph.com , 2021-02-16T16:43:30.349 DEBUG:teuthology.orchestra.run.gibba040:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2021-02-16T17:11:42.922 INFO:scrape:Found 9 distinct failure reasons 2021-02-16T17:11:42.922 INFO:scrape:Dead: None 2021-02-16T17:11:42.922 INFO:scrape:15 jobs: ['5887606', '5887626', '5887607', '5887611', '5887608', '5887631', '5887625', '5887618', '5887639', '5887632', '5887620', '5887614', '5887637', '5887627', '5887615'] 2021-02-16T17:11:42.923 INFO:scrape: 2021-02-16T17:11:42.923 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on gibba020 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=519abe3e4b47f5c65c84a1097653bbd2fea95358 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2021-02-16T17:11:42.923 INFO:scrape:2 jobs: ['5887613', '5887628'] 2021-02-16T17:11:42.923 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-02-16T17:11:42.923 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2021-02-16T17:11:42.923 INFO:scrape: 2021-02-16T17:11:42.923 INFO:scrape:Failure: Command failed on gibba033 with status 5: 'sudo systemctl stop ceph-e22bf85e-7074-11eb-9007-001a4aab830c@mon.a' 2021-02-16T17:11:42.923 INFO:scrape:5 jobs: ['5887624', '5887629', '5887617', '5887636', '5887605'] 2021-02-16T17:11:42.923 INFO:scrape:suites intersection: [] 2021-02-16T17:11:42.924 INFO:scrape:suites union: ['fixed-2', 'mode/root', 'msgr/async', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'start', 'start}', 'task/test_orch_cli}', 'tasks/rados_api_tests}'] 2021-02-16T17:11:42.924 INFO:scrape: 2021-02-16T17:11:42.924 INFO:scrape:Failure: "2021-02-16T16:33:16.214177+0000 mon.a (mon.0) 344 : cluster [WRN] Health check failed: 1 pools have both target_size_bytes and target_size_ratio set (POOL_HAS_TARGET_SIZE_BYTES_AND_RATIO)" in cluster log 2021-02-16T17:11:42.924 INFO:scrape:1 jobs: ['5887622'] 2021-02-16T17:11:42.924 INFO:scrape:suites: ['msgr-failures/many', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'rados', 'rados/singleton/{all/pg-autoscaler-progress-off', 'supported-random-distro$/{centos_latest}}'] 2021-02-16T17:11:42.924 INFO:scrape: 2021-02-16T17:11:42.924 INFO:scrape:Failure: Test failure: test_osd_came_back (tasks.mgr.test_progress.TestProgress) 2021-02-16T17:11:42.924 INFO:scrape:2 jobs: ['5887610', '5887635'] 2021-02-16T17:11:42.924 INFO:scrape:suites intersection: ['debug/mgr', 'rados/mgr/{clusters/{2-node-mgr}', 'tasks/progress}'] 2021-02-16T17:11:42.924 INFO:scrape:suites union: ['debug/mgr', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_latest}', 'supported-random-distro$/{rhel_latest}', 'tasks/progress}'] 2021-02-16T17:11:42.925 INFO:scrape: 2021-02-16T17:11:42.925 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on gibba015 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=519abe3e4b47f5c65c84a1097653bbd2fea95358 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2021-02-16T17:11:42.925 INFO:scrape:2 jobs: ['5887623', '5887641'] 2021-02-16T17:11:42.925 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-02-16T17:11:42.925 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2021-02-16T17:11:42.925 INFO:scrape: 2021-02-16T17:11:42.925 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2021-02-16T17:11:42.925 INFO:scrape:1 jobs: ['5887630'] 2021-02-16T17:11:42.925 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{rhel_latest}}'] 2021-02-16T17:11:42.926 INFO:scrape: 2021-02-16T17:11:42.926 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds 2021-02-16T17:11:42.926 INFO:scrape:1 jobs: ['5887621'] 2021-02-16T17:11:42.926 INFO:scrape:suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_latest}', 'fixed-2}', 'rados/cephadm/upgrade/{1-start'] 2021-02-16T17:11:42.926 INFO:scrape: 2021-02-16T17:11:42.926 INFO:scrape:Failure: Command failed on gibba013 with status 100: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo apt -y install podman'" 2021-02-16T17:11:42.926 INFO:scrape:1 jobs: ['5887616'] 2021-02-16T17:11:42.926 INFO:scrape:suites: ['fixed-2', 'mode/root', 'msgr/async-v1only', 'rados/cephadm/with-work/{distro/ubuntu_18.04_podman', 'start', 'tasks/rados_python}'] 2021-02-16T17:11:42.926 INFO:scrape: