2020-11-27T16:53:10.052 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-27T16:53:10.069 INFO:teuthology.results:subset: '1721/120000' 2020-11-27T16:53:10.070 INFO:teuthology.results:seed: '9873' 2020-11-28T02:54:49.298 INFO:root:teuthology version: 1.0.0-e0aaa9bf 2020-11-28T02:54:49.358 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2020-11-28T07:47:59.332 INFO:teuthology.results:Tests finished! gathering results... 2020-11-28T07:48:52.843 INFO:scrape:Found 320 jobs 2020-11-28T07:48:55.921 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:55.923 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:55.925 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.054 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.056 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.057 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.204 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.206 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.325 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.326 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.328 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.443 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.444 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.446 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.566 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.568 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.569 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.699 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.701 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.703 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.826 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.828 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.829 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:48:56.947 WARNING:scrape:Ignoring malparsed backtrace: ceph version 15.2.6-617-gc2a20e18 (c2a20e183fa3e99558a18c72740747e4b8c8b359) octopus (stable) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x154) [0x7f52d8eee070] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f52d8eee24b] 2020-11-28T07:48:56.949 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:13.447 INFO:teuthology.orchestra.run.gibba001.stdout: , dumped all , 2020-11-27T21:44:13.455 INFO:teuthology.orchestra.run.gibba001.stdout:{"pg_ready":true,"pg_map":{"version":127,"stamp":"2020-11-27T21:44:12.320234+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":29632431620,"num_objects":9979,"num_object_clones":0,"num_object_copies":19958,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9955,"num_whiteouts":49,"num_read":29400,"num_read_kb":8800028,"num_write":52343,"num_write_kb":19619894,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":45613,"ondisk_log_size":45613,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":528224256,"kb_used":33962812,"kb_used_data":494411068,"kb_used_omap":58309,"kb_used_meta":0,"kb_avail":494261444,"statfs":{"total":540901638144,"available":506123718656,"internally_reserved":153214976,"allocated":506276933632,"data_stored":506276933632,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":59709146,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":9,"commit_latency_ns":0,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":172466639,"num_objects":86,"num_object_clones":0,"num_object_copies":172,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":83,"num_whiteouts":22,"num_read":1298,"num_read_kb":1209080,"num_write":841,"num_write_kb":519241,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":2,"num_bytes_hit_set_archive":995,"num_flush":81,"num_flush_kb":165124,"num_evict":37,"num_evict_kb":78335,"num_promote":198,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.003793"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391832+0000","last_change":"2020-11-27T21:41:08.069209+0000","last_active":"2020-11-27T21:43:50.391832+0000","last_peered":"2020-11-27T21:43:50.391832+0000","last_clean":"2020-11-27T21:43:50.391832+0000","last_became_active":"2020-11-27T21:41:08.067937+0000","last_became_peered":"2020-11-27T21:41:08.067937+0000","last_unstale":"2020-11-27T21:43:50.391832+0000","last_undegraded":"2020-11-27T21:43:50.391832+0000","last_fullsized":"2020-11-27T21:43:50.391832+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391538+0000","last_change":"2020-11-27T21:41:07.351270+0000","last_active":"2020-11-27T21:43:50.391538+0000","last_peered":"2020-11-27T21:43:50.391538+0000","last_clean":"2020-11-27T21:43:50.391538+0000","last_became_active":"2020-11-27T21:41:07.351036+0000","last_became_peered":"2020-11-27T21:41:07.351036+0000","last_unstale":"2020-11-27T21:43:50.391538+0000","last_undegraded":"2020-11-27T21:43:50.391538+0000","last_fullsized":"2020-11-27T21:43:50.391538+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"36'2857","reported_seq":"4114","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.640392+0000","last_change":"2020-11-27T21:41:16.399213+0000","last_active":"2020-11-27T21:44:10.640392+0000","last_peered":"2020-11-27T21:44:10.640392+0000","last_clean":"2020-11-27T21:44:10.640392+0000","last_became_active":"2020-11-27T21:41:16.398322+0000","last_became_peered":"2020-11-27T21:41:16.398322+0000","last_unstale":"2020-11-27T21:44:10.640392+0000","last_undegraded":"2020-11-27T21:44:10.640392+0000","last_fullsized":"2020-11-27T21:44:10.640392+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2857,"ondisk_log_size":2857,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":107696542,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":11,"num_read":929,"num_read_kb":89484,"num_write":2246,"num_write_kb":619145,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4507,"num_flush":477,"num_flush_kb":1210936,"num_evict":380,"num_evict_kb":982104,"num_promote":582,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"36'8367","reported_seq":"11937","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.690355+0000","last_change":"2020-11-27T21:41:14.402297+0000","last_active":"2020-11-27T21:44:10.690355+0000","last_peered":"2020-11-27T21:44:10.690355+0000","last_clean":"2020-11-27T21:44:10.690355+0000","last_became_active":"2020-11-27T21:41:14.402032+0000","last_became_peered":"2020-11-27T21:41:14.402032+0000","last_unstale":"2020-11-27T21:44:10.690355+0000","last_undegraded":"2020-11-27T21:44:10.690355+0000","last_fullsized":"2020-11-27T21:44:10.690355+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8367,"ondisk_log_size":8367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7033904827,"num_objects":2360,"num_object_clones":0,"num_object_copies":4720,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2360,"num_whiteouts":0,"num_read":6210,"num_read_kb":2013158,"num_write":10601,"num_write_kb":4125700,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391800+0000","last_change":"2020-11-27T21:41:07.351108+0000","last_active":"2020-11-27T21:43:50.391800+0000","last_peered":"2020-11-27T21:43:50.391800+0000","last_clean":"2020-11-27T21:43:50.391800+0000","last_became_active":"2020-11-27T21:41:07.350818+0000","last_became_peered":"2020-11-27T21:41:07.350818+0000","last_unstale":"2020-11-27T21:43:50.391800+0000","last_undegraded":"2020-11-27T21:43:50.391800+0000","last_fullsized":"2020-11-27T21:43:50.391800+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"36'2636","reported_seq":"3780","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718531+0000","last_change":"2020-11-27T21:41:16.703957+0000","last_active":"2020-11-27T21:44:10.718531+0000","last_peered":"2020-11-27T21:44:10.718531+0000","last_clean":"2020-11-27T21:44:10.718531+0000","last_became_active":"2020-11-27T21:41:16.703682+0000","last_became_peered":"2020-11-27T21:41:16.703682+0000","last_unstale":"2020-11-27T21:44:10.718531+0000","last_undegraded":"2020-11-27T21:44:10.718531+0000","last_fullsized":"2020-11-27T21:44:10.718531+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2636,"ondisk_log_size":2636,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":93399210,"num_objects":53,"num_object_clones":0,"num_object_copies":106,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":15,"num_read":866,"num_read_kb":73417,"num_write":2062,"num_write_kb":623509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2893,"num_flush":449,"num_flush_kb":1118691,"num_evict":346,"num_evict_kb":887992,"num_promote":522,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"36'8432","reported_seq":"12064","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.635216+0000","last_change":"2020-11-27T21:41:14.377372+0000","last_active":"2020-11-27T21:44:10.635216+0000","last_peered":"2020-11-27T21:44:10.635216+0000","last_clean":"2020-11-27T21:44:10.635216+0000","last_became_active":"2020-11-27T21:41:14.376308+0000","last_became_peered":"2020-11-27T21:41:14.376308+0000","last_unstale":"2020-11-27T21:44:10.635216+0000","last_undegraded":"2020-11-27T21:44:10.635216+0000","last_fullsized":"2020-11-27T21:44:10.635216+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8432,"ondisk_log_size":8432,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7140954355,"num_objects":2385,"num_object_clones":0,"num_object_copies":4770,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2385,"num_whiteouts":0,"num_read":6257,"num_read_kb":1960975,"num_write":10644,"num_write_kb":4244977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391526+0000","last_change":"2020-11-27T21:41:07.351187+0000","last_active":"2020-11-27T21:43:50.391526+0000","last_peered":"2020-11-27T21:43:50.391526+0000","last_clean":"2020-11-27T21:43:50.391526+0000","last_became_active":"2020-11-27T21:41:07.350931+0000","last_became_peered":"2020-11-27T21:41:07.350931+0000","last_unstale":"2020-11-27T21:43:50.391526+0000","last_undegraded":"2020-11-27T21:43:50.391526+0000","last_fullsized":"2020-11-27T21:43:50.391526+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"36'2860","reported_seq":"4067","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.722089+0000","last_change":"2020-11-27T21:41:16.703144+0000","last_active":"2020-11-27T21:44:10.722089+0000","last_peered":"2020-11-27T21:44:10.722089+0000","last_clean":"2020-11-27T21:44:10.722089+0000","last_became_active":"2020-11-27T21:41:16.702804+0000","last_became_peered":"2020-11-27T21:41:16.702804+0000","last_unstale":"2020-11-27T21:44:10.722089+0000","last_undegraded":"2020-11-27T21:44:10.722089+0000","last_fullsized":"2020-11-27T21:44:10.722089+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2860,"ondisk_log_size":2860,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":106152017,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":10,"num_read":950,"num_read_kb":89355,"num_write":2295,"num_write_kb":627872,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2860,"num_flush":466,"num_flush_kb":1197692,"num_evict":372,"num_evict_kb":992095,"num_promote":545,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"36'8766","reported_seq":"12677","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:09.632202+0000","last_change":"2020-11-27T21:41:14.398105+0000","last_active":"2020-11-27T21:44:09.632202+0000","last_peered":"2020-11-27T21:44:09.632202+0000","last_clean":"2020-11-27T21:44:09.632202+0000","last_became_active":"2020-11-27T21:41:14.397776+0000","last_became_peered":"2020-11-27T21:41:14.397776+0000","last_unstale":"2020-11-27T21:44:09.632202+0000","last_undegraded":"2020-11-27T21:44:09.632202+0000","last_fullsized":"2020-11-27T21:44:09.632202+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8766,"ondisk_log_size":8766,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7469148616,"num_objects":2503,"num_object_clones":0,"num_object_copies":5006,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2503,"num_whiteouts":0,"num_read":6780,"num_read_kb":2439371,"num_write":11076,"num_write_kb":4381816,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391517+0000","last_change":"2020-11-27T21:41:07.351271+0000","last_active":"2020-11-27T21:43:50.391517+0000","last_peered":"2020-11-27T21:43:50.391517+0000","last_clean":"2020-11-27T21:43:50.391517+0000","last_became_active":"2020-11-27T21:41:07.351005+0000","last_became_peered":"2020-11-27T21:41:07.351005+0000","last_unstale":"2020-11-27T21:43:50.391517+0000","last_undegraded":"2020-11-27T21:43:50.391517+0000","last_fullsized":"2020-11-27T21:43:50.391517+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"35'2913","reported_seq":"4197","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:08.393562+0000","last_change":"2020-11-27T21:41:16.394480+0000","last_active":"2020-11-27T21:44:08.393562+0000","last_peered":"2020-11-27T21:44:08.393562+0000","last_clean":"2020-11-27T21:44:08.393562+0000","last_became_active":"2020-11-27T21:41:16.394270+0000","last_became_peered":"2020-11-27T21:41:16.394270+0000","last_unstale":"2020-11-27T21:44:08.393562+0000","last_undegraded":"2020-11-27T21:44:08.393562+0000","last_fullsized":"2020-11-27T21:44:08.393562+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:15.369754+0000","last_clean_scrub_stamp":"2020-11-27T21:41:15.369754+0000","log_size":2913,"ondisk_log_size":2913,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":140623609,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":57,"num_whiteouts":13,"num_read":950,"num_read_kb":69864,"num_write":2308,"num_write_kb":633048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3041,"num_flush":475,"num_flush_kb":1233179,"num_evict":378,"num_evict_kb":1002108,"num_promote":590,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"36'8782","reported_seq":"12456","reported_epoch":"36","state":"active+clean","last_fresh":"2020-11-27T21:44:10.718150+0000","last_change":"2020-11-27T21:41:14.402078+0000","last_active":"2020-11-27T21:44:10.718150+0000","last_peered":"2020-11-27T21:44:10.718150+0000","last_clean":"2020-11-27T21:44:10.718150+0000","last_became_active":"2020-11-27T21:41:14.401920+0000","last_became_peered":"2020-11-27T21:41:14.401920+0000","last_unstale":"2020-11-27T21:44:10.718150+0000","last_undegraded":"2020-11-27T21:44:10.718150+0000","last_fullsized":"2020-11-27T21:44:10.718150+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:13.353138+0000","last_clean_scrub_stamp":"2020-11-27T21:41:13.353138+0000","log_size":8782,"ondisk_log_size":8782,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7540552444,"num_objects":2507,"num_object_clones":0,"num_object_copies":5014,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2507,"num_whiteouts":0,"num_read":6458,"num_read_kb":2064404,"num_write":11111,"num_write_kb":4363827,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388973+0000","last_change":"2020-11-27T21:41:07.347155+0000","last_active":"2020-11-27T21:43:50.388973+0000","last_peered":"2020-11-27T21:43:50.388973+0000","last_clean":"2020-11-27T21:43:50.388973+0000","last_became_active":"2020-11-27T21:41:07.346921+0000","last_became_peered":"2020-11-27T21:41:07.346921+0000","last_unstale":"2020-11-27T21:43:50.388973+0000","last_undegraded":"2020-11-27T21:43:50.388973+0000","last_fullsized":"2020-11-27T21:43:50.388973+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.388954+0000","last_change":"2020-11-27T21:41:07.346808+0000","last_active":"2020-11-27T21:43:50.388954+0000","last_peered":"2020-11-27T21:43:50.388954+0000","last_clean":"2020-11-27T21:43:50.388954+0000","last_became_active":"2020-11-27T21:41:07.346591+0000","last_became_peered":"2020-11-27T21:41:07.346591+0000","last_unstale":"2020-11-27T21:43:50.388954+0000","last_undegraded":"2020-11-27T21:43:50.388954+0000","last_fullsized":"2020-11-27T21:43:50.388954+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"30","reported_epoch":"35","state":"active+clean","last_fresh":"2020-11-27T21:43:50.391515+0000","last_change":"2020-11-27T21:41:08.068682+0000","last_active":"2020-11-27T21:43:50.391515+0000","last_peered":"2020-11-27T21:43:50.391515+0000","last_clean":"2020-11-27T21:43:50.391515+0000","last_became_active":"2020-11-27T21:41:08.067654+0000","last_became_peered":"2020-11-27T21:41:08.067654+0000","last_unstale":"2020-11-27T21:43:50.391515+0000","last_undegraded":"2020-11-27T21:43:50.391515+0000","last_fullsized":"2020-11-27T21:43:50.391515+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-27T21:41:06.326584+0000","last_clean_scrub_stamp":"2020-11-27T21:41:06.326584+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":447871378,"num_objects":224,"num_object_clones":0,"num_object_copies":448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":200,"num_whiteouts":49,"num_read":3695,"num_read_kb":322120,"num_write":8911,"num_write_kb":2503574,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":23,"num_bytes_hit_set_archive":13301,"num_flush":1867,"num_flush_kb":4760498,"num_evict":1476,"num_evict_kb":3864299,"num_promote":2239,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11266,"ondisk_log_size":11266,"up":8,"acting":8,"num_store_stats":0},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":0},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29184560242,"num_objects":9755,"num_object_clones":0,"num_object_copies":19510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9755,"num_whiteouts":0,"num_read":25705,"num_read_kb":8477908,"num_write":43432,"num_write_kb":17116320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":34347,"ondisk_log_size":34347,"up":8,"acting":8,"num_store_stats":0}],"osd_stats":[{"osd":1,"up_from":11,"seq":47244640296,"num_pgs":7,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":12317776,"kb_used_data":75735280,"kb_used_omap":18896,"kb_used_meta":0,"kb_avail":75719600,"statfs":{"total":90150273024,"available":77536870400,"internally_reserved":16056320,"allocated":77552926720,"data_stored":77552926720,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19350022,"internal_metadata":0},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.3280000000000001,"5min":1.282,"15min":1.3680000000000001},"min":{"1min":0.28699999999999998,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":5.2039999999999997,"5min":5.2039999999999997,"15min":5.2039999999999997},"last":0.44800000000000001},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.488,"15min":1.4590000000000001},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":5.5250000000000004,"5min":5.5250000000000004,"15min":5.5250000000000004},"last":0.63300000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.246,"5min":1.5129999999999999,"15min":1.456},"min":{"1min":0.33800000000000002,"5min":0.311,"15min":0.311},"max":{"1min":2.714,"5min":31.544,"15min":31.544},"last":0.48199999999999998},{"interface":"front","average":{"1min":1.677,"5min":1.526,"15min":1.5469999999999999},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":5.6210000000000004,"5min":5.6210000000000004,"15min":5.6210000000000004},"last":0.56399999999999995}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.0900000000000001,"5min":1.391,"15min":1.542},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":2.294,"5min":3.0049999999999999,"15min":3.0049999999999999},"last":1.6020000000000001},{"interface":"front","average":{"1min":1.554,"5min":1.4430000000000001,"15min":1.54},"min":{"1min":0.57099999999999995,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":5.8129999999999997,"5min":5.8129999999999997,"15min":5.8129999999999997},"last":1.76}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.2769999999999999,"5min":1.538,"15min":1.702},"min":{"1min":0.47499999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"max":{"1min":2.403,"5min":3.9399999999999999,"15min":3.9399999999999999},"last":0.92700000000000005},{"interface":"front","average":{"1min":1.538,"5min":1.671,"15min":1.825},"min":{"1min":0.55300000000000005,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":2.9529999999999998,"5min":3.5630000000000002,"15min":3.5630000000000002},"last":1.155}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.7150000000000001,"5min":2.0139999999999998,"15min":2.0129999999999999},"min":{"1min":0.52900000000000003,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":3.2280000000000002,"5min":31.224,"15min":31.224},"last":1.1839999999999999},{"interface":"front","average":{"1min":2.085,"5min":2.052,"15min":2.1899999999999999},"min":{"1min":0.67100000000000004,"5min":0.441,"15min":0.441},"max":{"1min":5.8970000000000002,"5min":5.8970000000000002,"15min":5.8970000000000002},"last":1.5389999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":523120,"kb_used_data":87555004,"kb_used_omap":5843,"kb_used_meta":0,"kb_avail":87514256,"statfs":{"total":90150273024,"available":89614598144,"internally_reserved":41725952,"allocated":89656324096,"data_stored":89656324096,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5983446,"internal_metadata":0},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.226,"5min":2.1190000000000002,"15min":1.5489999999999999},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":7.3719999999999999,"5min":69.585999999999999,"15min":69.585999999999999},"last":2.472},{"interface":"front","average":{"1min":1.869,"5min":2.3069999999999999,"15min":1.869},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":5.5199999999999996,"5min":69.953000000000003,"15min":69.953000000000003},"last":2.2490000000000001}]},{"osd":2,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0990000000000002,"5min":1.6890000000000001,"15min":1.768},"min":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"max":{"1min":6.0279999999999996,"5min":6.0279999999999996,"15min":6.0279999999999996},"last":1.381},{"interface":"front","average":{"1min":1.706,"5min":1.5069999999999999,"15min":1.613},"min":{"1min":0.30299999999999999,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":2.6200000000000001,"5min":2.6619999999999999,"15min":2.6619999999999999},"last":1.8400000000000001}]},{"osd":3,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.4339999999999999,"15min":1.6080000000000001},"min":{"1min":0.48199999999999998,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.968,"5min":3.073,"15min":3.073},"last":1.474},{"interface":"front","average":{"1min":1.55,"5min":1.605,"15min":1.7889999999999999},"min":{"1min":0.438,"5min":0.438,"15min":0.438},"max":{"1min":2.6829999999999998,"5min":3.488,"15min":3.488},"last":1.579}]},{"osd":4,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.0830000000000002,"5min":1.9930000000000001,"15min":2.1890000000000001},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":3.0920000000000001,"5min":5.0129999999999999,"15min":5.0129999999999999},"last":2.089},{"interface":"front","average":{"1min":2.1579999999999999,"5min":2.1139999999999999,"15min":2.3260000000000001},"min":{"1min":0.495,"5min":0.495,"15min":0.495},"max":{"1min":4.6989999999999998,"5min":4.7880000000000003,"15min":4.7880000000000003},"last":1.7190000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:08 2020","interfaces":[{"interface":"back","average":{"1min":2.601,"5min":2.1360000000000001,"15min":2.254},"min":{"1min":0.57799999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":5.0060000000000002,"5min":5.0060000000000002,"15min":5.0060000000000002},"last":1.978},{"interface":"front","average":{"1min":2.4350000000000001,"5min":2.194,"15min":2.3780000000000001},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":3.7349999999999999,"5min":4.3579999999999997,"15min":4.3579999999999997},"last":2.7639999999999998}]}]},{"osd":5,"up_from":11,"seq":47244640296,"num_pgs":6,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":7971388,"kb_used_data":80081792,"kb_used_omap":11391,"kb_used_meta":0,"kb_avail":80065988,"statfs":{"total":90150273024,"available":81987571712,"internally_reserved":16183296,"allocated":82003755008,"data_stored":82003755008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11664651,"internal_metadata":0},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,1,1],"upper_bound":16},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.86499999999999999,"5min":1.1970000000000001,"15min":1.385},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":2.0680000000000001,"5min":2.996,"15min":2.996},"last":0.51700000000000002},{"interface":"front","average":{"1min":0.86299999999999999,"5min":1.1459999999999999,"15min":1.3149999999999999},"min":{"1min":0.41199999999999998,"5min":0.33100000000000002,"15min":0.33100000000000002},"max":{"1min":1.3240000000000001,"5min":3.2290000000000001,"15min":3.2290000000000001},"last":0.66600000000000004}]},{"osd":1,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":1.1850000000000001,"5min":3.3690000000000002,"15min":2.0009999999999999},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":4.2750000000000004,"5min":209.85599999999999,"15min":209.85599999999999},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.84999999999999998,"5min":3.2509999999999999,"15min":1.9890000000000001},"min":{"1min":0.38200000000000001,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":1.3899999999999999,"5min":203.67400000000001,"15min":203.67400000000001},"last":1.232}]},{"osd":2,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":2.7349999999999999,"15min":1.927},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.863,"5min":142.636,"15min":142.636},"last":0.63400000000000001},{"interface":"front","average":{"1min":0.99199999999999999,"5min":2.7610000000000001,"15min":1.931},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":1.601,"5min":141.887,"15min":141.887},"last":0.72899999999999998}]},{"osd":3,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.53000000000000003,"5min":1.103,"15min":1.3560000000000001},"min":{"1min":0.32500000000000001,"5min":0.308,"15min":0.308},"max":{"1min":0.93500000000000005,"5min":3.6349999999999998,"15min":3.6349999999999998},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.55700000000000005,"5min":1.048,"15min":1.26},"min":{"1min":0.41799999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.91900000000000004,"5min":3.226,"15min":3.226},"last":0.53000000000000003}]},{"osd":4,"last update":"Fri Nov 27 21:44:06 2020","interfaces":[{"interface":"back","average":{"1min":0.55100000000000005,"5min":1.115,"15min":1.349},"min":{"1min":0.40300000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":1.2350000000000001,"5min":3.3530000000000002,"15min":3.3530000000000002},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.59399999999999997,"5min":1.198,"15min":1.452},"min":{"1min":0.45100000000000001,"5min":0.373,"15min":0.373},"max":{"1min":0.86599999999999999,"5min":4.2569999999999997,"15min":4.2569999999999997},"last":0.42099999999999999}]}]},{"osd":4,"up_from":11,"seq":47244640296,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":559892,"kb_used_data":87523976,"kb_used_omap":5807,"kb_used_meta":0,"kb_avail":87477484,"statfs":{"total":90150273024,"available":89576943616,"internally_reserved":47607808,"allocated":89624551424,"data_stored":89624551424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":5947376,"internal_metadata":0},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.81999999999999995,"5min":0.92100000000000004,"15min":1.022},"min":{"1min":0.40899999999999997,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":1.5680000000000001,"5min":3.4889999999999999,"15min":3.4889999999999999},"last":1.323},{"interface":"front","average":{"1min":0.83299999999999996,"5min":1.0229999999999999,"15min":1.151},"min":{"1min":0.36699999999999999,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.6539999999999999,"5min":3.7280000000000002,"15min":3.7280000000000002},"last":0.99399999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.83899999999999997,"5min":1.046,"15min":1.1679999999999999},"min":{"1min":0.34699999999999998,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":1.51,"5min":4.2599999999999998,"15min":4.2599999999999998},"last":1.4119999999999999},{"interface":"front","average":{"1min":0.85799999999999998,"5min":1.002,"15min":1.129},"min":{"1min":0.441,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":1.7350000000000001,"5min":3.2839999999999998,"15min":3.2839999999999998},"last":1.0429999999999999}]},{"osd":2,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":1.0469999999999999,"15min":1.177},"min":{"1min":0.47699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.526,"5min":4.1189999999999998,"15min":4.1189999999999998},"last":1.2130000000000001},{"interface":"front","average":{"1min":0.89500000000000002,"5min":1.113,"15min":1.2589999999999999},"min":{"1min":0.502,"5min":0.502,"15min":0.502},"max":{"1min":1.593,"5min":4.5099999999999998,"15min":4.5099999999999998},"last":1.498}]},{"osd":3,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.82299999999999995,"15min":0.98299999999999998},"min":{"1min":0.32800000000000001,"5min":0.31,"15min":0.31},"max":{"1min":0.75600000000000001,"5min":4.2439999999999998,"15min":4.2439999999999998},"last":0.63500000000000001},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.81699999999999995,"15min":0.95899999999999996},"min":{"1min":0.376,"5min":0.34699999999999998,"15min":0.34699999999999998},"max":{"1min":0.81699999999999995,"5min":4.5709999999999997,"15min":4.5709999999999997},"last":0.76300000000000001}]},{"osd":5,"last update":"Fri Nov 27 21:44:03 2020","interfaces":[{"interface":"back","average":{"1min":0.59399999999999997,"5min":0.82699999999999996,"15min":0.95999999999999996},"min":{"1min":0.375,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":1.107,"5min":3.7330000000000001,"15min":3.7330000000000001},"last":0.79500000000000004},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.84999999999999998,"15min":0.99399999999999999},"min":{"1min":0.39100000000000001,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.92700000000000005,"5min":3.4740000000000002,"15min":3.4740000000000002},"last":0.78600000000000003}]}]},{"osd":2,"up_from":11,"seq":47244640296,"num_pgs":5,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":8270228,"kb_used_data":79785072,"kb_used_omap":11753,"kb_used_meta":0,"kb_avail":79767148,"statfs":{"total":90150273024,"available":81681559552,"internally_reserved":18354176,"allocated":81699913728,"data_stored":81699913728,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12036074,"internal_metadata":0},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":2,"commit_latency_ns":0,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.421,"5min":1.242,"15min":1.28},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":2.7650000000000001,"5min":2.7650000000000001,"15min":2.7650000000000001},"last":1.4239999999999999},{"interface":"front","average":{"1min":1.9259999999999999,"5min":1.7909999999999999,"15min":1.885},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":3.3559999999999999,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.819}]},{"osd":1,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.667,"5min":1.496,"15min":1.552},"min":{"1min":0.374,"5min":0.308,"15min":0.308},"max":{"1min":2.6720000000000002,"5min":5.4080000000000004,"15min":5.4080000000000004},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.7150000000000001,"5min":1.6459999999999999,"15min":1.718},"min":{"1min":0.34100000000000003,"5min":0.34100000000000003,"15min":0.34100000000000003},"max":{"1min":2.6360000000000001,"5min":5.2169999999999996,"15min":5.2169999999999996},"last":2.0550000000000002}]},{"osd":3,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":3.2989999999999999,"15min":1.9199999999999999},"min":{"1min":0.44700000000000001,"5min":0.39200000000000002,"15min":0.39200000000000002},"max":{"1min":2.1389999999999998,"5min":227.292,"15min":227.292},"last":2.1389999999999998},{"interface":"front","average":{"1min":1.29,"5min":3.5009999999999999,"15min":2.081},"min":{"1min":0.48299999999999998,"5min":0.46100000000000002,"15min":0.46100000000000002},"max":{"1min":2.2170000000000001,"5min":235.67500000000001,"15min":235.67500000000001},"last":2.2170000000000001}]},{"osd":4,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5089999999999999,"5min":3.5960000000000001,"15min":2.218},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":2.6829999999999998,"5min":228.57499999999999,"15min":228.57499999999999},"last":2.6829999999999998},{"interface":"front","average":{"1min":1.7230000000000001,"5min":3.7320000000000002,"15min":2.3799999999999999},"min":{"1min":0.57199999999999995,"5min":0.57199999999999995,"15min":0.57199999999999995},"max":{"1min":3.0270000000000001,"5min":226.70099999999999,"15min":226.70099999999999},"last":2.4329999999999998}]},{"osd":5,"last update":"Fri Nov 27 21:44:10 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":3.9169999999999998,"15min":2.5800000000000001},"min":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"max":{"1min":3.0699999999999998,"5min":226.81200000000001,"15min":226.81200000000001},"last":2.9409999999999998},{"interface":"front","average":{"1min":2.1070000000000002,"5min":4.1879999999999997,"15min":2.8500000000000001},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":3.444,"5min":231.65899999999999,"15min":231.65899999999999},"last":2.8210000000000002}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":88037376,"kb_used":4320408,"kb_used_data":83729944,"kb_used_omap":4616,"kb_used_meta":0,"kb_avail":83716968,"statfs":{"total":90150273024,"available":85726175232,"internally_reserved":13287424,"allocated":85739462656,"data_stored":85739462656,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4727577,"internal_metadata":0},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":1,"commit_latency_ns":0,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":1.0009999999999999,"15min":1.0669999999999999},"min":{"1min":0.34999999999999998,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.93999999999999995,"5min":2.194,"15min":2.194},"last":1.379},{"interface":"front","average":{"1min":0.63300000000000001,"5min":1.0569999999999999,"15min":1.1279999999999999},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.96599999999999997,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.1879999999999999}]},{"osd":1,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":1.1140000000000001,"15min":1.1759999999999999},"min":{"1min":0.46700000000000003,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":1.8160000000000001,"5min":3.4460000000000002,"15min":3.4460000000000002},"last":1.151},{"interface":"front","average":{"1min":0.73299999999999998,"5min":1.2929999999999999,"15min":1.387},"min":{"1min":0.53100000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.8320000000000001,"5min":3.274,"15min":3.274},"last":1.327}]},{"osd":2,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.66600000000000004,"5min":1.7450000000000001,"15min":1.925},"min":{"1min":0.42099999999999999,"5min":0.42099999999999999,"15min":0.42099999999999999},"max":{"1min":0.94699999999999995,"5min":8.6219999999999999,"15min":8.6219999999999999},"last":1.133},{"interface":"front","average":{"1min":0.73899999999999999,"5min":1.8260000000000001,"15min":2.0070000000000001},"min":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"max":{"1min":1.042,"5min":9.5869999999999997,"15min":9.5869999999999997},"last":0.89900000000000002}]},{"osd":4,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":1.169,"15min":1.2909999999999999},"min":{"1min":0.34200000000000003,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.58899999999999997,"5min":4.3220000000000001,"15min":4.3220000000000001},"last":0.36099999999999999},{"interface":"front","average":{"1min":0.56100000000000005,"5min":1.347,"15min":1.478},"min":{"1min":0.40999999999999998,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.75900000000000001,"5min":4.5289999999999999,"15min":4.5289999999999999},"last":0.48899999999999999}]},{"osd":5,"last update":"Fri Nov 27 21:43:09 2020","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":1.3939999999999999,"15min":1.544},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.67600000000000005,"5min":4.2629999999999999,"15min":4.2629999999999999},"last":0.436},{"interface":"front","average":{"1min":0.57699999999999996,"5min":1.4079999999999999,"15min":1.546},"min":{"1min":0.42699999999999999,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.73999999999999999,"5min":4.4260000000000002,"15min":4.4260000000000002},"last":0.47399999999999998}]}]}]}} 2020-11-28T07:48:56.950 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-27T21:44:57.845 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 , 2020-11-27T21:44:57.995 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@gibba015.front.sepia.ceph.com , 2020-11-27T21:44:57.996 INFO:teuthology.orchestra.run.gibba015:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2020-11-28T07:49:04.795 INFO:scrape:Found 10 distinct failure reasons 2020-11-28T07:49:04.797 INFO:scrape:Failure: Could not find an image for rhel 8.0 2020-11-28T07:49:04.798 INFO:scrape:15 jobs: ['5660907', '5660898', '5661003', '5660779', '5660999', '5660909', '5660729', '5660747', '5660751', '5660835', '5660913', '5660732', '5660840', '5660891', '5660758'] 2020-11-28T07:49:04.799 INFO:scrape: 2020-11-28T07:49:04.800 INFO:scrape:Failure: Command failed (workunit test cephadm/test_cephadm.sh) on gibba028 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2020-11-28T07:49:04.800 INFO:scrape:3 jobs: ['5660867', '5660710', '5660783'] 2020-11-28T07:49:04.801 INFO:scrape:suites intersection: ['task/test_cephadm}'] 2020-11-28T07:49:04.802 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_cephadm}'] 2020-11-28T07:49:04.802 INFO:scrape: 2020-11-28T07:49:04.803 INFO:scrape:Failure: Failed to fetch package version from https://shaman.ceph.com/api/search/?status=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref=hammer 2020-11-28T07:49:04.804 INFO:scrape:2 jobs: ['5660690', '5660976'] 2020-11-28T07:49:04.804 INFO:scrape:suites intersection: ['1-install/hammer', 'ceph', 'clusters/{openstack', 'd-balancer/off', 'distro$/{ubuntu_18.04}', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2020-11-28T07:49:04.805 INFO:scrape:suites union: ['1-install/hammer', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/off', 'distro$/{ubuntu_18.04}', 'msgr-failures/few', 'msgr-failures/osd-delay', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/mapgap', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/snaps-few-objects}'] 2020-11-28T07:49:04.805 INFO:scrape: 2020-11-28T07:49:04.805 INFO:scrape:Failure: Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) 2020-11-28T07:49:04.810 INFO:scrape:2 jobs: ['5660904', '5660743'] 2020-11-28T07:49:04.810 INFO:scrape:suites intersection: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-11-28T07:49:04.811 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_orch_cli}'] 2020-11-28T07:49:04.811 INFO:scrape: 2020-11-28T07:49:04.812 INFO:scrape:Failure: Command failed (workunit test cephadm/test_adoption.sh) on gibba011 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' 2020-11-28T07:49:04.812 INFO:scrape:3 jobs: ['5660849', '5660762', '5660691'] 2020-11-28T07:49:04.813 INFO:scrape:suites intersection: ['task/test_adoption}'] 2020-11-28T07:49:04.813 INFO:scrape:suites union: ['rados/cephadm/workunits/{distro/centos_latest', 'rados/cephadm/workunits/{distro/ubuntu_18.04_podman', 'task/test_adoption}'] 2020-11-28T07:49:04.813 INFO:scrape: 2020-11-28T07:49:04.814 INFO:scrape:Failure: Command failed on gibba007 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo add-apt-repository -y ppa:projectatomic/ppa'" 2020-11-28T07:49:04.814 INFO:scrape:1 jobs: ['5660803'] 2020-11-28T07:49:04.815 INFO:scrape:suites: ['fixed-2', 'rados/cephadm/smoke/{distro/ubuntu_18.04_podman', 'start}'] 2020-11-28T07:49:04.815 INFO:scrape: 2020-11-28T07:49:04.815 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 2020-11-28T07:49:04.816 INFO:scrape:1 jobs: ['5660850'] 2020-11-28T07:49:04.816 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async', 'objectstore/filestore-xfs', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{ubuntu_latest}}'] 2020-11-28T07:49:04.817 INFO:scrape: 2020-11-28T07:49:04.817 INFO:scrape:Failure: Command failed on gibba014 with status 5: 'sudo systemctl stop ceph-319a0420-30f7-11eb-980d-001a4aab830c@mon.a' 2020-11-28T07:49:04.817 INFO:scrape:2 jobs: ['5660843', '5661004'] 2020-11-28T07:49:04.822 INFO:scrape:suites intersection: ['2-repo_digest/defaut', '3-start-upgrade', '4-wait', 'fixed-2}', 'rados/cephadm/upgrade/{1-start'] 2020-11-28T07:49:04.822 INFO:scrape:suites union: ['2-repo_digest/defaut', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_18.04_podman}', 'distro$/{ubuntu_18.04}', 'fixed-2}', 'rados/cephadm/upgrade/{1-start'] 2020-11-28T07:49:04.823 INFO:scrape: 2020-11-28T07:49:04.823 INFO:scrape:Failure: Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) 2020-11-28T07:49:04.824 INFO:scrape:1 jobs: ['5660774'] 2020-11-28T07:49:04.824 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-comp-zlib', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}'] 2020-11-28T07:49:04.824 INFO:scrape: 2020-11-28T07:49:04.825 INFO:scrape:Failure: Command failed (workunit test osd/osd-recovery-prio.sh) on gibba007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery-prio.sh' 2020-11-28T07:49:04.826 INFO:scrape:1 jobs: ['5660900'] 2020-11-28T07:49:04.827 INFO:scrape:suites: ['rados/standalone/{supported-random-distro$/{ubuntu_latest}', 'workloads/osd}'] 2020-11-28T07:49:04.827 INFO:scrape: 2020-11-28T07:49:04.852 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba ================================================================= info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/ logs: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/ failed: 16 dead: 15 running: 0 waiting: 0 queued: 0 passed: 289 Fail ================================================================= [5660690] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/hammer backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:02:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660690/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660690/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c5c3ba2935ae4fd3b586b5e641f87e2e Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref= hammer [5660691] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:05:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660691/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660691/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6dad98743f1249a3af5744c1b3a7f12d Command failed (workunit test cephadm/test_adoption.sh) on gibba034 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5660710] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:04:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660710/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660710/ sentry: https://sentry.ceph.com/organizations/ceph/?query=047c920d4c9a4f2eae55a8206a9bbb69 Command failed (workunit test cephadm/test_cephadm.sh) on gibba010 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5660743] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660743/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660743/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0db7a67b0a66456bb6439639eb57357f Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [5660762] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} ----------------------------------------------------------------- time: 00:04:42 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660762/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660762/ sentry: https://sentry.ceph.com/organizations/ceph/?query=6d3263f9e4bd4a6d826d4a9703ea7a6b Command failed (workunit test cephadm/test_adoption.sh) on gibba040 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5660774] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard} ----------------------------------------------------------------- time: 00:56:27 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660774/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660774/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d44ee6f134f54ae99bbd552ff3268d24 Test failure: test_pwd_expiration_date_update (tasks.mgr.dashboard.test_user.UserTest) [5660783] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} ----------------------------------------------------------------- time: 00:05:01 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660783/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660783/ sentry: https://sentry.ceph.com/organizations/ceph/?query=d80da49ce57144b1ad84b65cf4ff032f Command failed (workunit test cephadm/test_cephadm.sh) on gibba044 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5660803] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} ----------------------------------------------------------------- time: 00:04:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660803/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660803/ sentry: https://sentry.ceph.com/organizations/ceph/?query=2368ece8c87a4b76802d34ec2a642cf0 Command failed on gibba007 with status 1: "sudo TESTDIR=/home/ubuntu/cephtest bash -c 'sudo add-apt-repository -y ppa:projectatomic/ppa'" [5660843] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2} ----------------------------------------------------------------- time: 00:02:13 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660843/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660843/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ee3d0e02b10a4ddd95491131499ab27a Command failed on gibba014 with status 5: 'sudo systemctl stop ceph-319a0420-30f7-11eb-980d-001a4aab830c@mon.a' [5660849] rados/cephadm/workunits/{distro/centos_latest task/test_adoption} ----------------------------------------------------------------- time: 00:04:56 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660849/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660849/ sentry: https://sentry.ceph.com/organizations/ceph/?query=55d14e6a59f94a8aa58d9d344453d7b5 Command failed (workunit test cephadm/test_adoption.sh) on gibba011 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_adoption.sh' [5660850] rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} ----------------------------------------------------------------- time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660850/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660850/ Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' [5660867] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm} ----------------------------------------------------------------- time: 00:04:34 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660867/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660867/ sentry: https://sentry.ceph.com/organizations/ceph/?query=811b6d130d2845aca019ef61eba2b29c Command failed (workunit test cephadm/test_cephadm.sh) on gibba028 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' [5660900] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/osd} ----------------------------------------------------------------- time: 02:04:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660900/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660900/ sentry: https://sentry.ceph.com/organizations/ceph/?query=0504af0ddbcd44bf90d8c52e67b06cb8 Command failed (workunit test osd/osd-recovery-prio.sh) on gibba007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=c2a20e183fa3e99558a18c72740747e4b8c8b359 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/osd/osd-recovery- prio.sh' [5660904] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_orch_cli} ----------------------------------------------------------------- time: 00:09:54 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660904/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660904/ sentry: https://sentry.ceph.com/organizations/ceph/?query=fa04ca20ed2e4f50abeb86482ed38e97 Test failure: test_cluster_info (tasks.cephfs.test_nfs.TestNFS) [5660976] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/hammer backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/snaps-few-objects} ----------------------------------------------------------------- time: 00:03:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660976/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660976/ sentry: https://sentry.ceph.com/organizations/ceph/?query=bd8e3f1abff249a99e8a4d2c505af9c5 Failed to fetch package version from https://shaman.ceph.com/api/search/?st atus=ready&project=ceph&flavor=default&distros=ubuntu%2F18.04%2Fx86_64&ref= hammer [5661004] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2} ----------------------------------------------------------------- time: 00:03:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661004/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661004/ sentry: https://sentry.ceph.com/organizations/ceph/?query=310738fc2501438fb2aeb918de1f22b7 Command failed on gibba022 with status 5: 'sudo systemctl stop ceph-49b5cc5a-3125-11eb-980d-001a4aab830c@mon.a' Dead ================================================================= [5660729] rados/cephadm/smoke/{distro/rhel_7 fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660729/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660729/ sentry: https://sentry.ceph.com/organizations/ceph/?query=36b29237228245778c5c0e9e9bcf8a08 Could not find an image for rhel 7.7 [5660732] rados/cephadm/smoke-roleless/{distro/rhel_7 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660732/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660732/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86d73b9db10a4b1491c4b9e801dc8726 Could not find an image for rhel 7.7 [5660747] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660747/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660747/ sentry: https://sentry.ceph.com/organizations/ceph/?query=12b7d81216d447ea95c57836f96b18e8 Could not find an image for rhel 8.0 [5660751] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660751/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660751/ sentry: https://sentry.ceph.com/organizations/ceph/?query=ade9042c77e340a7968019ae8147a07a Could not find an image for rhel 8.0 [5660758] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660758/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660758/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7e77ea3950834ef4b8176044ed3ddd69 Could not find an image for rhel 8.0 [5660779] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660779/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660779/ sentry: https://sentry.ceph.com/organizations/ceph/?query=8e16269fe0154cebab3f334d48526cf0 Could not find an image for rhel 8.0 [5660835] rados/cephadm/smoke/{distro/centos_7 fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660835/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660835/ sentry: https://sentry.ceph.com/organizations/ceph/?query=aeb5c258fa334cfea927a8f732729494 Could not find an image for centos 7.6 [5660840] rados/cephadm/smoke-roleless/{distro/centos_7 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660840/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660840/ sentry: https://sentry.ceph.com/organizations/ceph/?query=c70ece1698ce4485ab2ff25bb52de03e Could not find an image for centos 7.6 [5660891] rados/cephadm/smoke/{distro/rhel_7 fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660891/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660891/ sentry: https://sentry.ceph.com/organizations/ceph/?query=7b459f00765246a4b912fa5d39406fab Could not find an image for rhel 7.7 [5660898] rados/cephadm/smoke-roleless/{distro/rhel_7 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660898/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660898/ sentry: https://sentry.ceph.com/organizations/ceph/?query=72fc2300e4ea40048590f0180e3ef3ac Could not find an image for rhel 7.7 [5660907] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660907/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660907/ sentry: https://sentry.ceph.com/organizations/ceph/?query=b5b86c375d20444d974f389e32360c7d Could not find an image for rhel 8.0 [5660909] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660909/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660909/ sentry: https://sentry.ceph.com/organizations/ceph/?query=86e805fafd464691b25e9b3c515bae8e Could not find an image for rhel 8.0 [5660913] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660913/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660913/ sentry: https://sentry.ceph.com/organizations/ceph/?query=41ac73836b734e09b21413d7c60404c7 Could not find an image for rhel 8.0 [5660999] rados/cephadm/smoke/{distro/centos_7 fixed-2 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660999/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660999/ sentry: https://sentry.ceph.com/organizations/ceph/?query=01a3353d7cde4d5e80799684838bf35d Could not find an image for centos 7.6 [5661003] rados/cephadm/smoke-roleless/{distro/centos_7 start} ----------------------------------------------------------------- time: 00:00:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661003/ log: http://qa-proxy.ceph.com/teuthology/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661003/ sentry: https://sentry.ceph.com/organizations/ceph/?query=955e393859f54eb898e1282b09c4587b Could not find an image for centos 7.6 Pass ================================================================= [5660689] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}} time: 00:06:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660689/ [5660692] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:16:06 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660692/ [5660693] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:07:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660693/ [5660694] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:18:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660694/ [5660695] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/force-sync-many workloads/rados_mon_workunits} time: 00:28:05 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660695/ [5660696] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:06:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660696/ [5660697] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:09:19 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660697/ [5660698] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:10:05 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660698/ [5660699] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps} time: 00:20:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660699/ [5660700] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660700/ [5660701] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:17:15 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660701/ [5660702] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_latest} tasks/dashboard} time: 00:59:20 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660702/ [5660703] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} tasks/mon_clock_no_skews} time: 00:07:18 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660703/ [5660704] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}} time: 00:09:37 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660704/ [5660705] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:24:55 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660705/ [5660706] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660706/ [5660707] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660707/ [5660708] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/lockdep} time: 00:17:23 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660708/ [5660709] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:22:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660709/ [5660711] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{ubuntu_latest}} time: 00:05:55 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660711/ [5660712] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:28:05 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660712/ [5660713] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-snaps-balanced} time: 00:23:33 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660713/ [5660714] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}} time: 00:22:22 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660714/ [5660715] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/prometheus} time: 00:08:19 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660715/ [5660716] rados/standalone/{supported-random-distro$/{centos_latest} workloads/erasure-code} time: 00:31:05 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660716/ [5660717] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:10:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660717/ [5660718] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:34 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660718/ [5660719] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:23:31 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660719/ [5660720] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api} time: 00:17:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660720/ [5660721] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:08:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660721/ [5660722] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:20:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660722/ [5660723] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:11:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660723/ [5660724] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:12:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660724/ [5660725] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-snaps} time: 00:19:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660725/ [5660726] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:03:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660726/ [5660727] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{centos_latest}} time: 00:05:29 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660727/ [5660728] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/many workloads/snaps-few-objects} time: 00:37:20 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660728/ [5660730] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mostlyread} time: 00:23:03 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660730/ [5660731] rados/singleton/{all/peer msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:05:31 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660731/ [5660733] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:13:55 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660733/ [5660734] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache} time: 00:08:01 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660734/ [5660735] rados/multimon/{clusters/9 msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:05:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660735/ [5660736] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:23:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660736/ [5660737] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:07 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660737/ [5660738] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/valgrind} time: 01:12:36 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660738/ [5660739] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:16:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660739/ [5660740] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:57:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660740/ [5660741] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_latest}} time: 00:07:32 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660741/ [5660742] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:08:50 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660742/ [5660744] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_latest}} time: 00:04:27 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660744/ [5660745] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_latest} tasks/workunits} time: 00:05:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660745/ [5660746] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/dedup_tier} time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660746/ [5660748] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps} time: 00:28:06 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660748/ [5660749] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects} time: 00:18:31 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660749/ [5660750] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:14:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660750/ [5660752] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:06:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660752/ [5660753] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:35 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660753/ [5660754] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:28:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660754/ [5660755] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/pool-snaps-few-objects} time: 00:23:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660755/ [5660756] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite} time: 00:08:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660756/ [5660757] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/pool-create-delete} time: 00:14:23 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660757/ [5660759] rados/singleton/{all/radostool msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660759/ [5660760] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/mgr} time: 00:09:48 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660760/ [5660761] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{rhel_latest}} time: 00:07:24 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660761/ [5660763] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-small-objects-overwrites} time: 00:17:57 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660763/ [5660764] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read} time: 00:08:35 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660764/ [5660765] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/rados_api_tests} time: 00:18:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660765/ [5660766] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery} time: 00:17:27 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660766/ [5660767] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:53 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660767/ [5660768] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:53 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660768/ [5660769] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/lockdep} time: 00:08:15 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660769/ [5660770] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:11:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660770/ [5660771] rados/singleton/{all/random-eio msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}} time: 00:15:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660771/ [5660772] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:09:51 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660772/ [5660773] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench} time: 01:10:48 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660773/ [5660775] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/crash} time: 00:07:25 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660775/ [5660776] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_latest}} time: 02:28:35 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660776/ [5660777] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:25:01 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660777/ [5660778] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest} time: 00:13:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660778/ [5660780] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}} time: 00:15:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660780/ [5660781] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/radosbench-high-concurrency} time: 00:45:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660781/ [5660782] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2} time: 00:24:25 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660782/ [5660784] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660784/ [5660785] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{centos_latest}} time: 00:06:07 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660785/ [5660786] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/repair_test} time: 00:11:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660786/ [5660787] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw} time: 00:09:57 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660787/ [5660788] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:11:31 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660788/ [5660789] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:13:59 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660789/ [5660790] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/radosbench} time: 01:27:59 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660790/ [5660791] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925} time: 00:07:35 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660791/ [5660792] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:09:53 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660792/ [5660793] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:27:44 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660793/ [5660794] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:06:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660794/ [5660795] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:03:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660795/ [5660796] rados/multimon/{clusters/3 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:04:37 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660796/ [5660797] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:21:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660797/ [5660798] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:21:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660798/ [5660799] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/valgrind} time: 00:38:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660799/ [5660800] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/redirect} time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660800/ [5660801] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}} time: 00:06:30 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660801/ [5660802] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read} time: 00:07:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660802/ [5660804] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls} time: 00:21:01 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660804/ [5660805] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest}} time: 00:06:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660805/ [5660806] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/failover} time: 00:09:48 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660806/ [5660807] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/misc} time: 00:22:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660807/ [5660808] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:10:26 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660808/ [5660809] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/scrub_test} time: 00:07:50 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660809/ [5660810] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 00:57:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660810/ [5660811] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}} time: 02:17:29 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660811/ [5660812] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/redirect_promote_tests} time: 00:11:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660812/ [5660813] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites} time: 00:22:51 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660813/ [5660814] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660814/ [5660815] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:14:20 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660815/ [5660816] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1} time: 00:24:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660816/ [5660817] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest}} time: 00:12:57 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660817/ [5660818] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:11:18 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660818/ [5660819] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw} time: 00:07:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660819/ [5660820] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{rhel_latest}} time: 00:07:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660820/ [5660821] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660821/ [5660822] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} thrashers/sync workloads/rados_api_tests} time: 00:22:56 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660822/ [5660823] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/redirect_set_object} time: 00:10:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660823/ [5660824] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest}} time: 01:02:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660824/ [5660825] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async-v1only start tasks/rados_python} time: 00:18:48 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660825/ [5660826] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} time: 04:30:14 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660826/ [5660827] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_latest}} time: 00:09:20 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660827/ [5660828] rados/multimon/{clusters/6 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660828/ [5660829] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:10:26 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660829/ [5660830] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:23:26 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660830/ [5660831] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/lockdep} time: 00:10:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660831/ [5660832] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}} time: 00:37:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660832/ [5660833] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects} time: 00:36:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660833/ [5660834] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/set-chunk-promote-flush} time: 00:10:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660834/ [5660836] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write} time: 00:10:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660836/ [5660837] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/rados_api_tests} time: 00:20:03 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660837/ [5660838] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/insights} time: 00:09:46 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660838/ [5660839] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_latest}} time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660839/ [5660841] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660841/ [5660842] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest}} time: 00:18:24 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660842/ [5660844] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/set-chunks-read} time: 00:12:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660844/ [5660845] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1} time: 00:20:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660845/ [5660846] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} tasks/dashboard} time: 00:57:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660846/ [5660847] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_latest}} time: 00:06:33 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660847/ [5660848] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:23:55 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660848/ [5660851] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/mon} time: 00:34:56 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660851/ [5660852] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:28:05 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660852/ [5660853] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read} time: 00:11:02 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660853/ [5660854] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune} time: 00:36:04 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660854/ [5660855] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/small-objects-balanced} time: 00:19:31 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660855/ [5660856] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:21:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660856/ [5660857] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start} time: 00:09:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660857/ [5660858] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{rhel_latest}} time: 00:08:59 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660858/ [5660859] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}} time: 00:07:32 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660859/ [5660860] rados/cephadm/smoke-roleless/{distro/centos_8.0 start} time: 00:08:07 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660860/ [5660861] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/none thrashosds-health workloads/test_rbd_api} time: 00:13:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660861/ [5660862] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_recovery} time: 00:09:23 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660862/ [5660863] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:25:55 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660863/ [5660864] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:18:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660864/ [5660865] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/valgrind} time: 00:21:27 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660865/ [5660866] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_cls_all} time: 00:10:22 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660866/ [5660868] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/small-objects-localized} time: 00:16:42 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660868/ [5660869] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{centos_latest} tasks/module_selftest} time: 00:24:46 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660869/ [5660870] rados/singleton/{all/admin-socket msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:04:27 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660870/ [5660871] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read} time: 00:09:15 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660871/ [5660872] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/root msgr/async-v2only start tasks/rados_python} time: 00:16:19 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660872/ [5660873] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-hybrid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:25 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660873/ [5660874] rados/cephadm/smoke/{distro/centos_latest fixed-2 start} time: 00:09:46 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660874/ [5660875] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{rhel_latest}} time: 00:16:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660875/ [5660876] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-radosbench} time: 01:34:05 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660876/ [5660877] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects} time: 00:19:18 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660877/ [5660878] rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:05:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660878/ [5660879] rados/cephadm/smoke-roleless/{distro/centos_latest start} time: 00:08:47 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660879/ [5660880] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} tasks/dashboard} time: 00:56:53 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660880/ [5660881] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_latest}} time: 00:07:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660881/ [5660882] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest} time: 00:13:14 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660882/ [5660883] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos} time: 00:03:02 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660883/ [5660884] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/many workloads/pool-create-delete} time: 00:15:06 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660884/ [5660885] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:06:14 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660885/ [5660886] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read} time: 00:09:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660886/ [5660887] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/packaged msgr/async start tasks/rados_api_tests} time: 00:26:13 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660887/ [5660888] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/snaps-few-objects-balanced} time: 00:20:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660888/ [5660889] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_python} time: 00:11:02 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660889/ [5660890] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/cache-snaps} time: 00:35:36 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660890/ [5660892] rados/multimon/{clusters/21 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews} time: 00:05:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660892/ [5660893] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:08:37 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660893/ [5660894] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:24:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660894/ [5660895] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados tasks/rados_api_tests validater/lockdep} time: 00:17:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660895/ [5660896] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_latest}} time: 00:26:37 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660896/ [5660897] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}} time: 00:06:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660897/ [5660899] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_latest} tasks/progress} time: 00:14:36 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660899/ [5660901] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/snaps-few-objects-localized} time: 00:24:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660901/ [5660902] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites} time: 00:19:24 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660902/ [5660903] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660903/ [5660905] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read} time: 00:07:56 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660905/ [5660906] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}} time: 00:07:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660906/ [5660908] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-balanced} time: 00:20:26 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660908/ [5660910] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects} time: 00:28:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660910/ [5660911] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}} time: 00:35:02 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660911/ [5660912] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{ubuntu_latest}} time: 00:15:02 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660912/ [5660914] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} tasks/rados_stress_watch} time: 00:12:03 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660914/ [5660915] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/one workloads/rados_5925} time: 00:06:22 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660915/ [5660916] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{centos_latest} tasks/dashboard} time: 00:57:53 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660916/ [5660917] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}} time: 00:17:47 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660917/ [5660918] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest}} time: 00:26:47 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660918/ [5660919] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2} time: 00:11:36 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660919/ [5660920] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/radosbench} time: 01:22:34 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660920/ [5660921] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write} time: 00:07:55 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660921/ [5660922] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/write_fadvise_dontneed} time: 00:09:41 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660922/ [5660923] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest}} time: 00:04:33 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660923/ [5660924] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption} time: 00:05:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660924/ [5660925] rados/multimon/{clusters/3 msgr-failures/few msgr/async no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews} time: 00:04:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660925/ [5660926] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:22:32 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660926/ [5660927] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:25:16 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660927/ [5660928] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-stupid rados tasks/rados_cls_all validater/valgrind} time: 01:11:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660928/ [5660929] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start} time: 00:10:57 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660929/ [5660930] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_latest} tasks/prometheus} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660930/ [5660931] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-stupid rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:08:36 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660931/ [5660932] rados/cephadm/smoke-roleless/{distro/rhel_latest start} time: 00:09:47 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660932/ [5660933] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}} time: 00:25:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660933/ [5660934] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/admin_socket_objecter_requests} time: 00:23:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660934/ [5660935] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{ubuntu_latest}} time: 00:05:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660935/ [5660936] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/packaged msgr/async-v2only start tasks/rados_api_tests} time: 00:28:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660936/ [5660937] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write} time: 00:23:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660937/ [5660938] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-fast-read} time: 00:18:37 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660938/ [5660939] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm} time: 00:09:56 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660939/ [5660940] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}} time: 00:36:23 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660940/ [5660941] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/rados_striper} time: 00:06:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660941/ [5660942] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/cache-agent-big} time: 00:21:29 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660942/ [5660943] rados/standalone/{supported-random-distro$/{centos_latest} workloads/scrub} time: 01:21:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660943/ [5660944] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites} time: 00:22:13 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660944/ [5660945] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start} time: 00:11:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660945/ [5660946] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/few rados thrashers/default thrashosds-health workloads/rbd_cls} time: 00:18:33 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660946/ [5660947] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start} time: 00:10:32 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660947/ [5660948] rados/monthrash/{ceph clusters/3-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/sync-many workloads/rados_api_tests} time: 00:21:12 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660948/ [5660949] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}} time: 00:04:45 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660949/ [5660950] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{rhel_latest}} time: 00:37:54 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660950/ [5660951] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:00:29 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660951/ [5660952] rados/objectstore/{backends/objectstore supported-random-distro$/{centos_latest}} time: 03:55:11 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660952/ [5660953] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/root msgr/async start tasks/rados_python} time: 00:19:13 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660953/ [5660954] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-small} time: 00:08:03 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660954/ [5660955] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_fio} time: 00:09:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660955/ [5660956] rados/multimon/{clusters/6 msgr-failures/many msgr/async-v1only no_pools objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} tasks/mon_recovery} time: 00:10:19 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660956/ [5660957] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3} time: 00:07:46 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660957/ [5660958] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:26:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660958/ [5660959] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados tasks/mon_recovery validater/lockdep} time: 00:07:57 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660959/ [5660960] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos} time: 00:03:29 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660960/ [5660961] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{centos_latest} tasks/workunits} time: 00:05:57 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660961/ [5660962] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}} time: 00:09:06 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660962/ [5660963] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:09:08 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660963/ [5660964] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start} time: 00:12:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660964/ [5660965] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/off msgr-failures/few msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps-readproxy} time: 00:23:47 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660965/ [5660966] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start} time: 00:10:53 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660966/ [5660967] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}} time: 00:09:52 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660967/ [5660968] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big} time: 00:28:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660968/ [5660969] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{rhel_latest}} time: 00:08:25 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660969/ [5660970] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests} time: 00:28:28 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660970/ [5660971] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_radosbench} time: 00:08:38 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660971/ [5660972] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-small-objects-many-deletes} time: 00:24:06 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660972/ [5660973] rados/cephadm/workunits/{distro/centos_latest task/test_orch_cli} time: 00:15:16 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660973/ [5660974] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/upmap msgr-failures/osd-delay msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps} time: 00:21:18 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660974/ [5660975] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}} time: 00:06:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660975/ [5660977] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start} time: 00:11:59 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660977/ [5660978] rados/monthrash/{ceph clusters/9-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/sync workloads/rados_mon_osdmap_prune} time: 00:37:59 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660978/ [5660979] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start} time: 00:10:07 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660979/ [5660980] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest}} time: 00:09:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660980/ [5660981] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/crush-compat msgr-failures/fastclose msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-snaps-balanced} time: 00:18:46 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660981/ [5660982] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}} time: 00:09:26 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660982/ [5660983] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard} time: 01:08:00 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660983/ [5660984] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} tasks/crash} time: 00:07:42 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660984/ [5660985] rados/multimon/{clusters/9 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews} time: 00:05:14 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660985/ [5660986] rados/objectstore/{backends/alloc-hint supported-random-distro$/{ubuntu_latest}} time: 00:05:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660986/ [5660987] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write} time: 00:13:02 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660987/ [5660988] rados/rest/{mgr-restful supported-random-distro$/{centos_latest}} time: 00:06:20 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660988/ [5660989] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}} time: 00:25:15 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660989/ [5660990] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_latest}} time: 00:12:29 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660990/ [5660991] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/crush} time: 00:09:40 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660991/ [5660992] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2} time: 00:24:03 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660992/ [5660993] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1} time: 00:22:58 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660993/ [5660994] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites} time: 00:27:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660994/ [5660995] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2} time: 00:10:17 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660995/ [5660996] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest} time: 05:12:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660996/ [5660997] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest} time: 00:15:21 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660997/ [5660998] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/valgrind} time: 00:24:09 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5660998/ [5661000] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix} time: 00:17:43 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661000/ [5661001] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_latest}} time: 00:14:01 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661001/ [5661002] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/off msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps} time: 00:18:10 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661002/ [5661005] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects} time: 00:18:42 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661005/ [5661006] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}} time: 00:06:39 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661006/ [5661007] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write} time: 00:14:25 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661007/ [5661008] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/test_rbd_api} time: 00:17:13 info: http://pulpito.ceph.com/yuriw-2020-11-27_16:50:49-rados-wip-yuri2-testing-2020-11-26-0903-octopus-distro-basic-gibba/5661008/