2020-11-11T10:49:52.197 INFO:root:teuthology version: 1.0.0-4ace5ba
2020-11-11T10:49:52.198 INFO:teuthology.results:subset: '20/100000'
2020-11-11T10:49:52.198 INFO:teuthology.results:seed: '5747'
2020-11-11T13:23:53.456 INFO:root:teuthology version: 1.0.0-4ace5ba
2020-11-11T13:23:53.487 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-11-11T18:32:04.434 INFO:teuthology.results:Tests finished! gathering results...
2020-11-11T18:32:45.969 INFO:scrape:Found 367 jobs
2020-11-11T18:32:50.888 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:50.891 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:50.893 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:50.893 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:50.894 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:50.998 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:51.000 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:51.002 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:51.003 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:51.003 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:51.109 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:51.111 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:51.113 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:51.114 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:51.115 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:51.218 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:51.220 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:51.222 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:51.223 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:51.223 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:51.328 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:51.330 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:51.331 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:51.332 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:51.333 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:51.437 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:51.439 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:51.441 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:51.441 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:51.442 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:51.552 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 16.0.0-7061-g7d0d9a13 (7d0d9a133194d135cf03ea30a929f2a9fa846008) pacific (dev)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xe5) [0x7f4fc097ee44]
,  2: (DeleteOp::_begin()+0x519) [0x55f615ae4099]

2020-11-11T18:32:51.554 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:37:16.955 INFO:teuthology.orchestra.run.smithi169.stdout:{"pg_ready":true,"pg_map":{"version":131,"stamp":"2020-11-11T11:37:14.978346+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30046083681,"num_objects":10094,"num_object_clones":0,"num_object_copies":20188,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10066,"num_whiteouts":21,"num_read":22786,"num_read_kb":930889,"num_write":53613,"num_write_kb":24988997,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49451,"ondisk_log_size":49451,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":33594612,"kb_used_data":33149872,"kb_used_omap":0,"kb_used_meta":386240,"kb_avail":532636428,"statfs":{"total":579820584960,"available":545419702272,"internally_reserved":0,"allocated":33945468928,"data_stored":40280503706,"data_compressed":141298882,"data_compressed_allocated":6477107200,"data_compressed_original":12954211476,"omap_allocated":0,"internal_metadata":395509760},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":63,"apply_latency_ms":63,"commit_latency_ns":63000000,"apply_latency_ns":63000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":129695932,"num_objects":69,"num_object_clones":0,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":20,"num_read":969,"num_read_kb":885142,"num_write":680,"num_write_kb":732320,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":190,"num_flush_kb":536680,"num_evict":185,"num_evict_kb":523403,"num_promote":106,"num_flush_mode_high":-1,"num_flush_mode_low":-2,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.001861"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299131+0000","last_change":"2020-11-11T11:33:55.298303+0000","last_active":"2020-11-11T11:36:27.299131+0000","last_peered":"2020-11-11T11:36:27.299131+0000","last_clean":"2020-11-11T11:36:27.299131+0000","last_became_active":"2020-11-11T11:33:55.297900+0000","last_became_peered":"2020-11-11T11:33:55.297900+0000","last_unstale":"2020-11-11T11:36:27.299131+0000","last_undegraded":"2020-11-11T11:36:27.299131+0000","last_fullsized":"2020-11-11T11:36:27.299131+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.299064+0000","last_change":"2020-11-11T11:33:55.297213+0000","last_active":"2020-11-11T11:36:27.299064+0000","last_peered":"2020-11-11T11:36:27.299064+0000","last_clean":"2020-11-11T11:36:27.299064+0000","last_became_active":"2020-11-11T11:33:55.296820+0000","last_became_peered":"2020-11-11T11:33:55.296820+0000","last_unstale":"2020-11-11T11:36:27.299064+0000","last_undegraded":"2020-11-11T11:36:27.299064+0000","last_fullsized":"2020-11-11T11:36:27.299064+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"33'5712","reported_seq":"7828","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:08.914023+0000","last_change":"2020-11-11T11:34:05.323073+0000","last_active":"2020-11-11T11:37:08.914023+0000","last_peered":"2020-11-11T11:37:08.914023+0000","last_clean":"2020-11-11T11:37:08.914023+0000","last_became_active":"2020-11-11T11:34:05.322621+0000","last_became_peered":"2020-11-11T11:34:05.322621+0000","last_unstale":"2020-11-11T11:37:08.914023+0000","last_undegraded":"2020-11-11T11:37:08.914023+0000","last_fullsized":"2020-11-11T11:37:08.914023+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":5712,"ondisk_log_size":5712,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":131262718,"num_objects":55,"num_object_clones":0,"num_object_copies":110,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":49,"num_whiteouts":4,"num_read":1955,"num_read_kb":1009,"num_write":5267,"num_write_kb":1221161,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3220,"num_flush":942,"num_flush_kb":2741719,"num_evict":930,"num_evict_kb":2709068,"num_promote":1046,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"33'6416","reported_seq":"8594","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.078180+0000","last_change":"2020-11-11T11:34:03.510085+0000","last_active":"2020-11-11T11:37:09.078180+0000","last_peered":"2020-11-11T11:37:09.078180+0000","last_clean":"2020-11-11T11:37:09.078180+0000","last_became_active":"2020-11-11T11:34:03.509692+0000","last_became_peered":"2020-11-11T11:34:03.509692+0000","last_unstale":"2020-11-11T11:37:09.078180+0000","last_undegraded":"2020-11-11T11:37:09.078180+0000","last_fullsized":"2020-11-11T11:37:09.078180+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6416,"ondisk_log_size":6416,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7434711774,"num_objects":2497,"num_object_clones":0,"num_object_copies":4994,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2497,"num_whiteouts":0,"num_read":3676,"num_read_kb":270958,"num_write":7905,"num_write_kb":5015283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.266156+0000","last_change":"2020-11-11T11:33:55.297499+0000","last_active":"2020-11-11T11:36:27.266156+0000","last_peered":"2020-11-11T11:36:27.266156+0000","last_clean":"2020-11-11T11:36:27.266156+0000","last_became_active":"2020-11-11T11:33:55.297140+0000","last_became_peered":"2020-11-11T11:33:55.297140+0000","last_unstale":"2020-11-11T11:36:27.266156+0000","last_undegraded":"2020-11-11T11:36:27.266156+0000","last_fullsized":"2020-11-11T11:36:27.266156+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"33'6089","reported_seq":"8458","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.049913+0000","last_change":"2020-11-11T11:34:05.322959+0000","last_active":"2020-11-11T11:37:09.049913+0000","last_peered":"2020-11-11T11:37:09.049913+0000","last_clean":"2020-11-11T11:37:09.049913+0000","last_became_active":"2020-11-11T11:34:05.322654+0000","last_became_peered":"2020-11-11T11:34:05.322654+0000","last_unstale":"2020-11-11T11:37:09.049913+0000","last_undegraded":"2020-11-11T11:37:09.049913+0000","last_fullsized":"2020-11-11T11:37:09.049913+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6089,"ondisk_log_size":6089,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":139000723,"num_objects":59,"num_object_clones":0,"num_object_copies":118,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":51,"num_whiteouts":5,"num_read":2148,"num_read_kb":1095,"num_write":5674,"num_write_kb":1313437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4131,"num_flush":1016,"num_flush_kb":2953260,"num_evict":963,"num_evict_kb":2804405,"num_promote":1123,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"34'6186","reported_seq":"8265","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.261692+0000","last_change":"2020-11-11T11:34:03.316511+0000","last_active":"2020-11-11T11:37:09.261692+0000","last_peered":"2020-11-11T11:37:09.261692+0000","last_clean":"2020-11-11T11:37:09.261692+0000","last_became_active":"2020-11-11T11:34:03.316160+0000","last_became_peered":"2020-11-11T11:34:03.316160+0000","last_unstale":"2020-11-11T11:37:09.261692+0000","last_undegraded":"2020-11-11T11:37:09.261692+0000","last_fullsized":"2020-11-11T11:37:09.261692+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6186,"ondisk_log_size":6186,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7094247063,"num_objects":2370,"num_object_clones":0,"num_object_copies":4740,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2370,"num_whiteouts":0,"num_read":3520,"num_read_kb":223127,"num_write":7630,"num_write_kb":4744123,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"27","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.298926+0000","last_change":"2020-11-11T11:33:55.445425+0000","last_active":"2020-11-11T11:36:27.298926+0000","last_peered":"2020-11-11T11:36:27.298926+0000","last_clean":"2020-11-11T11:36:27.298926+0000","last_became_active":"2020-11-11T11:33:55.445019+0000","last_became_peered":"2020-11-11T11:33:55.445019+0000","last_unstale":"2020-11-11T11:36:27.298926+0000","last_undegraded":"2020-11-11T11:36:27.298926+0000","last_fullsized":"2020-11-11T11:36:27.298926+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"33'6036","reported_seq":"8469","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.044767+0000","last_change":"2020-11-11T11:34:05.324511+0000","last_active":"2020-11-11T11:37:09.044767+0000","last_peered":"2020-11-11T11:37:09.044767+0000","last_clean":"2020-11-11T11:37:09.044767+0000","last_became_active":"2020-11-11T11:34:05.324114+0000","last_became_peered":"2020-11-11T11:34:05.324114+0000","last_unstale":"2020-11-11T11:37:09.044767+0000","last_undegraded":"2020-11-11T11:37:09.044767+0000","last_fullsized":"2020-11-11T11:37:09.044767+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6036,"ondisk_log_size":6036,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":160157981,"num_objects":63,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":55,"num_whiteouts":2,"num_read":2110,"num_read_kb":5502,"num_write":5615,"num_write_kb":1318824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":4257,"num_flush":996,"num_flush_kb":2938400,"num_evict":957,"num_evict_kb":2819675,"num_promote":1114,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"33'6646","reported_seq":"8851","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.094259+0000","last_change":"2020-11-11T11:34:03.509638+0000","last_active":"2020-11-11T11:37:09.094259+0000","last_peered":"2020-11-11T11:37:09.094259+0000","last_clean":"2020-11-11T11:37:09.094259+0000","last_became_active":"2020-11-11T11:34:03.509302+0000","last_became_peered":"2020-11-11T11:34:03.509302+0000","last_unstale":"2020-11-11T11:37:09.094259+0000","last_undegraded":"2020-11-11T11:37:09.094259+0000","last_fullsized":"2020-11-11T11:37:09.094259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6646,"ondisk_log_size":6646,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7593258884,"num_objects":2541,"num_object_clones":0,"num_object_copies":5082,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2541,"num_whiteouts":0,"num_read":3725,"num_read_kb":203935,"num_write":8201,"num_write_kb":5082734,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252073+0000","last_change":"2020-11-11T11:33:55.292355+0000","last_active":"2020-11-11T11:36:27.252073+0000","last_peered":"2020-11-11T11:36:27.252073+0000","last_clean":"2020-11-11T11:36:27.252073+0000","last_became_active":"2020-11-11T11:33:55.291925+0000","last_became_peered":"2020-11-11T11:33:55.291925+0000","last_unstale":"2020-11-11T11:36:27.252073+0000","last_undegraded":"2020-11-11T11:36:27.252073+0000","last_fullsized":"2020-11-11T11:36:27.252073+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"33'6039","reported_seq":"8343","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:37:09.120072+0000","last_change":"2020-11-11T11:34:05.324785+0000","last_active":"2020-11-11T11:37:09.120072+0000","last_peered":"2020-11-11T11:37:09.120072+0000","last_clean":"2020-11-11T11:37:09.120072+0000","last_became_active":"2020-11-11T11:34:05.324308+0000","last_became_peered":"2020-11-11T11:34:05.324308+0000","last_unstale":"2020-11-11T11:37:09.120072+0000","last_undegraded":"2020-11-11T11:37:09.120072+0000","last_fullsized":"2020-11-11T11:37:09.120072+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:04.310389+0000","last_clean_scrub_stamp":"2020-11-11T11:34:04.310389+0000","log_size":6039,"ondisk_log_size":6039,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":133984890,"num_objects":60,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":54,"num_whiteouts":10,"num_read":2090,"num_read_kb":1056,"num_write":5525,"num_write_kb":1309647,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3308,"num_flush":997,"num_flush_kb":2916195,"num_evict":957,"num_evict_kb":2794979,"num_promote":1112,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"34'6327","reported_seq":"8455","reported_epoch":"34","state":"active+clean","last_fresh":"2020-11-11T11:37:09.730331+0000","last_change":"2020-11-11T11:34:03.510171+0000","last_active":"2020-11-11T11:37:09.730331+0000","last_peered":"2020-11-11T11:37:09.730331+0000","last_clean":"2020-11-11T11:37:09.730331+0000","last_became_active":"2020-11-11T11:34:03.509674+0000","last_became_peered":"2020-11-11T11:34:03.509674+0000","last_unstale":"2020-11-11T11:37:09.730331+0000","last_undegraded":"2020-11-11T11:37:09.730331+0000","last_fullsized":"2020-11-11T11:37:09.730331+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:34:02.304716+0000","last_clean_scrub_stamp":"2020-11-11T11:34:02.304716+0000","log_size":6327,"ondisk_log_size":6327,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7359459648,"num_objects":2449,"num_object_clones":0,"num_object_copies":4898,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2449,"num_whiteouts":0,"num_read":3562,"num_read_kb":224207,"num_write":7796,"num_write_kb":4983788,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252806+0000","last_change":"2020-11-11T11:33:55.296400+0000","last_active":"2020-11-11T11:36:27.252806+0000","last_peered":"2020-11-11T11:36:27.252806+0000","last_clean":"2020-11-11T11:36:27.252806+0000","last_became_active":"2020-11-11T11:33:55.295959+0000","last_became_peered":"2020-11-11T11:33:55.295959+0000","last_unstale":"2020-11-11T11:36:27.252806+0000","last_undegraded":"2020-11-11T11:36:27.252806+0000","last_fullsized":"2020-11-11T11:36:27.252806+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.252950+0000","last_change":"2020-11-11T11:33:55.295974+0000","last_active":"2020-11-11T11:36:27.252950+0000","last_peered":"2020-11-11T11:36:27.252950+0000","last_clean":"2020-11-11T11:36:27.252950+0000","last_became_active":"2020-11-11T11:33:55.295694+0000","last_became_peered":"2020-11-11T11:33:55.295694+0000","last_unstale":"2020-11-11T11:36:27.252950+0000","last_undegraded":"2020-11-11T11:36:27.252950+0000","last_fullsized":"2020-11-11T11:36:27.252950+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"33","state":"active+clean","last_fresh":"2020-11-11T11:36:27.263804+0000","last_change":"2020-11-11T11:33:55.298570+0000","last_active":"2020-11-11T11:36:27.263804+0000","last_peered":"2020-11-11T11:36:27.263804+0000","last_clean":"2020-11-11T11:36:27.263804+0000","last_became_active":"2020-11-11T11:33:55.297639+0000","last_became_peered":"2020-11-11T11:33:55.297639+0000","last_unstale":"2020-11-11T11:36:27.263804+0000","last_undegraded":"2020-11-11T11:36:27.263804+0000","last_fullsized":"2020-11-11T11:36:27.263804+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-11T11:33:54.281140+0000","last_clean_scrub_stamp":"2020-11-11T11:33:54.281140+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":564406312,"num_objects":237,"num_object_clones":0,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":209,"num_whiteouts":21,"num_read":8303,"num_read_kb":8662,"num_write":22081,"num_write_kb":5163069,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":28,"num_bytes_hit_set_archive":14916,"num_flush":3951,"num_flush_kb":11549574,"num_evict":3807,"num_evict_kb":11128127,"num_promote":4395,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":614572032,"data_stored":683214002,"data_compressed":1560388,"data_compressed_allocated":71761920,"data_compressed_original":143520916,"omap_allocated":0,"internal_metadata":0},"log_size":23876,"ondisk_log_size":23876,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29481677369,"num_objects":9857,"num_object_clones":0,"num_object_copies":19714,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9857,"num_whiteouts":0,"num_read":14483,"num_read_kb":922227,"num_write":31532,"num_write_kb":19825928,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":33329258496,"data_stored":39597163740,"data_compressed":139738408,"data_compressed_allocated":6405529600,"data_compressed_original":12811059200,"omap_allocated":0,"internal_metadata":0},"log_size":25575,"ondisk_log_size":25575,"up":8,"acting":8,"num_store_stats":6}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8431452,"kb_used_data":8346688,"kb_used_omap":0,"kb_used_meta":79296,"kb_avail":85940388,"statfs":{"total":96636764160,"available":88002957312,"internally_reserved":0,"allocated":8547008512,"data_stored":10145473187,"data_compressed":35725911,"data_compressed_allocated":1633755136,"data_compressed_original":3267510272,"omap_allocated":0,"internal_metadata":81199104},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":0.90800000000000003,"15min":0.77900000000000003},"min":{"1min":0.501,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":11.843,"5min":11.843,"15min":11.843},"last":0.66300000000000003},{"interface":"front","average":{"1min":2.1000000000000001,"5min":1,"15min":0.83199999999999996},"min":{"1min":0.53600000000000003,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":10.003,"5min":10.003,"15min":10.003},"last":0.79700000000000004}]},{"osd":1,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.262,"5min":0.92200000000000004,"15min":0.89000000000000001},"min":{"1min":0.58799999999999997,"5min":0.501,"15min":0.501},"max":{"1min":3.472,"5min":3.472,"15min":3.472},"last":1.137},{"interface":"front","average":{"1min":1.3580000000000001,"5min":0.98299999999999998,"15min":0.92700000000000005},"min":{"1min":0.69699999999999995,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":3.5550000000000002,"5min":3.5550000000000002,"15min":3.5550000000000002},"last":0.90500000000000003}]},{"osd":2,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0499999999999998,"5min":1.089,"15min":0.94799999999999995},"min":{"1min":0.58999999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":13.795,"5min":13.795,"15min":13.795},"last":1.0449999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":1.165,"15min":0.95699999999999996},"min":{"1min":0.65900000000000003,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":12.250999999999999,"5min":12.250999999999999,"15min":12.250999999999999},"last":0.94699999999999995}]},{"osd":3,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.90800000000000003,"15min":0.84399999999999997},"min":{"1min":0.68400000000000005,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":3.931,"5min":3.931,"15min":3.931},"last":1.2669999999999999},{"interface":"front","average":{"1min":1.5209999999999999,"5min":1.0860000000000001,"15min":1.05},"min":{"1min":0.91500000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":3.593,"5min":4.6340000000000003,"15min":4.6340000000000003},"last":1.1910000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:54 2020","interfaces":[{"interface":"back","average":{"1min":1.9850000000000001,"5min":1.1080000000000001,"15min":0.96599999999999997},"min":{"1min":0.75700000000000001,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":5.782,"5min":5.782,"15min":5.782},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.466,"5min":1.079,"15min":1.0169999999999999},"min":{"1min":0.86199999999999999,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.8780000000000001,"5min":2.8780000000000001,"15min":2.8780000000000001},"last":1.345}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4256332,"kb_used_data":4193204,"kb_used_omap":0,"kb_used_meta":50368,"kb_avail":90115508,"statfs":{"total":96636764160,"available":92278280192,"internally_reserved":0,"allocated":4293840896,"data_stored":5108468818,"data_compressed":18037185,"data_compressed_allocated":832438272,"data_compressed_original":1664876544,"omap_allocated":0,"internal_metadata":51576832},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.147,"5min":0.80800000000000005,"15min":0.77000000000000002},"min":{"1min":0.498,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":3.4140000000000001,"5min":3.4140000000000001,"15min":3.4140000000000001},"last":0.88500000000000001},{"interface":"front","average":{"1min":0.995,"5min":0.96199999999999997,"15min":0.98999999999999999},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":0.74299999999999999}]},{"osd":1,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.212,"5min":0.86499999999999999,"15min":0.80500000000000005},"min":{"1min":0.501,"5min":0.496,"15min":0.496},"max":{"1min":3.286,"5min":3.286,"15min":3.286},"last":0.624},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.88800000000000001,"15min":0.91600000000000004},"min":{"1min":0.45200000000000001,"5min":0.45200000000000001,"15min":0.45200000000000001},"max":{"1min":2.2170000000000001,"5min":2.2799999999999998,"15min":2.2799999999999998},"last":0.59299999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.21,"5min":0.96099999999999997,"15min":0.93700000000000006},"min":{"1min":0.60299999999999998,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":3.6560000000000001,"5min":3.6560000000000001,"15min":3.6560000000000001},"last":0.57699999999999996},{"interface":"front","average":{"1min":1.5549999999999999,"5min":1.0800000000000001,"15min":1.01},"min":{"1min":0.79000000000000004,"5min":0.65900000000000003,"15min":0.65900000000000003},"max":{"1min":3.669,"5min":3.669,"15min":3.669},"last":0.76300000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.4590000000000001,"5min":1.0880000000000001,"15min":1.046},"min":{"1min":0.57999999999999996,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":6.6719999999999997,"5min":6.6719999999999997,"15min":6.6719999999999997},"last":0.68600000000000005},{"interface":"front","average":{"1min":1.5289999999999999,"5min":1.129,"15min":1.046},"min":{"1min":0.621,"5min":0.621,"15min":0.621},"max":{"1min":3.5419999999999998,"5min":3.5419999999999998,"15min":3.5419999999999998},"last":1}]},{"osd":5,"last update":"Wed Nov 11 11:36:57 2020","interfaces":[{"interface":"back","average":{"1min":1.278,"5min":1.107,"15min":1.0740000000000001},"min":{"1min":0.67500000000000004,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":3.7309999999999999,"5min":3.7309999999999999,"15min":3.7309999999999999},"last":0.80300000000000005},{"interface":"front","average":{"1min":1.2,"5min":1.175,"15min":1.1950000000000001},"min":{"1min":0.76600000000000001,"5min":0.75,"15min":0.75},"max":{"1min":2.21,"5min":2.6629999999999998,"15min":2.6629999999999998},"last":0.84799999999999998}]}]},{"osd":3,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4317320,"kb_used_data":4257324,"kb_used_omap":0,"kb_used_meta":55360,"kb_avail":90054520,"statfs":{"total":96636764160,"available":92215828480,"internally_reserved":0,"allocated":4359499776,"data_stored":5157359284,"data_compressed":17759060,"data_compressed_allocated":816373760,"data_compressed_original":1632746058,"omap_allocated":0,"internal_metadata":56688640},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":11,"apply_latency_ms":11,"commit_latency_ns":11000000,"apply_latency_ns":11000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1020000000000001,"5min":0.81100000000000005,"15min":0.77600000000000002},"min":{"1min":0.47999999999999998,"5min":0.34799999999999998,"15min":0.34799999999999998},"max":{"1min":3.4380000000000002,"5min":3.4380000000000002,"15min":3.4380000000000002},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.502,"5min":0.91300000000000003,"15min":0.84499999999999997},"min":{"1min":0.50800000000000001,"5min":0.46000000000000002,"15min":0.46000000000000002},"max":{"1min":4.0300000000000002,"5min":4.0300000000000002,"15min":4.0300000000000002},"last":0.85399999999999998}]},{"osd":1,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4319999999999999,"5min":0.96199999999999997,"15min":0.91200000000000003},"min":{"1min":0.60499999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":4.1660000000000004,"5min":4.1660000000000004,"15min":4.1660000000000004},"last":0.92200000000000004},{"interface":"front","average":{"1min":1.411,"5min":0.91700000000000004,"15min":0.84599999999999997},"min":{"1min":0.53000000000000003,"5min":0.497,"15min":0.497},"max":{"1min":5.3410000000000002,"5min":5.3410000000000002,"15min":5.3410000000000002},"last":0.83899999999999997}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":2,"5min":1.1339999999999999,"15min":1.0069999999999999},"min":{"1min":0.83799999999999997,"5min":0.622,"15min":0.622},"max":{"1min":5.6959999999999997,"5min":5.6959999999999997,"15min":5.6959999999999997},"last":0.98399999999999999},{"interface":"front","average":{"1min":1.756,"5min":1.155,"15min":1.0489999999999999},"min":{"1min":0.72099999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.7249999999999996,"5min":5.7249999999999996,"15min":5.7249999999999996},"last":0.76600000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.1859999999999999,"5min":0.90000000000000002,"15min":0.84499999999999997},"min":{"1min":0.61299999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":5.2830000000000004,"5min":5.2830000000000004,"15min":5.2830000000000004},"last":0.59099999999999997},{"interface":"front","average":{"1min":1.4970000000000001,"5min":1.046,"15min":0.96299999999999997},"min":{"1min":0.72199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"max":{"1min":5.6479999999999997,"5min":5.6479999999999997,"15min":5.6479999999999997},"last":0.65100000000000002}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.2849999999999999,"5min":1.04,"15min":0.996},"min":{"1min":0.70199999999999996,"5min":0.60899999999999999,"15min":0.60899999999999999},"max":{"1min":5.1550000000000002,"5min":5.1550000000000002,"15min":5.1550000000000002},"last":0.68000000000000005},{"interface":"front","average":{"1min":1.98,"5min":1.2450000000000001,"15min":1.121},"min":{"1min":0.80400000000000005,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":8.0449999999999999,"5min":8.0449999999999999,"15min":8.0449999999999999},"last":0.63}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":8396280,"kb_used_data":8273124,"kb_used_omap":0,"kb_used_meta":119744,"kb_avail":85975560,"statfs":{"total":96636764160,"available":88038973440,"internally_reserved":0,"allocated":8471678976,"data_stored":10046274809,"data_compressed":35292339,"data_compressed_allocated":1610055680,"data_compressed_original":3220109898,"omap_allocated":0,"internal_metadata":122617856},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":0.66100000000000003,"15min":0.60899999999999999},"min":{"1min":0.40300000000000002,"5min":0.40300000000000002,"15min":0.40300000000000002},"max":{"1min":5.0819999999999999,"5min":5.0819999999999999,"15min":5.0819999999999999},"last":0.67100000000000004},{"interface":"front","average":{"1min":0.94999999999999996,"5min":0.76900000000000002,"15min":0.74199999999999999},"min":{"1min":0.53800000000000003,"5min":0.438,"15min":0.438},"max":{"1min":2.165,"5min":2.165,"15min":2.165},"last":0.64800000000000002}]},{"osd":1,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":0.89600000000000002,"5min":0.78300000000000003,"15min":0.76700000000000002},"min":{"1min":0.501,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.532,"5min":1.9510000000000001,"15min":1.9510000000000001},"last":0.82299999999999995},{"interface":"front","average":{"1min":0.84099999999999997,"5min":0.72199999999999998,"15min":0.71199999999999997},"min":{"1min":0.56200000000000006,"5min":0.47699999999999998,"15min":0.47699999999999998},"max":{"1min":1.409,"5min":1.409,"15min":1.409},"last":0.71899999999999997}]},{"osd":3,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.381,"5min":1.01,"15min":0.98399999999999999},"min":{"1min":0.61299999999999999,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":5.2400000000000002,"5min":5.2400000000000002,"15min":5.2400000000000002},"last":0.85499999999999998},{"interface":"front","average":{"1min":1.157,"5min":0.99399999999999999,"15min":0.96599999999999997},"min":{"1min":0.64200000000000002,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.909,"5min":1.909,"15min":1.909},"last":1.2010000000000001}]},{"osd":4,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.026,"5min":0.93899999999999995,"15min":0.93400000000000005},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.605,"5min":1.605,"15min":1.605},"last":0.873},{"interface":"front","average":{"1min":1.6699999999999999,"5min":1.204,"15min":1.1599999999999999},"min":{"1min":0.72099999999999997,"5min":0.60499999999999998,"15min":0.60499999999999998},"max":{"1min":5.4610000000000003,"5min":5.4610000000000003,"15min":5.4610000000000003},"last":0.93100000000000005}]},{"osd":5,"last update":"Wed Nov 11 11:37:00 2020","interfaces":[{"interface":"back","average":{"1min":1.345,"5min":1.1299999999999999,"15min":1.095},"min":{"1min":0.88700000000000001,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":2.7639999999999998,"5min":2.7639999999999998,"15min":2.7639999999999998},"last":1.075},{"interface":"front","average":{"1min":1.1559999999999999,"5min":1.196,"15min":1.246},"min":{"1min":0.78300000000000003,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":1.802,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":0.95599999999999996}]}]},{"osd":0,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4259944,"kb_used_data":4182480,"kb_used_omap":0,"kb_used_meta":45248,"kb_avail":90111896,"statfs":{"total":96636764160,"available":92274581504,"internally_reserved":0,"allocated":4282859520,"data_stored":5088091812,"data_compressed":17844366,"data_compressed_allocated":823123968,"data_compressed_original":1646247936,"omap_allocated":0,"internal_metadata":46333952},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":0.66900000000000004,"15min":0.60499999999999998},"min":{"1min":0.39500000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":1.9970000000000001},"last":0.57899999999999996},{"interface":"front","average":{"1min":0.99299999999999999,"5min":0.81599999999999995,"15min":0.77600000000000002},"min":{"1min":0.50900000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":4.0330000000000004,"5min":4.0330000000000004,"15min":4.0330000000000004},"last":0.69299999999999995}]},{"osd":2,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":0.78400000000000003,"15min":0.746},"min":{"1min":0.53500000000000003,"5min":0.46200000000000002,"15min":0.46200000000000002},"max":{"1min":1.962,"5min":1.962,"15min":1.962},"last":0.498},{"interface":"front","average":{"1min":1.359,"5min":0.81100000000000005,"15min":0.70399999999999996},"min":{"1min":0.54400000000000004,"5min":0.46700000000000003,"15min":0.46700000000000003},"max":{"1min":4.2969999999999997,"5min":4.2969999999999997,"15min":4.2969999999999997},"last":0.51600000000000001}]},{"osd":3,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":3.1960000000000002,"5min":1.304,"15min":0.995},"min":{"1min":0.57999999999999996,"5min":0.501,"15min":0.501},"max":{"1min":37.673000000000002,"5min":37.673000000000002,"15min":37.673000000000002},"last":0.97799999999999998},{"interface":"front","average":{"1min":3.5139999999999998,"5min":1.4430000000000001,"15min":1.1100000000000001},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":37.646000000000001,"5min":37.646000000000001,"15min":37.646000000000001},"last":0.83999999999999997}]},{"osd":4,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":0.89600000000000002,"15min":0.88200000000000001},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":4.3949999999999996,"5min":4.3949999999999996,"15min":4.3949999999999996},"last":0.80500000000000005},{"interface":"front","average":{"1min":1.4299999999999999,"5min":1.0369999999999999,"15min":0.97399999999999998},"min":{"1min":0.82199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":2.3370000000000002,"5min":2.3370000000000002,"15min":2.3370000000000002},"last":0.72399999999999998}]},{"osd":5,"last update":"Wed Nov 11 11:36:52 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.145,"15min":1.046},"min":{"1min":0.76600000000000001,"5min":0.745,"15min":0.745},"max":{"1min":6.0220000000000002,"5min":6.0220000000000002,"15min":6.0220000000000002},"last":0.85599999999999998},{"interface":"front","average":{"1min":1.4950000000000001,"5min":1.0660000000000001,"15min":1.012},"min":{"1min":0.82599999999999996,"5min":0.72199999999999998,"15min":0.72199999999999998},"max":{"1min":4.4720000000000004,"5min":4.4720000000000004,"15min":4.4720000000000004},"last":0.93400000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3933284,"kb_used_data":3897052,"kb_used_omap":0,"kb_used_meta":36224,"kb_avail":90438556,"statfs":{"total":96636764160,"available":92609081344,"internally_reserved":0,"allocated":3990581248,"data_stored":4734835796,"data_compressed":16640021,"data_compressed_allocated":761360384,"data_compressed_original":1522720768,"omap_allocated":0,"internal_metadata":37093376},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":15,"apply_latency_ms":15,"commit_latency_ns":15000000,"apply_latency_ns":15000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.181,"5min":0.73199999999999998,"15min":0.67800000000000005},"min":{"1min":0.46999999999999997,"5min":0.41599999999999998,"15min":0.41599999999999998},"max":{"1min":5.3280000000000003,"5min":5.3280000000000003,"15min":5.3280000000000003},"last":0.63600000000000001},{"interface":"front","average":{"1min":1.216,"5min":0.86499999999999999,"15min":0.81499999999999995},"min":{"1min":0.45500000000000002,"5min":0.41999999999999998,"15min":0.41999999999999998},"max":{"1min":5.3659999999999997,"5min":5.3659999999999997,"15min":5.3659999999999997},"last":0.85599999999999998}]},{"osd":2,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.383,"5min":0.77700000000000002,"15min":0.67200000000000004},"min":{"1min":0.50900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":0.75900000000000001},{"interface":"front","average":{"1min":0.97899999999999998,"5min":0.78600000000000003,"15min":0.754},"min":{"1min":0.432,"5min":0.432,"15min":0.432},"max":{"1min":2.2330000000000001,"5min":2.2330000000000001,"15min":2.2330000000000001},"last":0.83199999999999996}]},{"osd":3,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.171,"5min":0.94999999999999996,"15min":0.93500000000000005},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.3849999999999998,"5min":3.3849999999999998,"15min":3.3849999999999998},"last":1.151},{"interface":"front","average":{"1min":1.516,"5min":1.034,"15min":0.97199999999999998},"min":{"1min":0.66300000000000003,"5min":0.51700000000000002,"15min":0.51700000000000002},"max":{"1min":3.7989999999999999,"5min":3.7989999999999999,"15min":3.7989999999999999},"last":0.92500000000000004}]},{"osd":4,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.5,"5min":1.0800000000000001,"15min":1.0409999999999999},"min":{"1min":0.58699999999999997,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":4.0949999999999998,"5min":4.0949999999999998,"15min":4.0949999999999998},"last":0.96499999999999997},{"interface":"front","average":{"1min":1.4279999999999999,"5min":1.034,"15min":0.97599999999999998},"min":{"1min":0.69699999999999995,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":3.1509999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.89100000000000001}]},{"osd":5,"last update":"Wed Nov 11 11:36:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4910000000000001,"5min":1.107,"15min":1.052},"min":{"1min":0.78300000000000003,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":1.0369999999999999},{"interface":"front","average":{"1min":1.546,"5min":1.2030000000000001,"15min":1.1599999999999999},"min":{"1min":0.83799999999999997,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":3.399,"5min":3.399,"15min":3.399},"last":1.1830000000000001}]}]}]}}
, 2020-11-11T11:37:16.959 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)
, 2020-11-11T11:37:16.960 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-11T11:33:54.281140+0000 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=33, tm_sec=54, tm_wday=2, tm_yday=316, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=11, tm_hour=11, tm_min=37, tm_sec=12, tm_wday=2, tm_yday=316, tm_isdst=0)

2020-11-11T18:32:51.556 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:38:59.334 DEBUG:tasks.ceph.osd.4:waiting for process to exit
, 2020-11-11T11:38:59.334 INFO:teuthology.orchestra.run:waiting for 300
, 2020-11-11T11:38:59.377 INFO:tasks.ceph.osd.4:Stopped

2020-11-11T18:32:51.556 WARNING:scrape:Ignoring malparsed backtrace: 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-11-11T11:43:45.974 INFO:teuthology.orchestra.run.smithi082.stdout:===============================================================================
, 2020-11-11T11:43:45.975 INFO:teuthology.orchestra.run.smithi082.stdout:^+ hv01.front.sepia.ceph.com     3   6   377    39  -2866us[-2875us] +/-  142ms

2020-11-11T18:32:51.557 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/remote.py", line 215, in run
,     r = self._runner(client=self.ssh, name=self.shortname, **kwargs)
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 446, in run

2020-11-11T18:32:52.187 INFO:scrape:Found 6 distinct failure reasons
2020-11-11T18:32:52.189 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds
2020-11-11T18:32:52.189 INFO:scrape:3 jobs: ['5607913', '5608097', '5608186']
2020-11-11T18:32:52.189 INFO:scrape:suites intersection: ['3-start-upgrade', '4-wait', 'fixed-2', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start']
2020-11-11T18:32:52.190 INFO:scrape:suites union: ['2-repo_digest/defaut', '2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{rhel_8.0}', 'distro$/{rhel_latest}', 'fixed-2', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start']
2020-11-11T18:32:52.190 INFO:scrape:
2020-11-11T18:32:52.190 INFO:scrape:Failure: Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)
2020-11-11T18:32:52.191 INFO:scrape:18 jobs: ['5608180', '5607896', '5608120', '5608160', '5607916', '5607937', '5608017', '5607975', '5608038', '5608057', '5607835', '5608100', '5608079', '5608139', '5607954', '5607999', '5607852', '5607876']
2020-11-11T18:32:52.191 INFO:scrape:suites intersection: ['debug/mgr', 'rados/dashboard/{clusters/{2-node-mgr}', 'tasks/dashboard}']
2020-11-11T18:32:52.191 INFO:scrape:suites union: ['debug/mgr', 'mon_election/classic', 'mon_election/connectivity', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'rados/dashboard/{clusters/{2-node-mgr}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'tasks/dashboard}']
2020-11-11T18:32:52.192 INFO:scrape:
2020-11-11T18:32:52.192 INFO:scrape:Failure: Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi067 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'
2020-11-11T18:32:52.192 INFO:scrape:2 jobs: ['5607863', '5608045']
2020-11-11T18:32:52.193 INFO:scrape:suites intersection: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}']
2020-11-11T18:32:52.193 INFO:scrape:suites union: ['rados/cephadm/dashboard/{distro/centos_latest', 'task/test_e2e}']
2020-11-11T18:32:52.193 INFO:scrape:
2020-11-11T18:32:52.193 INFO:scrape:Timeout 3h running clone.client.0/qa/workunits/mon/caps.sh
2020-11-11T18:32:52.194 INFO:scrape:2 jobs: ['5607967', '5608187']
2020-11-11T18:32:52.194 INFO:scrape:suites intersection: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'workloads/rados_mon_workunits}']
2020-11-11T18:32:52.194 INFO:scrape:suites union: ['clusters/3-mons', 'mon_election/classic', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_8}', 'thrashers/force-sync-many', 'thrashers/sync', 'workloads/rados_mon_workunits}']
2020-11-11T18:32:52.195 INFO:scrape:
2020-11-11T18:32:52.195 INFO:scrape:Failure: Command failed (workunit test cls/test_cls_lock.sh) on smithi158 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh'
2020-11-11T18:32:52.195 INFO:scrape:1 jobs: ['5608052']
2020-11-11T18:32:52.196 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v1only', 'objectstore/bluestore-comp-lz4', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_cls_all', 'thrashosds-health}', 'validater/lockdep}']
2020-11-11T18:32:52.196 INFO:scrape:
2020-11-11T18:32:52.196 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base'
2020-11-11T18:32:52.196 INFO:scrape:1 jobs: ['5607912']
2020-11-11T18:32:52.197 INFO:scrape:suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{centos_8}}']
2020-11-11T18:32:52.197 INFO:scrape:
2020-11-11T18:32:52.211 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/
failed:  27
dead:    0
running: 0
waiting: 0
queued:  0
passed:  340


Fail
=================================================================
[5607835]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:24:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607835/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607835/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ea334b7baa574740be46cfe597231925

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607852]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:25:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607852/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607852/
sentry: https://sentry.ceph.com/organizations/ceph/?query=7d1627e0e6a54c129805f9a09c3c4715

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607863]  rados/cephadm/dashboard/{distro/centos_latest task/test_e2e}
-----------------------------------------------------------------
time:   00:25:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607863/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607863/
sentry: https://sentry.ceph.com/organizations/ceph/?query=01405a8217724b7eaea74bca3c27dbae

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi067
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[5607876]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:21:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607876/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607876/
sentry: https://sentry.ceph.com/organizations/ceph/?query=3b00b6859ea44bed8d81b76d3e1d5a84

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607896]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/dashboard}
-----------------------------------------------------------------
time:   00:19:19
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607896/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607896/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aacbab68c73e4562bf0e8035e926b9b9

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607912]  rados/singleton/{all/thrash_cache_writeback_proxy_none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8}}
-----------------------------------------------------------------
time:   00:16:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607912/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607912/

    Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000
    --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000
    --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op
    delete 50 --op copy_from 50 --op write_excl 50 --pool base'

[5607913]  rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity}
-----------------------------------------------------------------
time:   00:19:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607913/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607913/
sentry: https://sentry.ceph.com/organizations/ceph/?query=5e281b78b9d84c12b2ad509c48131f27

    reached maximum tries (180) after waiting for 180 seconds

[5607916]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:20:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607916/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607916/
sentry: https://sentry.ceph.com/organizations/ceph/?query=b66b271cd640450791ea20931dd75372

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607937]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zstd supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:20:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607937/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607937/
sentry: https://sentry.ceph.com/organizations/ceph/?query=47f3b89122dc4af2997c40d3700eab5a

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607954]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/dashboard}
-----------------------------------------------------------------
time:   00:19:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607954/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607954/
sentry: https://sentry.ceph.com/organizations/ceph/?query=49d2c61a2e564b4db683e81f2f37ba60

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607967]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8} thrashers/sync workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   03:14:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607967/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607967/
sentry: https://sentry.ceph.com/organizations/ceph/?query=77680c27dfa54952a3d4f424264aec1c

    Command failed (workunit test mon/caps.sh) on smithi007 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'

[5607975]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/dashboard}
-----------------------------------------------------------------
time:   00:19:23
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607975/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607975/
sentry: https://sentry.ceph.com/organizations/ceph/?query=391228c8e77c469b9be026f4392494f5

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5607999]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-stupid supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:20:48
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607999/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607999/
sentry: https://sentry.ceph.com/organizations/ceph/?query=aee8a872f3a54ca7a74a67d2c2dde8b0

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608017]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard}
-----------------------------------------------------------------
time:   00:19:16
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608017/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608017/
sentry: https://sentry.ceph.com/organizations/ceph/?query=1c01b98383e242dd96d183f50593c833

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608038]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-bitmap supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:21:03
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608038/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608038/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4cb8e5d6b33248b6ad89ec3c6ed9750e

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608045]  rados/cephadm/dashboard/{distro/centos_latest task/test_e2e}
-----------------------------------------------------------------
time:   00:24:45
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608045/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608045/
sentry: https://sentry.ceph.com/organizations/ceph/?query=bc7a67248a2c46b99e66196dfd7b199c

    Command failed (workunit test cephadm/test_dashboard_e2e.sh) on smithi168
    with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd
    -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clo
    ne.client.0/qa/workunits/cephadm/test_dashboard_e2e.sh'

[5608052]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados tasks/rados_cls_all validater/lockdep}
-----------------------------------------------------------------
time:   00:13:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608052/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608052/
sentry: https://sentry.ceph.com/organizations/ceph/?query=658fffcd426246239a84d8543dd0440d

    Command failed (workunit test cls/test_cls_lock.sh) on smithi158 with
    status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/cls/test_cls_lock.sh'

[5608057]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-lz4 supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:20:28
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608057/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608057/
sentry: https://sentry.ceph.com/organizations/ceph/?query=8a37fb4b5f344c62969a19cddebbca5f

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608079]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-snappy supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:20:27
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608079/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608079/
sentry: https://sentry.ceph.com/organizations/ceph/?query=eabde61c775b4a38897b640608812439

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608097]  rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{rhel_8.0} fixed-2 mon_election/connectivity}
-----------------------------------------------------------------
time:   00:18:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608097/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608097/
sentry: https://sentry.ceph.com/organizations/ceph/?query=cda6aac302a74699897a23e225a0d008

    reached maximum tries (180) after waiting for 180 seconds

[5608100]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{centos_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:20:50
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608100/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608100/
sentry: https://sentry.ceph.com/organizations/ceph/?query=656fca2ac8c44f9ebcfc2c8dc487d608

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608120]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/dashboard}
-----------------------------------------------------------------
time:   00:19:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608120/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608120/
sentry: https://sentry.ceph.com/organizations/ceph/?query=2d952ab753b445a88ebf833df3efd12c

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608139]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:24:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608139/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608139/
sentry: https://sentry.ceph.com/organizations/ceph/?query=db9ac46ea00a4d75923c530c664dc368

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608160]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:25:20
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608160/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608160/
sentry: https://sentry.ceph.com/organizations/ceph/?query=4600079618ff40c890e4a60a1521edd4

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608180]  rados/dashboard/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/dashboard}
-----------------------------------------------------------------
time:   00:24:27
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608180/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608180/
sentry: https://sentry.ceph.com/organizations/ceph/?query=a9760f9ac63e4e3a943fc8dbb34eb09a

    Test failure: test_full_health (tasks.mgr.dashboard.test_health.HealthTest)

[5608186]  rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{rhel_latest} fixed-2 mon_election/connectivity}
-----------------------------------------------------------------
time:   00:18:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608186/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608186/
sentry: https://sentry.ceph.com/organizations/ceph/?query=d86444eb7df34e489e429097f52c6500

    reached maximum tries (180) after waiting for 180 seconds

[5608187]  rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/force-sync-many workloads/rados_mon_workunits}
-----------------------------------------------------------------
time:   03:14:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608187/
log:    http://qa-proxy.ceph.com/teuthology/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608187/
sentry: https://sentry.ceph.com/organizations/ceph/?query=ad61fa32b9c2475195dbcd4bdfb300f9

    Command failed (workunit test mon/caps.sh) on smithi051 with status 124:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=7d0d9a133194d135cf03ea30a929f2a9fa846008
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage timeout 3h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/mon/caps.sh'



Pass
=================================================================
[5607836] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:38
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607836/

[5607837] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start}
time:   00:14:41
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607837/

[5607838] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607838/

[5607839] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start}
time:   00:12:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607839/

[5607840] rados/singleton-nomsgr/{all/version-number-sanity mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:32
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607840/

[5607841] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
time:   00:33:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607841/

[5607842] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/write_fadvise_dontneed}
time:   00:18:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607842/

[5607843] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:11:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607843/

[5607844] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:14:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607844/

[5607845] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start}
time:   00:14:22
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607845/

[5607846] rados/singleton/{all/resolve_stuck_peering mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607846/

[5607847] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:05:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607847/

[5607848] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:28:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607848/

[5607849] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm}
time:   00:12:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607849/

[5607850] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_8} tasks/crash}
time:   00:13:16
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607850/

[5607851] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:33:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607851/

[5607853] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_8}}
time:   00:11:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607853/

[5607854] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
time:   00:06:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607854/

[5607855] rados/singleton-nomsgr/{all/admin_socket_output mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:13:46
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607855/

[5607856] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/crush}
time:   00:09:34
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607856/

[5607857] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607857/

[5607858] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/classic thrashosds-health ubuntu_latest}
time:   05:31:32
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607858/

[5607859] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:18:59
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607859/

[5607860] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/radosbench}
time:   01:16:34
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607860/

[5607861] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:32:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607861/

[5607862] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/many workloads/rados_5925}
time:   00:08:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607862/

[5607864] rados/singleton/{all/test-crash mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:28
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607864/

[5607865] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{centos_8}}
time:   00:10:32
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607865/

[5607866] rados/singleton-nomsgr/{all/balancer mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:08:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607866/

[5607867] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start}
time:   00:13:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607867/

[5607868] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/cache-agent-big}
time:   00:24:01
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607868/

[5607869] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:10:43
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607869/

[5607870] rados/singleton/{all/test_envlibrados_for_rocksdb mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   00:14:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607870/

[5607871] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:25:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607871/

[5607872] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/rados_api_tests validater/valgrind}
time:   00:43:25
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607872/

[5607873] rados/cephadm/smoke-roleless/{distro/centos_8.0 start}
time:   00:11:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607873/

[5607874] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:59
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607874/

[5607875] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{centos_latest} fixed-2 mon_election/classic}
time:   00:15:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607875/

[5607877] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607877/

[5607878] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/few rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:27:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607878/

[5607879] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
time:   00:31:22
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607879/

[5607880] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} tasks/scrub_test}
time:   00:10:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607880/

[5607881] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/cache-agent-small}
time:   00:12:46
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607881/

[5607882] rados/singleton/{all/thrash-backfill-full mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
time:   01:04:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607882/

[5607883] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/erasure-code}
time:   00:33:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607883/

[5607884] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start}
time:   00:12:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607884/

[5607885] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/rbd_cls}
time:   00:22:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607885/

[5607886] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_8} tasks/mon_recovery}
time:   00:15:03
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607886/

[5607887] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:29:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607887/

[5607888] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:07:27
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607888/

[5607889] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:25
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607889/

[5607890] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_8} tasks/failover}
time:   00:15:26
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607890/

[5607891] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm_repos}
time:   00:04:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607891/

[5607892] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} thrashers/none thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:22:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607892/

[5607893] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:09:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607893/

[5607894] rados/singleton/{all/thrash-eio mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{centos_8}}
time:   00:37:36
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607894/

[5607895] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
time:   00:20:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607895/

[5607897] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{rhel_8}}
time:   00:14:31
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607897/

[5607898] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/one workloads/rados_api_tests}
time:   00:26:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607898/

[5607899] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start}
time:   00:15:54
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607899/

[5607900] rados/singleton-nomsgr/{all/ceph-post-file mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:10:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607900/

[5607901] rados/cephadm/smoke-roleless/{distro/centos_latest start}
time:   00:11:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607901/

[5607902] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:23:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607902/

[5607903] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-pool-snaps}
time:   00:23:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607903/

[5607904] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/snaps-few-objects}
time:   00:39:48
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607904/

[5607905] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:14:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607905/

[5607906] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados tasks/rados_cls_all validater/lockdep}
time:   00:16:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607906/

[5607907] rados/standalone/{mon_election/classic supported-random-distro$/{ubuntu_latest} workloads/mgr}
time:   00:08:41
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607907/

[5607908] rados/singleton-nomsgr/{all/export-after-evict mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:11:21
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607908/

[5607909] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start}
time:   00:15:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607909/

[5607910] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:21:20
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607910/

[5607911] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{rhel_8} tasks/rados_api_tests}
time:   00:27:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607911/

[5607914] rados/perf/{ceph mon_election/classic objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:08:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607914/

[5607915] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps-balanced}
time:   00:24:20
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607915/

[5607917] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:35:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607917/

[5607918] rados/singleton-nomsgr/{all/full-tiering mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:11:47
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607918/

[5607919] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start}
time:   00:13:26
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607919/

[5607920] rados/singleton/{all/watch-notify-same-primary mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:11:49
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607920/

[5607921] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews}
time:   00:11:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607921/

[5607922] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/minsize_recovery thrashosds-health workloads/ec-radosbench}
time:   01:57:23
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607922/

[5607923] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607923/

[5607924] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start}
time:   00:14:37
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607924/

[5607925] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-hybrid supported-random-distro$/{rhel_8} tasks/insights}
time:   00:15:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607925/

[5607926] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:29:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607926/

[5607927] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/test_rbd_api}
time:   00:20:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607927/

[5607928] rados/singleton-nomsgr/{all/health-warnings mon_election/connectivity rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:20
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607928/

[5607929] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:26:41
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607929/

[5607930] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_orch_cli}
time:   00:16:54
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607930/

[5607931] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/sync-many workloads/rados_mon_osdmap_prune}
time:   00:51:45
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607931/

[5607932] rados/singleton/{all/admin-socket mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8}}
time:   00:06:58
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607932/

[5607933] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/misc}
time:   00:28:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607933/

[5607934] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:10:38
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607934/

[5607935] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start}
time:   00:14:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607935/

[5607936] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache}
time:   00:11:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607936/

[5607938] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_8}}
time:   00:11:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607938/

[5607939] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:33:26
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607939/

[5607940] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8} tasks/rados_cls_all}
time:   00:22:36
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607940/

[5607941] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607941/

[5607942] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:24:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607942/

[5607943] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:28:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607943/

[5607944] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados tasks/mon_recovery validater/valgrind}
time:   00:25:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607944/

[5607945] rados/singleton/{all/deduptool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:00
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607945/

[5607946] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607946/

[5607947] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8}}
time:   00:33:16
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607947/

[5607948] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start}
time:   00:13:51
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607948/

[5607949] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/pool-snaps-few-objects}
time:   00:30:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607949/

[5607950] rados/cephadm/smoke-roleless/{distro/rhel_latest start}
time:   00:14:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607950/

[5607951] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:08:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607951/

[5607952] rados/singleton/{all/divergent_priors mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607952/

[5607953] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_adoption}
time:   00:06:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607953/

[5607955] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607955/

[5607956] rados/perf/{ceph mon_election/classic objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:09:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607956/

[5607957] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start}
time:   00:12:51
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607957/

[5607958] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/module_selftest}
time:   00:24:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607958/

[5607959] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/rados_api_tests}
time:   00:21:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607959/

[5607960] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:05:43
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607960/

[5607961] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-balanced}
time:   00:24:54
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607961/

[5607962] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/mon}
time:   00:39:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607962/

[5607963] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{centos_8.0} fixed-2 mon_election/classic}
time:   00:16:31
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607963/

[5607964] rados/singleton-nomsgr/{all/librados_hello_world mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:08:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607964/

[5607965] rados/singleton/{all/divergent_priors2 mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_8}}
time:   00:08:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607965/

[5607966] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/radosbench}
time:   01:11:45
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607966/

[5607968] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:32:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607968/

[5607969] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:40:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607969/

[5607970] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_8} tasks/rados_python}
time:   00:16:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607970/

[5607971] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start}
time:   00:11:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607971/

[5607972] rados/singleton-nomsgr/{all/msgr mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:16:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607972/

[5607973] rados/singleton/{all/dump-stuck mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8}}
time:   00:12:37
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607973/

[5607974] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start}
time:   00:12:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607974/

[5607976] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_8}}
time:   02:34:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607976/

[5607977] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
time:   00:18:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607977/

[5607978] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:10:28
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607978/

[5607979] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:09:16
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607979/

[5607980] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados tasks/rados_api_tests validater/lockdep}
time:   00:22:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607980/

[5607981] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/rbd_cls}
time:   00:21:34
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607981/

[5607982] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:32:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607982/

[5607983] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/radosbench}
time:   02:22:26
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607983/

[5607984] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:21:16
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607984/

[5607985] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start}
time:   00:16:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607985/

[5607986] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:09
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607986/

[5607987] rados/singleton/{all/ec-lost-unfound mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:26:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607987/

[5607988] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/osd}
time:   03:04:58
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607988/

[5607989] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_cephadm}
time:   00:12:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607989/

[5607990] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607990/

[5607991] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:22:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607991/

[5607992] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect}
time:   00:12:43
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607992/

[5607993] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-stupid supported-random-distro$/{rhel_8} tasks/progress}
time:   00:17:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607993/

[5607994] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:17:20
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607994/

[5607995] rados/singleton/{all/erasure-code-nonregression mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:05:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607995/

[5607996] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start}
time:   00:15:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607996/

[5607997] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_recovery}
time:   00:07:35
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607997/

[5607998] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:21:20
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5607998/

[5608000] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start}
time:   00:14:01
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608000/

[5608001] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:08:39
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608001/

[5608002] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/rados_stress_watch}
time:   00:19:49
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608002/

[5608003] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/snaps-few-objects}
time:   00:37:25
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608003/

[5608004] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/redirect_promote_tests}
time:   00:17:58
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608004/

[5608005] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_8} thrashers/force-sync-many workloads/snaps-few-objects}
time:   00:32:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608005/

[5608006] rados/singleton/{all/lost-unfound-delete mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:40:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608006/

[5608007] rados/singleton-nomsgr/{all/pool-access mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:07:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608007/

[5608008] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_18.04} fixed-2 mon_election/connectivity}
time:   00:18:09
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608008/

[5608009] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start}
time:   00:13:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608009/

[5608010] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/scrub}
time:   01:31:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608010/

[5608011] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async start tasks/rados_api_tests}
time:   00:30:35
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608011/

[5608012] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:28:48
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608012/

[5608013] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-bitmap rados tasks/rados_api_tests validater/valgrind}
time:   00:46:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608013/

[5608014] rados/singleton/{all/lost-unfound mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:59:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608014/

[5608015] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/redirect_set_object}
time:   00:13:22
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608015/

[5608016] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:31:35
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608016/

[5608018] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{ubuntu_latest}}
time:   02:14:33
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608018/

[5608019] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:29:31
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608019/

[5608020] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/test_rbd_api}
time:   00:20:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608020/

[5608021] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/classic start}
time:   00:14:49
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608021/

[5608022] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:08:25
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608022/

[5608023] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:38
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608023/

[5608024] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start}
time:   00:12:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608024/

[5608025] rados/singleton/{all/max-pg-per-osd.from-mon mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:10:47
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608025/

[5608026] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/set-chunks-read}
time:   00:12:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608026/

[5608027] rados/singleton-nomsgr/{all/version-number-sanity mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:07:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608027/

[5608028] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/filestore-xfs supported-random-distro$/{rhel_8} tasks/prometheus}
time:   00:13:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608028/

[5608029] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/classic task/test_cephadm_repos}
time:   00:04:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608029/

[5608030] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper}
time:   00:06:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608030/

[5608031] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:05:43
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608031/

[5608032] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:17:36
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608032/

[5608033] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/connectivity start}
time:   00:13:48
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608033/

[5608034] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:29:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608034/

[5608035] rados/singleton/{all/max-pg-per-osd.from-primary mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
time:   00:10:45
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608035/

[5608036] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/octopus backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/cache-snaps}
time:   00:38:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608036/

[5608037] rados/singleton-bluestore/{all/cephtool mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:29:01
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608037/

[5608039] rados/singleton-nomsgr/{all/admin_socket_output mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:14:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608039/

[5608040] rados/standalone/{mon_election/connectivity supported-random-distro$/{ubuntu_latest} workloads/crush}
time:   00:08:31
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608040/

[5608041] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap mon_election/connectivity thrashosds-health ubuntu_latest}
time:   05:16:51
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608041/

[5608042] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/pggrow thrashosds-health workloads/small-objects-balanced}
time:   00:21:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608042/

[5608043] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async-v1only start tasks/rados_python}
time:   00:20:01
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608043/

[5608044] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/pool-create-delete}
time:   00:16:04
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608044/

[5608046] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:23:09
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608046/

[5608047] rados/singleton/{all/max-pg-per-osd.from-replica mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:10:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608047/

[5608048] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}}
time:   00:09:36
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608048/

[5608049] rados/singleton-nomsgr/{all/balancer mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:08:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608049/

[5608050] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/small-objects-localized}
time:   00:24:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608050/

[5608051] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:09:34
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608051/

[5608053] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/classic start}
time:   00:12:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608053/

[5608054] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:31:31
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608054/

[5608055] rados/cephadm/smoke-roleless/{distro/centos_8.0 start}
time:   00:11:33
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608055/

[5608056] rados/singleton/{all/mon-auth-caps mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:41
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608056/

[5608058] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_8}}
time:   00:10:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608058/

[5608059] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:22
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608059/

[5608060] rados/cephadm/upgrade/{1-start 2-repo_digest/defaut 3-start-upgrade 4-wait distro$/{ubuntu_latest} fixed-2 mon_election/classic}
time:   00:18:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608060/

[5608061] rados/singleton-nomsgr/{all/cache-fs-trunc mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:12:03
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608061/

[5608062] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/small-objects}
time:   00:24:50
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608062/

[5608063] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_big}
time:   00:30:46
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608063/

[5608064] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/radosbench}
time:   01:22:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608064/

[5608065] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-bitmap supported-random-distro$/{rhel_8} tasks/workunits}
time:   00:11:19
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608065/

[5608066] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/erasure-code}
time:   00:40:37
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608066/

[5608067] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:11:00
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608067/

[5608068] rados/cephadm/workunits/{distro/centos_latest mon_election/connectivity task/test_orch_cli}
time:   00:16:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608068/

[5608069] rados/singleton/{all/mon-config-key-caps mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
time:   00:09:09
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608069/

[5608070] rados/multimon/{clusters/9 mon_election/connectivity msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_with_skews}
time:   00:05:48
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608070/

[5608071] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-small-objects}
time:   00:20:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608071/

[5608072] rados/singleton-nomsgr/{all/ceph-kvstore-tool mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608072/

[5608073] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/connectivity start}
time:   00:11:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608073/

[5608074] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:24:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608074/

[5608075] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:34:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608075/

[5608076] rados/singleton/{all/mon-config-keys mon_election/classic msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608076/

[5608077] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/classic start}
time:   00:15:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608077/

[5608078] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_8} thrashers/one workloads/rados_5925}
time:   00:12:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608078/

[5608080] rados/singleton-nomsgr/{all/ceph-post-file mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:05:50
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608080/

[5608081] rados/cephadm/smoke-roleless/{distro/centos_latest start}
time:   00:10:45
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608081/

[5608082] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/snaps-few-objects-localized}
time:   00:28:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608082/

[5608083] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls}
time:   00:16:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608083/

[5608084] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:26:16
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608084/

[5608085] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:23
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608085/

[5608086] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados tasks/mon_recovery validater/valgrind}
time:   00:26:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608086/

[5608087] rados/singleton/{all/mon-config mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:06:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608087/

[5608088] rados/perf/{ceph mon_election/classic objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:09:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608088/

[5608089] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/connectivity start}
time:   00:15:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608089/

[5608090] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608090/

[5608091] rados/standalone/{mon_election/connectivity supported-random-distro$/{rhel_8} workloads/mgr}
time:   00:13:39
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608091/

[5608092] rados/singleton-nomsgr/{all/export-after-evict mon_election/classic rados supported-random-distro$/{rhel_8}}
time:   00:10:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608092/

[5608093] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:09:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608093/

[5608094] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} tasks/rados_workunit_loadgen_mix}
time:   00:19:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608094/

[5608095] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_adoption}
time:   00:06:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608095/

[5608096] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/snaps-few-objects}
time:   00:21:11
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608096/

[5608098] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:08:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608098/

[5608099] rados/singleton/{all/osd-backfill mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608099/

[5608101] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{ubuntu_latest}}
time:   00:12:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608101/

[5608102] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:19:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608102/

[5608103] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:24:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608103/

[5608104] rados/singleton-nomsgr/{all/full-tiering mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:11:26
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608104/

[5608105] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
time:   00:36:47
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608105/

[5608106] rados/multimon/{clusters/21 mon_election/classic msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} tasks/mon_recovery}
time:   00:19:01
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608106/

[5608107] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_8} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:32:09
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608107/

[5608108] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:16:32
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608108/

[5608109] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/classic start}
time:   00:13:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608109/

[5608110] rados/singleton/{all/osd-recovery-incomplete mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:58
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608110/

[5608111] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write}
time:   00:15:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608111/

[5608112] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start}
time:   00:14:36
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608112/

[5608113] rados/singleton-nomsgr/{all/health-warnings mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608113/

[5608114] rados/monthrash/{ceph clusters/3-mons mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_api_tests}
time:   00:21:32
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608114/

[5608115] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 mon_election/connectivity start}
time:   00:14:37
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608115/

[5608116] rados/standalone/{mon_election/classic supported-random-distro$/{centos_8} workloads/misc}
time:   00:23:25
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608116/

[5608117] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:33:59
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608117/

[5608118] rados/singleton/{all/osd-recovery mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_8}}
time:   00:16:48
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608118/

[5608119] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api}
time:   00:20:46
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608119/

[5608121] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:34:21
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608121/

[5608122] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged mon_election/classic msgr/async-v1only start tasks/rados_api_tests}
time:   00:32:50
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608122/

[5608123] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:13:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608123/

[5608124] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados tasks/rados_api_tests validater/lockdep}
time:   00:21:21
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608124/

[5608125] rados/singleton-nomsgr/{all/large-omap-object-warnings mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:07:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608125/

[5608126] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:22:00
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608126/

[5608127] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:09:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608127/

[5608128] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 mon_election/classic start}
time:   00:13:59
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608128/

[5608129] rados/singleton-bluestore/{all/cephtool mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8}}
time:   00:34:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608129/

[5608130] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-agent-big}
time:   00:24:43
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608130/

[5608131] rados/singleton/{all/peer mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_8}}
time:   00:07:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608131/

[5608132] rados/cephadm/smoke-roleless/{distro/rhel_latest start}
time:   00:13:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608132/

[5608133] rados/perf/{ceph mon_election/classic objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write}
time:   00:20:52
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608133/

[5608134] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/classic objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_8} tasks/failover}
time:   00:15:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608134/

[5608135] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_cephadm}
time:   00:12:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608135/

[5608136] rados/singleton-nomsgr/{all/lazy_omap_stats_output mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:07:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608136/

[5608137] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:31:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608137/

[5608138] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal mon_election/classic msgr-failures/osd-delay rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:20:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608138/

[5608140] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{centos_8}}
time:   00:21:57
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608140/

[5608141] rados/singleton/{all/pg-autoscaler mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:08:12
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608141/

[5608142] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} thrashers/mapgap thrashosds-health workloads/cache-agent-small}
time:   00:13:27
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608142/

[5608143] rados/multimon/{clusters/3 mon_election/connectivity msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} tasks/mon_clock_no_skews}
time:   00:10:29
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608143/

[5608144] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:23:53
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608144/

[5608145] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 mon_election/connectivity start}
time:   00:12:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608145/

[5608146] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/mon}
time:   00:39:37
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608146/

[5608147] rados/cephadm/upgrade/{1-start 2-repo_digest/repo_digest 3-start-upgrade 4-wait distro$/{ubuntu_18.04_podman} fixed-2 mon_election/classic}
time:   00:30:15
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608147/

[5608148] rados/singleton-nomsgr/{all/librados_hello_world mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:08:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608148/

[5608149] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root mon_election/connectivity msgr/async-v2only start tasks/rados_python}
time:   00:22:02
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608149/

[5608150] rados/singleton/{all/pg-removal-interruption mon_election/connectivity msgr-failures/many msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:05:39
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608150/

[5608151] rados/monthrash/{ceph clusters/9-mons mon_election/connectivity msgr-failures/mon-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_8} thrashers/sync workloads/rados_mon_osdmap_prune}
time:   00:52:45
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608151/

[5608152] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:28:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608152/

[5608153] rados/cephadm/smoke/{distro/centos_latest fixed-2 mon_election/classic start}
time:   00:12:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608153/

[5608154] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/readwrite}
time:   00:09:55
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608154/

[5608155] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:10:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608155/

[5608156] rados/singleton-nomsgr/{all/msgr mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:12:23
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608156/

[5608157] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start}
time:   00:12:01
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608157/

[5608158] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/connectivity msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:33:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608158/

[5608159] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none mon_election/classic msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados tasks/rados_cls_all validater/valgrind}
time:   02:09:13
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608159/

[5608161] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:10:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608161/

[5608162] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/on distro$/{ubuntu_18.04} mon_election/connectivity msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:20:42
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608162/

[5608163] rados/singleton/{all/radostool mon_election/classic msgr-failures/few msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{centos_8}}
time:   00:11:35
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608163/

[5608164] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/classic msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_8} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:33:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608164/

[5608165] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{centos_8} thrashers/none thrashosds-health workloads/cache-pool-snaps}
time:   00:17:54
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608165/

[5608166] rados/cephadm/workunits/{distro/ubuntu_18.04_podman mon_election/connectivity task/test_cephadm_repos}
time:   00:04:03
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608166/

[5608167] rados/singleton-nomsgr/{all/multi-backfill-reject mon_election/connectivity rados supported-random-distro$/{centos_8}}
time:   00:20:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608167/

[5608168] rados/mgr/{clusters/{2-node-mgr} debug/mgr mon_election/connectivity objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/insights}
time:   00:09:43
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608168/

[5608169] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 mon_election/connectivity start}
time:   00:15:41
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608169/

[5608170] rados/standalone/{mon_election/classic supported-random-distro$/{rhel_8} workloads/osd}
time:   03:09:34
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608170/

[5608171] rados/singleton/{all/random-eio mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:22:08
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608171/

[5608172] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged mon_election/classic msgr/async-v2only start tasks/rados_api_tests}
time:   00:31:07
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608172/

[5608173] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:22:23
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608173/

[5608174] rados/cephadm/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{ubuntu_18.04} mon_election/classic msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls}
time:   00:22:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608174/

[5608175] rados/perf/{ceph mon_election/classic objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:11:46
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608175/

[5608176] rados/multimon/{clusters/6 mon_election/classic msgr-failures/few msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_8} tasks/mon_clock_with_skews}
time:   00:06:23
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608176/

[5608177] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_8} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:32:38
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608177/

[5608178] rados/singleton-nomsgr/{all/osd_stale_reads mon_election/classic rados supported-random-distro$/{centos_8}}
time:   00:17:10
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608178/

[5608179] rados/cephadm/smoke/{distro/rhel_latest fixed-2 mon_election/classic start}
time:   00:15:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608179/

[5608181] rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}}
time:   05:01:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608181/

[5608182] rados/singleton/{all/rebuild-mondb mon_election/classic msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_8}}
time:   00:14:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608182/

[5608183] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start}
time:   00:12:33
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608183/

[5608184] rados/basic/{ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/many msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/repair_test}
time:   00:13:39
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608184/

[5608185] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} crc-failures/default d-balancer/on mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_8} thrashers/careful thrashosds-health workloads/cache-snaps}
time:   00:27:46
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608185/

[5608188] rados/singleton-nomsgr/{all/pool-access mon_election/connectivity rados supported-random-distro$/{rhel_8}}
time:   00:11:34
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608188/

[5608189] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 mon_election/connectivity start}
time:   00:13:58
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608189/

[5608190] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast mon_election/connectivity msgr-failures/fastclose rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_8} thrashers/minsize_recovery thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:24:05
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608190/

[5608191] rados/singleton/{all/recovery-preemption mon_election/connectivity msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:39
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608191/

[5608192] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} mon_election/classic msgr-failures/fastclose objectstore/bluestore-comp-lz4 rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_8} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:37
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608192/

[5608193] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root mon_election/connectivity msgr/async start tasks/rados_python}
time:   00:20:14
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608193/

[5608194] rados/standalone/{mon_election/connectivity supported-random-distro$/{centos_8} workloads/scrub}
time:   01:32:17
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608194/

[5608195] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} mon_election/classic msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:08:56
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608195/

[5608196] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} mon_election/connectivity msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados tasks/mon_recovery validater/lockdep}
time:   00:11:18
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608196/

[5608197] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} crc-failures/bad_map_crc_failure d-balancer/crush-compat mon_election/classic msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_8} thrashers/default thrashosds-health workloads/cache}
time:   00:10:24
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608197/

[5608198] rados/cephadm/workunits/{distro/centos_latest mon_election/classic task/test_orch_cli}
time:   00:16:40
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608198/

[5608199] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} mon_election/connectivity msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:28:06
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608199/

[5608200] rados/perf/{ceph mon_election/connectivity objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:08:44
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608200/

[5608201] rados/singleton-nomsgr/{all/recovery-unfound-found mon_election/classic rados supported-random-distro$/{ubuntu_latest}}
time:   00:26:30
info:   http://pulpito.ceph.com/hmunjulu-2020-11-10_05:32:31-rados-wip-hmunjulu02-testing-2020-11-09-1705-distro-basic-smithi/5608201/