2020-07-01T04:17:49.939 INFO:root:teuthology version: 1.0.0-645528e
2020-07-01T04:17:49.941 INFO:teuthology.results:subset: '16/9999'
2020-07-01T04:17:49.941 INFO:teuthology.results:seed: '4254'
2020-07-02T01:09:09.354 INFO:root:teuthology version: 1.0.0-5208279
2020-07-02T01:09:09.380 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2020-07-02T03:26:14.159 INFO:teuthology.results:Tests finished! gathering results...
2020-07-02T03:26:41.164 INFO:scrape:Found 330 jobs
2020-07-02T03:26:41.857 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 15.2.4-4-gabcb13a (abcb13ae4e01e1d30857c98a01d0916e952030b9) octopus (stable)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f4317695afc]
,  2: (()+0x276d16) [0x7f4317695d16]

2020-07-02T03:26:41.860 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:08:18.993 INFO:teuthology.orchestra.run.smithi042.stdout:
, dumped all
, 2020-07-01T06:08:19.005 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2020-07-01T06:08:17.308951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30152980850,"num_objects":10142,"num_object_clones":0,"num_object_copies":20284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10115,"num_whiteouts":37,"num_read":22823,"num_read_kb":1350358,"num_write":53015,"num_write_kb":23915037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49201,"ondisk_log_size":49201,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":44867848,"kb_used_data":38477572,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":521363192,"statfs":{"total":579820584960,"available":533875908608,"internally_reserved":6442450944,"allocated":39401033728,"data_stored":39252435110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":107914797,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":1042,"num_read_kb":972772,"num_write":580,"num_write_kb":388950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":529,"num_flush":86,"num_flush_kb":243095,"num_evict":29,"num_evict_kb":78346,"num_promote":109,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764251+0000","last_change":"2020-07-01T06:05:03.040752+0000","last_active":"2020-07-01T06:07:47.764251+0000","last_peered":"2020-07-01T06:07:47.764251+0000","last_clean":"2020-07-01T06:07:47.764251+0000","last_became_active":"2020-07-01T06:05:03.040287+0000","last_became_peered":"2020-07-01T06:05:03.040287+0000","last_unstale":"2020-07-01T06:07:47.764251+0000","last_undegraded":"2020-07-01T06:07:47.764251+0000","last_fullsized":"2020-07-01T06:07:47.764251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761306+0000","last_change":"2020-07-01T06:05:03.066148+0000","last_active":"2020-07-01T06:07:47.761306+0000","last_peered":"2020-07-01T06:07:47.761306+0000","last_clean":"2020-07-01T06:07:47.761306+0000","last_became_active":"2020-07-01T06:05:03.065647+0000","last_became_peered":"2020-07-01T06:05:03.065647+0000","last_unstale":"2020-07-01T06:07:47.761306+0000","last_undegraded":"2020-07-01T06:07:47.761306+0000","last_fullsized":"2020-07-01T06:07:47.761306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5773","reported_seq":"7987","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.705740+0000","last_change":"2020-07-01T06:05:12.715597+0000","last_active":"2020-07-01T06:08:09.705740+0000","last_peered":"2020-07-01T06:08:09.705740+0000","last_clean":"2020-07-01T06:08:09.705740+0000","last_became_active":"2020-07-01T06:05:12.715286+0000","last_became_peered":"2020-07-01T06:05:12.715286+0000","last_unstale":"2020-07-01T06:08:09.705740+0000","last_undegraded":"2020-07-01T06:08:09.705740+0000","last_fullsized":"2020-07-01T06:08:09.705740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5773,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":98787888,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1952,"num_read_kb":971,"num_write":5064,"num_write_kb":1170992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3949,"num_flush":917,"num_flush_kb":2673482,"num_evict":838,"num_evict_kb":2438479,"num_promote":1026,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'6599","reported_seq":"8688","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.427521+0000","last_change":"2020-07-01T06:05:10.793859+0000","last_active":"2020-07-01T06:08:12.427521+0000","last_peered":"2020-07-01T06:08:12.427521+0000","last_clean":"2020-07-01T06:08:12.427521+0000","last_became_active":"2020-07-01T06:05:10.793445+0000","last_became_peered":"2020-07-01T06:05:10.793445+0000","last_unstale":"2020-07-01T06:08:12.427521+0000","last_undegraded":"2020-07-01T06:08:12.427521+0000","last_fullsized":"2020-07-01T06:08:12.427521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6599,"ondisk_log_size":6599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7351542432,"num_objects":2460,"num_object_clones":0,"num_object_copies":4920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2460,"num_whiteouts":0,"num_read":3711,"num_read_kb":319158,"num_write":8205,"num_write_kb":4718998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764187+0000","last_change":"2020-07-01T06:05:03.065634+0000","last_active":"2020-07-01T06:07:47.764187+0000","last_peered":"2020-07-01T06:07:47.764187+0000","last_clean":"2020-07-01T06:07:47.764187+0000","last_became_active":"2020-07-01T06:05:03.065163+0000","last_became_peered":"2020-07-01T06:05:03.065163+0000","last_unstale":"2020-07-01T06:07:47.764187+0000","last_undegraded":"2020-07-01T06:07:47.764187+0000","last_fullsized":"2020-07-01T06:07:47.764187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"33'5471","reported_seq":"7554","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.034923+0000","last_change":"2020-07-01T06:05:13.058750+0000","last_active":"2020-07-01T06:08:11.034923+0000","last_peered":"2020-07-01T06:08:11.034923+0000","last_clean":"2020-07-01T06:08:11.034923+0000","last_became_active":"2020-07-01T06:05:13.058349+0000","last_became_peered":"2020-07-01T06:05:13.058349+0000","last_unstale":"2020-07-01T06:08:11.034923+0000","last_undegraded":"2020-07-01T06:08:11.034923+0000","last_fullsized":"2020-07-01T06:08:11.034923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5471,"ondisk_log_size":5471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113457335,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":8,"num_read":1887,"num_read_kb":921,"num_write":4892,"num_write_kb":1195597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2644,"num_flush":870,"num_flush_kb":2557735,"num_evict":793,"num_evict_kb":2323729,"num_promote":959,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'6666","reported_seq":"8856","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.439313+0000","last_change":"2020-07-01T06:05:10.712962+0000","last_active":"2020-07-01T06:08:12.439313+0000","last_peered":"2020-07-01T06:08:12.439313+0000","last_clean":"2020-07-01T06:08:12.439313+0000","last_became_active":"2020-07-01T06:05:10.712567+0000","last_became_peered":"2020-07-01T06:05:10.712567+0000","last_unstale":"2020-07-01T06:08:12.439313+0000","last_undegraded":"2020-07-01T06:08:12.439313+0000","last_fullsized":"2020-07-01T06:08:12.439313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6666,"ondisk_log_size":6666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7457514421,"num_objects":2502,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2502,"num_whiteouts":0,"num_read":3789,"num_read_kb":286792,"num_write":8256,"num_write_kb":4887786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761389+0000","last_change":"2020-07-01T06:05:03.066158+0000","last_active":"2020-07-01T06:07:47.761389+0000","last_peered":"2020-07-01T06:07:47.761389+0000","last_clean":"2020-07-01T06:07:47.761389+0000","last_became_active":"2020-07-01T06:05:03.065602+0000","last_became_peered":"2020-07-01T06:05:03.065602+0000","last_unstale":"2020-07-01T06:07:47.761389+0000","last_undegraded":"2020-07-01T06:07:47.761389+0000","last_fullsized":"2020-07-01T06:07:47.761389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"33'5460","reported_seq":"7629","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.284048+0000","last_change":"2020-07-01T06:05:13.057409+0000","last_active":"2020-07-01T06:08:11.284048+0000","last_peered":"2020-07-01T06:08:11.284048+0000","last_clean":"2020-07-01T06:08:11.284048+0000","last_became_active":"2020-07-01T06:05:13.056913+0000","last_became_peered":"2020-07-01T06:05:13.056913+0000","last_unstale":"2020-07-01T06:08:11.284048+0000","last_undegraded":"2020-07-01T06:08:11.284048+0000","last_fullsized":"2020-07-01T06:08:11.284048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5460,"ondisk_log_size":5460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120594660,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":7,"num_read":1901,"num_read_kb":900,"num_write":4828,"num_write_kb":1138749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":2977,"num_flush":850,"num_flush_kb":2461298,"num_evict":712,"num_evict_kb":2056075,"num_promote":929,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'6836","reported_seq":"9123","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.417167+0000","last_change":"2020-07-01T06:05:10.793572+0000","last_active":"2020-07-01T06:08:12.417167+0000","last_peered":"2020-07-01T06:08:12.417167+0000","last_clean":"2020-07-01T06:08:12.417167+0000","last_became_active":"2020-07-01T06:05:10.793143+0000","last_became_peered":"2020-07-01T06:05:10.793143+0000","last_unstale":"2020-07-01T06:08:12.417167+0000","last_undegraded":"2020-07-01T06:08:12.417167+0000","last_fullsized":"2020-07-01T06:08:12.417167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6836,"ondisk_log_size":6836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7620744579,"num_objects":2547,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2547,"num_whiteouts":0,"num_read":3997,"num_read_kb":452821,"num_write":8470,"num_write_kb":4976422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761482+0000","last_change":"2020-07-01T06:05:03.066066+0000","last_active":"2020-07-01T06:07:47.761482+0000","last_peered":"2020-07-01T06:07:47.761482+0000","last_clean":"2020-07-01T06:07:47.761482+0000","last_became_active":"2020-07-01T06:05:03.065610+0000","last_became_peered":"2020-07-01T06:05:03.065610+0000","last_unstale":"2020-07-01T06:07:47.761482+0000","last_undegraded":"2020-07-01T06:07:47.761482+0000","last_fullsized":"2020-07-01T06:07:47.761482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"32'5823","reported_seq":"8053","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.317824+0000","last_change":"2020-07-01T06:05:12.716513+0000","last_active":"2020-07-01T06:08:09.317824+0000","last_peered":"2020-07-01T06:08:09.317824+0000","last_clean":"2020-07-01T06:08:09.317824+0000","last_became_active":"2020-07-01T06:05:12.716139+0000","last_became_peered":"2020-07-01T06:05:12.716139+0000","last_unstale":"2020-07-01T06:08:09.317824+0000","last_undegraded":"2020-07-01T06:08:09.317824+0000","last_fullsized":"2020-07-01T06:08:09.317824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5823,"ondisk_log_size":5823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99175935,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":1958,"num_read_kb":977,"num_write":5128,"num_write_kb":1180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3950,"num_flush":923,"num_flush_kb":2707853,"num_evict":836,"num_evict_kb":2447891,"num_promote":1022,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6573","reported_seq":"8565","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.769540+0000","last_change":"2020-07-01T06:05:10.793817+0000","last_active":"2020-07-01T06:08:11.769540+0000","last_peered":"2020-07-01T06:08:11.769540+0000","last_clean":"2020-07-01T06:08:11.769540+0000","last_became_active":"2020-07-01T06:05:10.793341+0000","last_became_peered":"2020-07-01T06:05:10.793341+0000","last_unstale":"2020-07-01T06:08:11.769540+0000","last_undegraded":"2020-07-01T06:08:11.769540+0000","last_fullsized":"2020-07-01T06:08:11.769540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6573,"ondisk_log_size":6573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7291163600,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":3628,"num_read_kb":287818,"num_write":8172,"num_write_kb":4646077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762140+0000","last_change":"2020-07-01T06:05:02.700518+0000","last_active":"2020-07-01T06:07:47.762140+0000","last_peered":"2020-07-01T06:07:47.762140+0000","last_clean":"2020-07-01T06:07:47.762140+0000","last_became_active":"2020-07-01T06:05:02.700021+0000","last_became_peered":"2020-07-01T06:05:02.700021+0000","last_unstale":"2020-07-01T06:07:47.762140+0000","last_undegraded":"2020-07-01T06:07:47.762140+0000","last_fullsized":"2020-07-01T06:07:47.762140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762255+0000","last_change":"2020-07-01T06:05:02.701920+0000","last_active":"2020-07-01T06:07:47.762255+0000","last_peered":"2020-07-01T06:07:47.762255+0000","last_clean":"2020-07-01T06:07:47.762255+0000","last_became_active":"2020-07-01T06:05:02.701535+0000","last_became_peered":"2020-07-01T06:05:02.701535+0000","last_unstale":"2020-07-01T06:07:47.762255+0000","last_undegraded":"2020-07-01T06:07:47.762255+0000","last_fullsized":"2020-07-01T06:07:47.762255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761267+0000","last_change":"2020-07-01T06:05:03.040661+0000","last_active":"2020-07-01T06:07:47.761267+0000","last_peered":"2020-07-01T06:07:47.761267+0000","last_clean":"2020-07-01T06:07:47.761267+0000","last_became_active":"2020-07-01T06:05:03.040253+0000","last_became_peered":"2020-07-01T06:05:03.040253+0000","last_unstale":"2020-07-01T06:07:47.761267+0000","last_undegraded":"2020-07-01T06:07:47.761267+0000","last_fullsized":"2020-07-01T06:07:47.761267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":432015818,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":37,"num_read":7698,"num_read_kb":3769,"num_write":19912,"num_write_kb":4685754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":680017920,"data_stored":678280898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22527,"ondisk_log_size":22527,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29720965032,"num_objects":9937,"num_object_clones":0,"num_object_copies":19874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9937,"num_whiteouts":0,"num_read":15125,"num_read_kb":1346589,"num_write":33103,"num_write_kb":19229283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38718308352,"data_stored":38572757424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26674,"ondisk_log_size":26674,"up":8,"acting":8,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10616748,"kb_used_data":9555644,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83755092,"statfs":{"total":96636764160,"available":85765214208,"internally_reserved":1073741824,"allocated":9784979456,"data_stored":9748301686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.224},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.999}]},{"osd":1,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.83599999999999997,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.60499999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.407,"15min":1.407},"last":1.03}]},{"osd":2,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.89900000000000002,"15min":0.874},"min":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.0129999999999999,"15min":0.98999999999999999},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.2949999999999999,"5min":6.2949999999999999,"15min":6.2949999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.97999999999999998,"15min":0.98399999999999999},"min":{"1min":0.60699999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4319999999999999,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":4,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.036},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4099999999999999,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1220000000000001,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.89200000000000002}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.282,"5min":1.488,"15min":1.488},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80200000000000005,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.145,"5min":1.387,"15min":1.387},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.214,"5min":1.0029999999999999,"15min":0.97599999999999998},"min":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.98999999999999999}]},{"osd":3,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":2.339,"15min":2.339},"last":1.121},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0800000000000001,"15min":1.0820000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.498,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.323}]},{"osd":5,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4219999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.141,"15min":1.143},"min":{"1min":0.96399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.452,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.3460000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5642524,"kb_used_data":4578092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":88729316,"statfs":{"total":96636764160,"available":90858819584,"internally_reserved":1073741824,"allocated":4687966208,"data_stored":4669691355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.81699999999999995,"15min":0.88400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0569999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1890000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.82099999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:09 2020","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2490000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.876},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85899999999999999,"15min":0.873},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9119999999999999,"5min":3.298,"15min":3.298},"last":1.159},{"interface":"front","average":{"1min":1.01,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64900000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.367,"5min":1.395,"15min":1.395},"last":1.0289999999999999}]},{"osd":4,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92300000000000004,"15min":0.93200000000000005},"min":{"1min":0.65100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.673,"15min":1.673},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.90600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0840000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0960000000000001,"15min":1.097},"min":{"1min":0.76100000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5009999999999999,"5min":1.883,"15min":1.883},"last":0.998}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10796920,"kb_used_data":9747172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83574920,"statfs":{"total":96636764160,"available":85580718080,"internally_reserved":1073741824,"allocated":9981104128,"data_stored":9944000252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.876,"15min":0.81999999999999995},"min":{"1min":0.65600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.81699999999999995,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.626}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.96399999999999997,"15min":0.95599999999999996},"min":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.107},{"interface":"front","average":{"1min":1.214,"5min":1.0389999999999999,"15min":1.044},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.751}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.054,"15min":1.006},"min":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94799999999999995,"15min":0.91500000000000004},"min":{"1min":0.72199999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.038,"15min":1.018},"min":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.224,"15min":1.246},"min":{"1min":0.88,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.9540000000000002,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.2509999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.878,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.1799999999999997,"5min":7.1799999999999997,"15min":7.1799999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.83399999999999996,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.745},{"interface":"front","average":{"1min":1.079,"5min":1.0649999999999999,"15min":1.0900000000000001},"min":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.008}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"min":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.21,"5min":1.1659999999999999,"15min":1.1879999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.153}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.02,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.117,"15min":1.1439999999999999},"min":{"1min":0.78200000000000003,"5min":0.745,"15min":0.745},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.92600000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15378608,"kb_used_data":14296216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":78993232,"statfs":{"total":96636764160,"available":80889069568,"internally_reserved":1073741824,"allocated":14639325184,"data_stored":14583979007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64000000000000001,"15min":0.67800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.496},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.343,"15min":1.343},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7070000000000001,"5min":2.004,"15min":2.004},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.621},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.478,"5min":1.841,"15min":1.841},"last":1.042}]},{"osd":5,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6699999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.117},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.415,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.022}]}]}]}}

2020-07-02T03:26:41.862 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:09:20.831 INFO:tasks.ceph:Checking cluster log for badness...
, 2020-07-01T06:09:20.832 INFO:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1
, 2020-07-01T06:09:20.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com

2020-07-02T03:26:41.863 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:04.152 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:41.864 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 179 M
, 2020-07-01T06:11:08.889 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check

2020-07-02T03:26:41.864 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:14.404 INFO:teuthology.orchestra.run.smithi042.stdout:  Preparing        :                                                        1/1
, 2020-07-01T06:11:14.434 INFO:teuthology.orchestra.run.smithi042.stdout:  Running scriptlet: ceph-2:15.2.4-4.gabcb13a.el8.x86_64                    1/1
, 2020-07-01T06:11:14.490 INFO:teuthology.orchestra.run.smithi019.stdout:  Preparing        :                                                        1/1

2020-07-02T03:26:41.865 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:41.866 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:41.867 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.4-4.gabcb13a.   15/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d   16/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: rbd-mirror-2:15.2.4-4.gabcb13a.el8.x86_64            17/81

2020-07-02T03:26:41.868 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy
, 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:32.048 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-html5lib-1:0.999999999-6.el8.noarch          59/81

2020-07-02T03:26:41.868 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:51.579 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-babel-2.5.1-5.el8.noarch                     26/81
, 2020-07-01T06:11:51.580 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-bcrypt-3.1.6-2.el8.1.x86_64                  27/81
, 2020-07-01T06:11:51.600 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          28/81

2020-07-02T03:26:41.869 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:53.977 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-cachetools-3.1.1-4.el8.noarch                29/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-argparse-2:15.2.4-4.gabcb13a.el8.x86_   30/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-common-2:15.2.4-4.gabcb13a.el8.x86_64   31/81

2020-07-02T03:26:41.870 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:55.468 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-lxml-4.2.3-1.el8.x86_64
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-mako-1.0.6-13.el8.noarch
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-markupsafe-0.23-19.el8.x86_64

2020-07-02T03:26:41.870 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cheroot-8.2.1-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cherrypy-18.4.0-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cssselect-0.9.2-10.el8.noarch

2020-07-02T03:26:41.871 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Remove  1 Package
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 721 k

2020-07-02T03:26:41.872 WARNING:scrape:Ignoring malparsed backtrace:   - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64
, No packages marked for removal.
, 2020-07-01T06:12:09.857 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-rook

2020-07-02T03:26:41.873 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: Package    Arch   Version                 Repository                      Size
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:41.873 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 2.1 M
, 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check
, 2020-07-01T06:12:20.022 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded.

2020-07-02T03:26:41.874 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : fmt-6.2.1-1.el8.x86_64                                 6/7
, 2020-07-01T06:12:25.450 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : lttng-ust-2.8.1-11.el8.x86_64                          7/7
, Modular dependency problem:

2020-07-02T03:26:41.875 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:30.980 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:31.389 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:12:31.390 INFO:teuthology.orchestra.run.smithi042.stdout:Removed:

2020-07-02T03:26:41.875 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do.
, 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:37.229 INFO:teuthology.orchestra.run.smithi019.stdout:Updating Subscription Management repositories.

2020-07-02T03:26:41.876 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:210 Number of sources = 4
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:===============================================================================

2020-07-02T03:26:41.877 WARNING:scrape:Ignoring malparsed backtrace:     node=self.hostname, label=self.label
, teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'which ceph_test_rados'
, 2020-07-01T06:13:05.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload

2020-07-02T03:26:42.028 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 15.2.4-4-gabcb13a (abcb13ae4e01e1d30857c98a01d0916e952030b9) octopus (stable)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f4317695afc]
,  2: (()+0x276d16) [0x7f4317695d16]

2020-07-02T03:26:42.031 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:08:18.993 INFO:teuthology.orchestra.run.smithi042.stdout:
, dumped all
, 2020-07-01T06:08:19.005 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2020-07-01T06:08:17.308951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30152980850,"num_objects":10142,"num_object_clones":0,"num_object_copies":20284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10115,"num_whiteouts":37,"num_read":22823,"num_read_kb":1350358,"num_write":53015,"num_write_kb":23915037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49201,"ondisk_log_size":49201,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":44867848,"kb_used_data":38477572,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":521363192,"statfs":{"total":579820584960,"available":533875908608,"internally_reserved":6442450944,"allocated":39401033728,"data_stored":39252435110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":107914797,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":1042,"num_read_kb":972772,"num_write":580,"num_write_kb":388950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":529,"num_flush":86,"num_flush_kb":243095,"num_evict":29,"num_evict_kb":78346,"num_promote":109,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764251+0000","last_change":"2020-07-01T06:05:03.040752+0000","last_active":"2020-07-01T06:07:47.764251+0000","last_peered":"2020-07-01T06:07:47.764251+0000","last_clean":"2020-07-01T06:07:47.764251+0000","last_became_active":"2020-07-01T06:05:03.040287+0000","last_became_peered":"2020-07-01T06:05:03.040287+0000","last_unstale":"2020-07-01T06:07:47.764251+0000","last_undegraded":"2020-07-01T06:07:47.764251+0000","last_fullsized":"2020-07-01T06:07:47.764251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761306+0000","last_change":"2020-07-01T06:05:03.066148+0000","last_active":"2020-07-01T06:07:47.761306+0000","last_peered":"2020-07-01T06:07:47.761306+0000","last_clean":"2020-07-01T06:07:47.761306+0000","last_became_active":"2020-07-01T06:05:03.065647+0000","last_became_peered":"2020-07-01T06:05:03.065647+0000","last_unstale":"2020-07-01T06:07:47.761306+0000","last_undegraded":"2020-07-01T06:07:47.761306+0000","last_fullsized":"2020-07-01T06:07:47.761306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5773","reported_seq":"7987","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.705740+0000","last_change":"2020-07-01T06:05:12.715597+0000","last_active":"2020-07-01T06:08:09.705740+0000","last_peered":"2020-07-01T06:08:09.705740+0000","last_clean":"2020-07-01T06:08:09.705740+0000","last_became_active":"2020-07-01T06:05:12.715286+0000","last_became_peered":"2020-07-01T06:05:12.715286+0000","last_unstale":"2020-07-01T06:08:09.705740+0000","last_undegraded":"2020-07-01T06:08:09.705740+0000","last_fullsized":"2020-07-01T06:08:09.705740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5773,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":98787888,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1952,"num_read_kb":971,"num_write":5064,"num_write_kb":1170992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3949,"num_flush":917,"num_flush_kb":2673482,"num_evict":838,"num_evict_kb":2438479,"num_promote":1026,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'6599","reported_seq":"8688","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.427521+0000","last_change":"2020-07-01T06:05:10.793859+0000","last_active":"2020-07-01T06:08:12.427521+0000","last_peered":"2020-07-01T06:08:12.427521+0000","last_clean":"2020-07-01T06:08:12.427521+0000","last_became_active":"2020-07-01T06:05:10.793445+0000","last_became_peered":"2020-07-01T06:05:10.793445+0000","last_unstale":"2020-07-01T06:08:12.427521+0000","last_undegraded":"2020-07-01T06:08:12.427521+0000","last_fullsized":"2020-07-01T06:08:12.427521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6599,"ondisk_log_size":6599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7351542432,"num_objects":2460,"num_object_clones":0,"num_object_copies":4920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2460,"num_whiteouts":0,"num_read":3711,"num_read_kb":319158,"num_write":8205,"num_write_kb":4718998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764187+0000","last_change":"2020-07-01T06:05:03.065634+0000","last_active":"2020-07-01T06:07:47.764187+0000","last_peered":"2020-07-01T06:07:47.764187+0000","last_clean":"2020-07-01T06:07:47.764187+0000","last_became_active":"2020-07-01T06:05:03.065163+0000","last_became_peered":"2020-07-01T06:05:03.065163+0000","last_unstale":"2020-07-01T06:07:47.764187+0000","last_undegraded":"2020-07-01T06:07:47.764187+0000","last_fullsized":"2020-07-01T06:07:47.764187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"33'5471","reported_seq":"7554","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.034923+0000","last_change":"2020-07-01T06:05:13.058750+0000","last_active":"2020-07-01T06:08:11.034923+0000","last_peered":"2020-07-01T06:08:11.034923+0000","last_clean":"2020-07-01T06:08:11.034923+0000","last_became_active":"2020-07-01T06:05:13.058349+0000","last_became_peered":"2020-07-01T06:05:13.058349+0000","last_unstale":"2020-07-01T06:08:11.034923+0000","last_undegraded":"2020-07-01T06:08:11.034923+0000","last_fullsized":"2020-07-01T06:08:11.034923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5471,"ondisk_log_size":5471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113457335,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":8,"num_read":1887,"num_read_kb":921,"num_write":4892,"num_write_kb":1195597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2644,"num_flush":870,"num_flush_kb":2557735,"num_evict":793,"num_evict_kb":2323729,"num_promote":959,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'6666","reported_seq":"8856","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.439313+0000","last_change":"2020-07-01T06:05:10.712962+0000","last_active":"2020-07-01T06:08:12.439313+0000","last_peered":"2020-07-01T06:08:12.439313+0000","last_clean":"2020-07-01T06:08:12.439313+0000","last_became_active":"2020-07-01T06:05:10.712567+0000","last_became_peered":"2020-07-01T06:05:10.712567+0000","last_unstale":"2020-07-01T06:08:12.439313+0000","last_undegraded":"2020-07-01T06:08:12.439313+0000","last_fullsized":"2020-07-01T06:08:12.439313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6666,"ondisk_log_size":6666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7457514421,"num_objects":2502,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2502,"num_whiteouts":0,"num_read":3789,"num_read_kb":286792,"num_write":8256,"num_write_kb":4887786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761389+0000","last_change":"2020-07-01T06:05:03.066158+0000","last_active":"2020-07-01T06:07:47.761389+0000","last_peered":"2020-07-01T06:07:47.761389+0000","last_clean":"2020-07-01T06:07:47.761389+0000","last_became_active":"2020-07-01T06:05:03.065602+0000","last_became_peered":"2020-07-01T06:05:03.065602+0000","last_unstale":"2020-07-01T06:07:47.761389+0000","last_undegraded":"2020-07-01T06:07:47.761389+0000","last_fullsized":"2020-07-01T06:07:47.761389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"33'5460","reported_seq":"7629","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.284048+0000","last_change":"2020-07-01T06:05:13.057409+0000","last_active":"2020-07-01T06:08:11.284048+0000","last_peered":"2020-07-01T06:08:11.284048+0000","last_clean":"2020-07-01T06:08:11.284048+0000","last_became_active":"2020-07-01T06:05:13.056913+0000","last_became_peered":"2020-07-01T06:05:13.056913+0000","last_unstale":"2020-07-01T06:08:11.284048+0000","last_undegraded":"2020-07-01T06:08:11.284048+0000","last_fullsized":"2020-07-01T06:08:11.284048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5460,"ondisk_log_size":5460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120594660,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":7,"num_read":1901,"num_read_kb":900,"num_write":4828,"num_write_kb":1138749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":2977,"num_flush":850,"num_flush_kb":2461298,"num_evict":712,"num_evict_kb":2056075,"num_promote":929,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'6836","reported_seq":"9123","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.417167+0000","last_change":"2020-07-01T06:05:10.793572+0000","last_active":"2020-07-01T06:08:12.417167+0000","last_peered":"2020-07-01T06:08:12.417167+0000","last_clean":"2020-07-01T06:08:12.417167+0000","last_became_active":"2020-07-01T06:05:10.793143+0000","last_became_peered":"2020-07-01T06:05:10.793143+0000","last_unstale":"2020-07-01T06:08:12.417167+0000","last_undegraded":"2020-07-01T06:08:12.417167+0000","last_fullsized":"2020-07-01T06:08:12.417167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6836,"ondisk_log_size":6836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7620744579,"num_objects":2547,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2547,"num_whiteouts":0,"num_read":3997,"num_read_kb":452821,"num_write":8470,"num_write_kb":4976422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761482+0000","last_change":"2020-07-01T06:05:03.066066+0000","last_active":"2020-07-01T06:07:47.761482+0000","last_peered":"2020-07-01T06:07:47.761482+0000","last_clean":"2020-07-01T06:07:47.761482+0000","last_became_active":"2020-07-01T06:05:03.065610+0000","last_became_peered":"2020-07-01T06:05:03.065610+0000","last_unstale":"2020-07-01T06:07:47.761482+0000","last_undegraded":"2020-07-01T06:07:47.761482+0000","last_fullsized":"2020-07-01T06:07:47.761482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"32'5823","reported_seq":"8053","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.317824+0000","last_change":"2020-07-01T06:05:12.716513+0000","last_active":"2020-07-01T06:08:09.317824+0000","last_peered":"2020-07-01T06:08:09.317824+0000","last_clean":"2020-07-01T06:08:09.317824+0000","last_became_active":"2020-07-01T06:05:12.716139+0000","last_became_peered":"2020-07-01T06:05:12.716139+0000","last_unstale":"2020-07-01T06:08:09.317824+0000","last_undegraded":"2020-07-01T06:08:09.317824+0000","last_fullsized":"2020-07-01T06:08:09.317824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5823,"ondisk_log_size":5823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99175935,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":1958,"num_read_kb":977,"num_write":5128,"num_write_kb":1180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3950,"num_flush":923,"num_flush_kb":2707853,"num_evict":836,"num_evict_kb":2447891,"num_promote":1022,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6573","reported_seq":"8565","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.769540+0000","last_change":"2020-07-01T06:05:10.793817+0000","last_active":"2020-07-01T06:08:11.769540+0000","last_peered":"2020-07-01T06:08:11.769540+0000","last_clean":"2020-07-01T06:08:11.769540+0000","last_became_active":"2020-07-01T06:05:10.793341+0000","last_became_peered":"2020-07-01T06:05:10.793341+0000","last_unstale":"2020-07-01T06:08:11.769540+0000","last_undegraded":"2020-07-01T06:08:11.769540+0000","last_fullsized":"2020-07-01T06:08:11.769540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6573,"ondisk_log_size":6573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7291163600,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":3628,"num_read_kb":287818,"num_write":8172,"num_write_kb":4646077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762140+0000","last_change":"2020-07-01T06:05:02.700518+0000","last_active":"2020-07-01T06:07:47.762140+0000","last_peered":"2020-07-01T06:07:47.762140+0000","last_clean":"2020-07-01T06:07:47.762140+0000","last_became_active":"2020-07-01T06:05:02.700021+0000","last_became_peered":"2020-07-01T06:05:02.700021+0000","last_unstale":"2020-07-01T06:07:47.762140+0000","last_undegraded":"2020-07-01T06:07:47.762140+0000","last_fullsized":"2020-07-01T06:07:47.762140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762255+0000","last_change":"2020-07-01T06:05:02.701920+0000","last_active":"2020-07-01T06:07:47.762255+0000","last_peered":"2020-07-01T06:07:47.762255+0000","last_clean":"2020-07-01T06:07:47.762255+0000","last_became_active":"2020-07-01T06:05:02.701535+0000","last_became_peered":"2020-07-01T06:05:02.701535+0000","last_unstale":"2020-07-01T06:07:47.762255+0000","last_undegraded":"2020-07-01T06:07:47.762255+0000","last_fullsized":"2020-07-01T06:07:47.762255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761267+0000","last_change":"2020-07-01T06:05:03.040661+0000","last_active":"2020-07-01T06:07:47.761267+0000","last_peered":"2020-07-01T06:07:47.761267+0000","last_clean":"2020-07-01T06:07:47.761267+0000","last_became_active":"2020-07-01T06:05:03.040253+0000","last_became_peered":"2020-07-01T06:05:03.040253+0000","last_unstale":"2020-07-01T06:07:47.761267+0000","last_undegraded":"2020-07-01T06:07:47.761267+0000","last_fullsized":"2020-07-01T06:07:47.761267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":432015818,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":37,"num_read":7698,"num_read_kb":3769,"num_write":19912,"num_write_kb":4685754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":680017920,"data_stored":678280898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22527,"ondisk_log_size":22527,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29720965032,"num_objects":9937,"num_object_clones":0,"num_object_copies":19874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9937,"num_whiteouts":0,"num_read":15125,"num_read_kb":1346589,"num_write":33103,"num_write_kb":19229283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38718308352,"data_stored":38572757424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26674,"ondisk_log_size":26674,"up":8,"acting":8,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10616748,"kb_used_data":9555644,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83755092,"statfs":{"total":96636764160,"available":85765214208,"internally_reserved":1073741824,"allocated":9784979456,"data_stored":9748301686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.224},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.999}]},{"osd":1,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.83599999999999997,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.60499999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.407,"15min":1.407},"last":1.03}]},{"osd":2,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.89900000000000002,"15min":0.874},"min":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.0129999999999999,"15min":0.98999999999999999},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.2949999999999999,"5min":6.2949999999999999,"15min":6.2949999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.97999999999999998,"15min":0.98399999999999999},"min":{"1min":0.60699999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4319999999999999,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":4,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.036},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4099999999999999,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1220000000000001,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.89200000000000002}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.282,"5min":1.488,"15min":1.488},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80200000000000005,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.145,"5min":1.387,"15min":1.387},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.214,"5min":1.0029999999999999,"15min":0.97599999999999998},"min":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.98999999999999999}]},{"osd":3,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":2.339,"15min":2.339},"last":1.121},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0800000000000001,"15min":1.0820000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.498,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.323}]},{"osd":5,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4219999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.141,"15min":1.143},"min":{"1min":0.96399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.452,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.3460000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5642524,"kb_used_data":4578092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":88729316,"statfs":{"total":96636764160,"available":90858819584,"internally_reserved":1073741824,"allocated":4687966208,"data_stored":4669691355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.81699999999999995,"15min":0.88400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0569999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1890000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.82099999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:09 2020","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2490000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.876},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85899999999999999,"15min":0.873},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9119999999999999,"5min":3.298,"15min":3.298},"last":1.159},{"interface":"front","average":{"1min":1.01,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64900000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.367,"5min":1.395,"15min":1.395},"last":1.0289999999999999}]},{"osd":4,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92300000000000004,"15min":0.93200000000000005},"min":{"1min":0.65100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.673,"15min":1.673},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.90600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0840000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0960000000000001,"15min":1.097},"min":{"1min":0.76100000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5009999999999999,"5min":1.883,"15min":1.883},"last":0.998}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10796920,"kb_used_data":9747172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83574920,"statfs":{"total":96636764160,"available":85580718080,"internally_reserved":1073741824,"allocated":9981104128,"data_stored":9944000252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.876,"15min":0.81999999999999995},"min":{"1min":0.65600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.81699999999999995,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.626}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.96399999999999997,"15min":0.95599999999999996},"min":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.107},{"interface":"front","average":{"1min":1.214,"5min":1.0389999999999999,"15min":1.044},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.751}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.054,"15min":1.006},"min":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94799999999999995,"15min":0.91500000000000004},"min":{"1min":0.72199999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.038,"15min":1.018},"min":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.224,"15min":1.246},"min":{"1min":0.88,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.9540000000000002,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.2509999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.878,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.1799999999999997,"5min":7.1799999999999997,"15min":7.1799999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.83399999999999996,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.745},{"interface":"front","average":{"1min":1.079,"5min":1.0649999999999999,"15min":1.0900000000000001},"min":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.008}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"min":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.21,"5min":1.1659999999999999,"15min":1.1879999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.153}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.02,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.117,"15min":1.1439999999999999},"min":{"1min":0.78200000000000003,"5min":0.745,"15min":0.745},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.92600000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15378608,"kb_used_data":14296216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":78993232,"statfs":{"total":96636764160,"available":80889069568,"internally_reserved":1073741824,"allocated":14639325184,"data_stored":14583979007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64000000000000001,"15min":0.67800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.496},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.343,"15min":1.343},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7070000000000001,"5min":2.004,"15min":2.004},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.621},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.478,"5min":1.841,"15min":1.841},"last":1.042}]},{"osd":5,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6699999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.117},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.415,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.022}]}]}]}}

2020-07-02T03:26:42.033 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:09:20.831 INFO:tasks.ceph:Checking cluster log for badness...
, 2020-07-01T06:09:20.832 INFO:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1
, 2020-07-01T06:09:20.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com

2020-07-02T03:26:42.034 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:04.152 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.035 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 179 M
, 2020-07-01T06:11:08.889 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check

2020-07-02T03:26:42.036 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:14.404 INFO:teuthology.orchestra.run.smithi042.stdout:  Preparing        :                                                        1/1
, 2020-07-01T06:11:14.434 INFO:teuthology.orchestra.run.smithi042.stdout:  Running scriptlet: ceph-2:15.2.4-4.gabcb13a.el8.x86_64                    1/1
, 2020-07-01T06:11:14.490 INFO:teuthology.orchestra.run.smithi019.stdout:  Preparing        :                                                        1/1

2020-07-02T03:26:42.036 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.037 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.044 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.4-4.gabcb13a.   15/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d   16/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: rbd-mirror-2:15.2.4-4.gabcb13a.el8.x86_64            17/81

2020-07-02T03:26:42.044 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy
, 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:32.048 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-html5lib-1:0.999999999-6.el8.noarch          59/81

2020-07-02T03:26:42.045 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:51.579 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-babel-2.5.1-5.el8.noarch                     26/81
, 2020-07-01T06:11:51.580 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-bcrypt-3.1.6-2.el8.1.x86_64                  27/81
, 2020-07-01T06:11:51.600 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          28/81

2020-07-02T03:26:42.046 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:53.977 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-cachetools-3.1.1-4.el8.noarch                29/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-argparse-2:15.2.4-4.gabcb13a.el8.x86_   30/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-common-2:15.2.4-4.gabcb13a.el8.x86_64   31/81

2020-07-02T03:26:42.046 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:55.468 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-lxml-4.2.3-1.el8.x86_64
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-mako-1.0.6-13.el8.noarch
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-markupsafe-0.23-19.el8.x86_64

2020-07-02T03:26:42.047 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cheroot-8.2.1-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cherrypy-18.4.0-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cssselect-0.9.2-10.el8.noarch

2020-07-02T03:26:42.048 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Remove  1 Package
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 721 k

2020-07-02T03:26:42.048 WARNING:scrape:Ignoring malparsed backtrace:   - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64
, No packages marked for removal.
, 2020-07-01T06:12:09.857 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-rook

2020-07-02T03:26:42.049 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: Package    Arch   Version                 Repository                      Size
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.050 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 2.1 M
, 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check
, 2020-07-01T06:12:20.022 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded.

2020-07-02T03:26:42.050 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : fmt-6.2.1-1.el8.x86_64                                 6/7
, 2020-07-01T06:12:25.450 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : lttng-ust-2.8.1-11.el8.x86_64                          7/7
, Modular dependency problem:

2020-07-02T03:26:42.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:30.980 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:31.389 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:12:31.390 INFO:teuthology.orchestra.run.smithi042.stdout:Removed:

2020-07-02T03:26:42.051 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do.
, 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:37.229 INFO:teuthology.orchestra.run.smithi019.stdout:Updating Subscription Management repositories.

2020-07-02T03:26:42.052 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:210 Number of sources = 4
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:===============================================================================

2020-07-02T03:26:42.053 WARNING:scrape:Ignoring malparsed backtrace:     node=self.hostname, label=self.label
, teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'which ceph_test_rados'
, 2020-07-01T06:13:05.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload

2020-07-02T03:26:42.192 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 15.2.4-4-gabcb13a (abcb13ae4e01e1d30857c98a01d0916e952030b9) octopus (stable)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f4317695afc]
,  2: (()+0x276d16) [0x7f4317695d16]

2020-07-02T03:26:42.195 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:08:18.993 INFO:teuthology.orchestra.run.smithi042.stdout:
, dumped all
, 2020-07-01T06:08:19.005 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2020-07-01T06:08:17.308951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30152980850,"num_objects":10142,"num_object_clones":0,"num_object_copies":20284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10115,"num_whiteouts":37,"num_read":22823,"num_read_kb":1350358,"num_write":53015,"num_write_kb":23915037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49201,"ondisk_log_size":49201,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":44867848,"kb_used_data":38477572,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":521363192,"statfs":{"total":579820584960,"available":533875908608,"internally_reserved":6442450944,"allocated":39401033728,"data_stored":39252435110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":107914797,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":1042,"num_read_kb":972772,"num_write":580,"num_write_kb":388950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":529,"num_flush":86,"num_flush_kb":243095,"num_evict":29,"num_evict_kb":78346,"num_promote":109,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764251+0000","last_change":"2020-07-01T06:05:03.040752+0000","last_active":"2020-07-01T06:07:47.764251+0000","last_peered":"2020-07-01T06:07:47.764251+0000","last_clean":"2020-07-01T06:07:47.764251+0000","last_became_active":"2020-07-01T06:05:03.040287+0000","last_became_peered":"2020-07-01T06:05:03.040287+0000","last_unstale":"2020-07-01T06:07:47.764251+0000","last_undegraded":"2020-07-01T06:07:47.764251+0000","last_fullsized":"2020-07-01T06:07:47.764251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761306+0000","last_change":"2020-07-01T06:05:03.066148+0000","last_active":"2020-07-01T06:07:47.761306+0000","last_peered":"2020-07-01T06:07:47.761306+0000","last_clean":"2020-07-01T06:07:47.761306+0000","last_became_active":"2020-07-01T06:05:03.065647+0000","last_became_peered":"2020-07-01T06:05:03.065647+0000","last_unstale":"2020-07-01T06:07:47.761306+0000","last_undegraded":"2020-07-01T06:07:47.761306+0000","last_fullsized":"2020-07-01T06:07:47.761306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5773","reported_seq":"7987","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.705740+0000","last_change":"2020-07-01T06:05:12.715597+0000","last_active":"2020-07-01T06:08:09.705740+0000","last_peered":"2020-07-01T06:08:09.705740+0000","last_clean":"2020-07-01T06:08:09.705740+0000","last_became_active":"2020-07-01T06:05:12.715286+0000","last_became_peered":"2020-07-01T06:05:12.715286+0000","last_unstale":"2020-07-01T06:08:09.705740+0000","last_undegraded":"2020-07-01T06:08:09.705740+0000","last_fullsized":"2020-07-01T06:08:09.705740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5773,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":98787888,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1952,"num_read_kb":971,"num_write":5064,"num_write_kb":1170992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3949,"num_flush":917,"num_flush_kb":2673482,"num_evict":838,"num_evict_kb":2438479,"num_promote":1026,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'6599","reported_seq":"8688","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.427521+0000","last_change":"2020-07-01T06:05:10.793859+0000","last_active":"2020-07-01T06:08:12.427521+0000","last_peered":"2020-07-01T06:08:12.427521+0000","last_clean":"2020-07-01T06:08:12.427521+0000","last_became_active":"2020-07-01T06:05:10.793445+0000","last_became_peered":"2020-07-01T06:05:10.793445+0000","last_unstale":"2020-07-01T06:08:12.427521+0000","last_undegraded":"2020-07-01T06:08:12.427521+0000","last_fullsized":"2020-07-01T06:08:12.427521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6599,"ondisk_log_size":6599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7351542432,"num_objects":2460,"num_object_clones":0,"num_object_copies":4920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2460,"num_whiteouts":0,"num_read":3711,"num_read_kb":319158,"num_write":8205,"num_write_kb":4718998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764187+0000","last_change":"2020-07-01T06:05:03.065634+0000","last_active":"2020-07-01T06:07:47.764187+0000","last_peered":"2020-07-01T06:07:47.764187+0000","last_clean":"2020-07-01T06:07:47.764187+0000","last_became_active":"2020-07-01T06:05:03.065163+0000","last_became_peered":"2020-07-01T06:05:03.065163+0000","last_unstale":"2020-07-01T06:07:47.764187+0000","last_undegraded":"2020-07-01T06:07:47.764187+0000","last_fullsized":"2020-07-01T06:07:47.764187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"33'5471","reported_seq":"7554","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.034923+0000","last_change":"2020-07-01T06:05:13.058750+0000","last_active":"2020-07-01T06:08:11.034923+0000","last_peered":"2020-07-01T06:08:11.034923+0000","last_clean":"2020-07-01T06:08:11.034923+0000","last_became_active":"2020-07-01T06:05:13.058349+0000","last_became_peered":"2020-07-01T06:05:13.058349+0000","last_unstale":"2020-07-01T06:08:11.034923+0000","last_undegraded":"2020-07-01T06:08:11.034923+0000","last_fullsized":"2020-07-01T06:08:11.034923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5471,"ondisk_log_size":5471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113457335,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":8,"num_read":1887,"num_read_kb":921,"num_write":4892,"num_write_kb":1195597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2644,"num_flush":870,"num_flush_kb":2557735,"num_evict":793,"num_evict_kb":2323729,"num_promote":959,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'6666","reported_seq":"8856","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.439313+0000","last_change":"2020-07-01T06:05:10.712962+0000","last_active":"2020-07-01T06:08:12.439313+0000","last_peered":"2020-07-01T06:08:12.439313+0000","last_clean":"2020-07-01T06:08:12.439313+0000","last_became_active":"2020-07-01T06:05:10.712567+0000","last_became_peered":"2020-07-01T06:05:10.712567+0000","last_unstale":"2020-07-01T06:08:12.439313+0000","last_undegraded":"2020-07-01T06:08:12.439313+0000","last_fullsized":"2020-07-01T06:08:12.439313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6666,"ondisk_log_size":6666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7457514421,"num_objects":2502,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2502,"num_whiteouts":0,"num_read":3789,"num_read_kb":286792,"num_write":8256,"num_write_kb":4887786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761389+0000","last_change":"2020-07-01T06:05:03.066158+0000","last_active":"2020-07-01T06:07:47.761389+0000","last_peered":"2020-07-01T06:07:47.761389+0000","last_clean":"2020-07-01T06:07:47.761389+0000","last_became_active":"2020-07-01T06:05:03.065602+0000","last_became_peered":"2020-07-01T06:05:03.065602+0000","last_unstale":"2020-07-01T06:07:47.761389+0000","last_undegraded":"2020-07-01T06:07:47.761389+0000","last_fullsized":"2020-07-01T06:07:47.761389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"33'5460","reported_seq":"7629","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.284048+0000","last_change":"2020-07-01T06:05:13.057409+0000","last_active":"2020-07-01T06:08:11.284048+0000","last_peered":"2020-07-01T06:08:11.284048+0000","last_clean":"2020-07-01T06:08:11.284048+0000","last_became_active":"2020-07-01T06:05:13.056913+0000","last_became_peered":"2020-07-01T06:05:13.056913+0000","last_unstale":"2020-07-01T06:08:11.284048+0000","last_undegraded":"2020-07-01T06:08:11.284048+0000","last_fullsized":"2020-07-01T06:08:11.284048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5460,"ondisk_log_size":5460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120594660,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":7,"num_read":1901,"num_read_kb":900,"num_write":4828,"num_write_kb":1138749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":2977,"num_flush":850,"num_flush_kb":2461298,"num_evict":712,"num_evict_kb":2056075,"num_promote":929,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'6836","reported_seq":"9123","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.417167+0000","last_change":"2020-07-01T06:05:10.793572+0000","last_active":"2020-07-01T06:08:12.417167+0000","last_peered":"2020-07-01T06:08:12.417167+0000","last_clean":"2020-07-01T06:08:12.417167+0000","last_became_active":"2020-07-01T06:05:10.793143+0000","last_became_peered":"2020-07-01T06:05:10.793143+0000","last_unstale":"2020-07-01T06:08:12.417167+0000","last_undegraded":"2020-07-01T06:08:12.417167+0000","last_fullsized":"2020-07-01T06:08:12.417167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6836,"ondisk_log_size":6836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7620744579,"num_objects":2547,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2547,"num_whiteouts":0,"num_read":3997,"num_read_kb":452821,"num_write":8470,"num_write_kb":4976422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761482+0000","last_change":"2020-07-01T06:05:03.066066+0000","last_active":"2020-07-01T06:07:47.761482+0000","last_peered":"2020-07-01T06:07:47.761482+0000","last_clean":"2020-07-01T06:07:47.761482+0000","last_became_active":"2020-07-01T06:05:03.065610+0000","last_became_peered":"2020-07-01T06:05:03.065610+0000","last_unstale":"2020-07-01T06:07:47.761482+0000","last_undegraded":"2020-07-01T06:07:47.761482+0000","last_fullsized":"2020-07-01T06:07:47.761482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"32'5823","reported_seq":"8053","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.317824+0000","last_change":"2020-07-01T06:05:12.716513+0000","last_active":"2020-07-01T06:08:09.317824+0000","last_peered":"2020-07-01T06:08:09.317824+0000","last_clean":"2020-07-01T06:08:09.317824+0000","last_became_active":"2020-07-01T06:05:12.716139+0000","last_became_peered":"2020-07-01T06:05:12.716139+0000","last_unstale":"2020-07-01T06:08:09.317824+0000","last_undegraded":"2020-07-01T06:08:09.317824+0000","last_fullsized":"2020-07-01T06:08:09.317824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5823,"ondisk_log_size":5823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99175935,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":1958,"num_read_kb":977,"num_write":5128,"num_write_kb":1180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3950,"num_flush":923,"num_flush_kb":2707853,"num_evict":836,"num_evict_kb":2447891,"num_promote":1022,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6573","reported_seq":"8565","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.769540+0000","last_change":"2020-07-01T06:05:10.793817+0000","last_active":"2020-07-01T06:08:11.769540+0000","last_peered":"2020-07-01T06:08:11.769540+0000","last_clean":"2020-07-01T06:08:11.769540+0000","last_became_active":"2020-07-01T06:05:10.793341+0000","last_became_peered":"2020-07-01T06:05:10.793341+0000","last_unstale":"2020-07-01T06:08:11.769540+0000","last_undegraded":"2020-07-01T06:08:11.769540+0000","last_fullsized":"2020-07-01T06:08:11.769540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6573,"ondisk_log_size":6573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7291163600,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":3628,"num_read_kb":287818,"num_write":8172,"num_write_kb":4646077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762140+0000","last_change":"2020-07-01T06:05:02.700518+0000","last_active":"2020-07-01T06:07:47.762140+0000","last_peered":"2020-07-01T06:07:47.762140+0000","last_clean":"2020-07-01T06:07:47.762140+0000","last_became_active":"2020-07-01T06:05:02.700021+0000","last_became_peered":"2020-07-01T06:05:02.700021+0000","last_unstale":"2020-07-01T06:07:47.762140+0000","last_undegraded":"2020-07-01T06:07:47.762140+0000","last_fullsized":"2020-07-01T06:07:47.762140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762255+0000","last_change":"2020-07-01T06:05:02.701920+0000","last_active":"2020-07-01T06:07:47.762255+0000","last_peered":"2020-07-01T06:07:47.762255+0000","last_clean":"2020-07-01T06:07:47.762255+0000","last_became_active":"2020-07-01T06:05:02.701535+0000","last_became_peered":"2020-07-01T06:05:02.701535+0000","last_unstale":"2020-07-01T06:07:47.762255+0000","last_undegraded":"2020-07-01T06:07:47.762255+0000","last_fullsized":"2020-07-01T06:07:47.762255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761267+0000","last_change":"2020-07-01T06:05:03.040661+0000","last_active":"2020-07-01T06:07:47.761267+0000","last_peered":"2020-07-01T06:07:47.761267+0000","last_clean":"2020-07-01T06:07:47.761267+0000","last_became_active":"2020-07-01T06:05:03.040253+0000","last_became_peered":"2020-07-01T06:05:03.040253+0000","last_unstale":"2020-07-01T06:07:47.761267+0000","last_undegraded":"2020-07-01T06:07:47.761267+0000","last_fullsized":"2020-07-01T06:07:47.761267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":432015818,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":37,"num_read":7698,"num_read_kb":3769,"num_write":19912,"num_write_kb":4685754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":680017920,"data_stored":678280898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22527,"ondisk_log_size":22527,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29720965032,"num_objects":9937,"num_object_clones":0,"num_object_copies":19874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9937,"num_whiteouts":0,"num_read":15125,"num_read_kb":1346589,"num_write":33103,"num_write_kb":19229283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38718308352,"data_stored":38572757424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26674,"ondisk_log_size":26674,"up":8,"acting":8,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10616748,"kb_used_data":9555644,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83755092,"statfs":{"total":96636764160,"available":85765214208,"internally_reserved":1073741824,"allocated":9784979456,"data_stored":9748301686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.224},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.999}]},{"osd":1,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.83599999999999997,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.60499999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.407,"15min":1.407},"last":1.03}]},{"osd":2,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.89900000000000002,"15min":0.874},"min":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.0129999999999999,"15min":0.98999999999999999},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.2949999999999999,"5min":6.2949999999999999,"15min":6.2949999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.97999999999999998,"15min":0.98399999999999999},"min":{"1min":0.60699999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4319999999999999,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":4,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.036},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4099999999999999,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1220000000000001,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.89200000000000002}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.282,"5min":1.488,"15min":1.488},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80200000000000005,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.145,"5min":1.387,"15min":1.387},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.214,"5min":1.0029999999999999,"15min":0.97599999999999998},"min":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.98999999999999999}]},{"osd":3,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":2.339,"15min":2.339},"last":1.121},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0800000000000001,"15min":1.0820000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.498,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.323}]},{"osd":5,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4219999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.141,"15min":1.143},"min":{"1min":0.96399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.452,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.3460000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5642524,"kb_used_data":4578092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":88729316,"statfs":{"total":96636764160,"available":90858819584,"internally_reserved":1073741824,"allocated":4687966208,"data_stored":4669691355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.81699999999999995,"15min":0.88400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0569999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1890000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.82099999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:09 2020","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2490000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.876},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85899999999999999,"15min":0.873},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9119999999999999,"5min":3.298,"15min":3.298},"last":1.159},{"interface":"front","average":{"1min":1.01,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64900000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.367,"5min":1.395,"15min":1.395},"last":1.0289999999999999}]},{"osd":4,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92300000000000004,"15min":0.93200000000000005},"min":{"1min":0.65100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.673,"15min":1.673},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.90600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0840000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0960000000000001,"15min":1.097},"min":{"1min":0.76100000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5009999999999999,"5min":1.883,"15min":1.883},"last":0.998}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10796920,"kb_used_data":9747172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83574920,"statfs":{"total":96636764160,"available":85580718080,"internally_reserved":1073741824,"allocated":9981104128,"data_stored":9944000252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.876,"15min":0.81999999999999995},"min":{"1min":0.65600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.81699999999999995,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.626}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.96399999999999997,"15min":0.95599999999999996},"min":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.107},{"interface":"front","average":{"1min":1.214,"5min":1.0389999999999999,"15min":1.044},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.751}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.054,"15min":1.006},"min":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94799999999999995,"15min":0.91500000000000004},"min":{"1min":0.72199999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.038,"15min":1.018},"min":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.224,"15min":1.246},"min":{"1min":0.88,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.9540000000000002,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.2509999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.878,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.1799999999999997,"5min":7.1799999999999997,"15min":7.1799999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.83399999999999996,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.745},{"interface":"front","average":{"1min":1.079,"5min":1.0649999999999999,"15min":1.0900000000000001},"min":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.008}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"min":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.21,"5min":1.1659999999999999,"15min":1.1879999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.153}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.02,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.117,"15min":1.1439999999999999},"min":{"1min":0.78200000000000003,"5min":0.745,"15min":0.745},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.92600000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15378608,"kb_used_data":14296216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":78993232,"statfs":{"total":96636764160,"available":80889069568,"internally_reserved":1073741824,"allocated":14639325184,"data_stored":14583979007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64000000000000001,"15min":0.67800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.496},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.343,"15min":1.343},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7070000000000001,"5min":2.004,"15min":2.004},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.621},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.478,"5min":1.841,"15min":1.841},"last":1.042}]},{"osd":5,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6699999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.117},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.415,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.022}]}]}]}}

2020-07-02T03:26:42.197 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:09:20.831 INFO:tasks.ceph:Checking cluster log for badness...
, 2020-07-01T06:09:20.832 INFO:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1
, 2020-07-01T06:09:20.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com

2020-07-02T03:26:42.198 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:04.152 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.198 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 179 M
, 2020-07-01T06:11:08.889 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check

2020-07-02T03:26:42.199 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:14.404 INFO:teuthology.orchestra.run.smithi042.stdout:  Preparing        :                                                        1/1
, 2020-07-01T06:11:14.434 INFO:teuthology.orchestra.run.smithi042.stdout:  Running scriptlet: ceph-2:15.2.4-4.gabcb13a.el8.x86_64                    1/1
, 2020-07-01T06:11:14.490 INFO:teuthology.orchestra.run.smithi019.stdout:  Preparing        :                                                        1/1

2020-07-02T03:26:42.200 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.200 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.201 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.4-4.gabcb13a.   15/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d   16/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: rbd-mirror-2:15.2.4-4.gabcb13a.el8.x86_64            17/81

2020-07-02T03:26:42.202 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy
, 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:32.048 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-html5lib-1:0.999999999-6.el8.noarch          59/81

2020-07-02T03:26:42.202 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:51.579 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-babel-2.5.1-5.el8.noarch                     26/81
, 2020-07-01T06:11:51.580 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-bcrypt-3.1.6-2.el8.1.x86_64                  27/81
, 2020-07-01T06:11:51.600 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          28/81

2020-07-02T03:26:42.203 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:53.977 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-cachetools-3.1.1-4.el8.noarch                29/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-argparse-2:15.2.4-4.gabcb13a.el8.x86_   30/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-common-2:15.2.4-4.gabcb13a.el8.x86_64   31/81

2020-07-02T03:26:42.204 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:55.468 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-lxml-4.2.3-1.el8.x86_64
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-mako-1.0.6-13.el8.noarch
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-markupsafe-0.23-19.el8.x86_64

2020-07-02T03:26:42.204 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cheroot-8.2.1-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cherrypy-18.4.0-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cssselect-0.9.2-10.el8.noarch

2020-07-02T03:26:42.205 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Remove  1 Package
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 721 k

2020-07-02T03:26:42.206 WARNING:scrape:Ignoring malparsed backtrace:   - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64
, No packages marked for removal.
, 2020-07-01T06:12:09.857 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-rook

2020-07-02T03:26:42.206 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: Package    Arch   Version                 Repository                      Size
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.207 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 2.1 M
, 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check
, 2020-07-01T06:12:20.022 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded.

2020-07-02T03:26:42.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : fmt-6.2.1-1.el8.x86_64                                 6/7
, 2020-07-01T06:12:25.450 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : lttng-ust-2.8.1-11.el8.x86_64                          7/7
, Modular dependency problem:

2020-07-02T03:26:42.208 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:30.980 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:31.389 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:12:31.390 INFO:teuthology.orchestra.run.smithi042.stdout:Removed:

2020-07-02T03:26:42.209 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do.
, 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:37.229 INFO:teuthology.orchestra.run.smithi019.stdout:Updating Subscription Management repositories.

2020-07-02T03:26:42.209 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:210 Number of sources = 4
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:===============================================================================

2020-07-02T03:26:42.210 WARNING:scrape:Ignoring malparsed backtrace:     node=self.hostname, label=self.label
, teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'which ceph_test_rados'
, 2020-07-01T06:13:05.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload

2020-07-02T03:26:42.383 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 15.2.4-4-gabcb13a (abcb13ae4e01e1d30857c98a01d0916e952030b9) octopus (stable)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f4317695afc]
,  2: (()+0x276d16) [0x7f4317695d16]

2020-07-02T03:26:42.386 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:08:18.993 INFO:teuthology.orchestra.run.smithi042.stdout:
, dumped all
, 2020-07-01T06:08:19.005 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2020-07-01T06:08:17.308951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30152980850,"num_objects":10142,"num_object_clones":0,"num_object_copies":20284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10115,"num_whiteouts":37,"num_read":22823,"num_read_kb":1350358,"num_write":53015,"num_write_kb":23915037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49201,"ondisk_log_size":49201,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":44867848,"kb_used_data":38477572,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":521363192,"statfs":{"total":579820584960,"available":533875908608,"internally_reserved":6442450944,"allocated":39401033728,"data_stored":39252435110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":107914797,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":1042,"num_read_kb":972772,"num_write":580,"num_write_kb":388950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":529,"num_flush":86,"num_flush_kb":243095,"num_evict":29,"num_evict_kb":78346,"num_promote":109,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764251+0000","last_change":"2020-07-01T06:05:03.040752+0000","last_active":"2020-07-01T06:07:47.764251+0000","last_peered":"2020-07-01T06:07:47.764251+0000","last_clean":"2020-07-01T06:07:47.764251+0000","last_became_active":"2020-07-01T06:05:03.040287+0000","last_became_peered":"2020-07-01T06:05:03.040287+0000","last_unstale":"2020-07-01T06:07:47.764251+0000","last_undegraded":"2020-07-01T06:07:47.764251+0000","last_fullsized":"2020-07-01T06:07:47.764251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761306+0000","last_change":"2020-07-01T06:05:03.066148+0000","last_active":"2020-07-01T06:07:47.761306+0000","last_peered":"2020-07-01T06:07:47.761306+0000","last_clean":"2020-07-01T06:07:47.761306+0000","last_became_active":"2020-07-01T06:05:03.065647+0000","last_became_peered":"2020-07-01T06:05:03.065647+0000","last_unstale":"2020-07-01T06:07:47.761306+0000","last_undegraded":"2020-07-01T06:07:47.761306+0000","last_fullsized":"2020-07-01T06:07:47.761306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5773","reported_seq":"7987","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.705740+0000","last_change":"2020-07-01T06:05:12.715597+0000","last_active":"2020-07-01T06:08:09.705740+0000","last_peered":"2020-07-01T06:08:09.705740+0000","last_clean":"2020-07-01T06:08:09.705740+0000","last_became_active":"2020-07-01T06:05:12.715286+0000","last_became_peered":"2020-07-01T06:05:12.715286+0000","last_unstale":"2020-07-01T06:08:09.705740+0000","last_undegraded":"2020-07-01T06:08:09.705740+0000","last_fullsized":"2020-07-01T06:08:09.705740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5773,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":98787888,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1952,"num_read_kb":971,"num_write":5064,"num_write_kb":1170992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3949,"num_flush":917,"num_flush_kb":2673482,"num_evict":838,"num_evict_kb":2438479,"num_promote":1026,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'6599","reported_seq":"8688","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.427521+0000","last_change":"2020-07-01T06:05:10.793859+0000","last_active":"2020-07-01T06:08:12.427521+0000","last_peered":"2020-07-01T06:08:12.427521+0000","last_clean":"2020-07-01T06:08:12.427521+0000","last_became_active":"2020-07-01T06:05:10.793445+0000","last_became_peered":"2020-07-01T06:05:10.793445+0000","last_unstale":"2020-07-01T06:08:12.427521+0000","last_undegraded":"2020-07-01T06:08:12.427521+0000","last_fullsized":"2020-07-01T06:08:12.427521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6599,"ondisk_log_size":6599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7351542432,"num_objects":2460,"num_object_clones":0,"num_object_copies":4920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2460,"num_whiteouts":0,"num_read":3711,"num_read_kb":319158,"num_write":8205,"num_write_kb":4718998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764187+0000","last_change":"2020-07-01T06:05:03.065634+0000","last_active":"2020-07-01T06:07:47.764187+0000","last_peered":"2020-07-01T06:07:47.764187+0000","last_clean":"2020-07-01T06:07:47.764187+0000","last_became_active":"2020-07-01T06:05:03.065163+0000","last_became_peered":"2020-07-01T06:05:03.065163+0000","last_unstale":"2020-07-01T06:07:47.764187+0000","last_undegraded":"2020-07-01T06:07:47.764187+0000","last_fullsized":"2020-07-01T06:07:47.764187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"33'5471","reported_seq":"7554","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.034923+0000","last_change":"2020-07-01T06:05:13.058750+0000","last_active":"2020-07-01T06:08:11.034923+0000","last_peered":"2020-07-01T06:08:11.034923+0000","last_clean":"2020-07-01T06:08:11.034923+0000","last_became_active":"2020-07-01T06:05:13.058349+0000","last_became_peered":"2020-07-01T06:05:13.058349+0000","last_unstale":"2020-07-01T06:08:11.034923+0000","last_undegraded":"2020-07-01T06:08:11.034923+0000","last_fullsized":"2020-07-01T06:08:11.034923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5471,"ondisk_log_size":5471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113457335,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":8,"num_read":1887,"num_read_kb":921,"num_write":4892,"num_write_kb":1195597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2644,"num_flush":870,"num_flush_kb":2557735,"num_evict":793,"num_evict_kb":2323729,"num_promote":959,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'6666","reported_seq":"8856","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.439313+0000","last_change":"2020-07-01T06:05:10.712962+0000","last_active":"2020-07-01T06:08:12.439313+0000","last_peered":"2020-07-01T06:08:12.439313+0000","last_clean":"2020-07-01T06:08:12.439313+0000","last_became_active":"2020-07-01T06:05:10.712567+0000","last_became_peered":"2020-07-01T06:05:10.712567+0000","last_unstale":"2020-07-01T06:08:12.439313+0000","last_undegraded":"2020-07-01T06:08:12.439313+0000","last_fullsized":"2020-07-01T06:08:12.439313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6666,"ondisk_log_size":6666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7457514421,"num_objects":2502,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2502,"num_whiteouts":0,"num_read":3789,"num_read_kb":286792,"num_write":8256,"num_write_kb":4887786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761389+0000","last_change":"2020-07-01T06:05:03.066158+0000","last_active":"2020-07-01T06:07:47.761389+0000","last_peered":"2020-07-01T06:07:47.761389+0000","last_clean":"2020-07-01T06:07:47.761389+0000","last_became_active":"2020-07-01T06:05:03.065602+0000","last_became_peered":"2020-07-01T06:05:03.065602+0000","last_unstale":"2020-07-01T06:07:47.761389+0000","last_undegraded":"2020-07-01T06:07:47.761389+0000","last_fullsized":"2020-07-01T06:07:47.761389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"33'5460","reported_seq":"7629","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.284048+0000","last_change":"2020-07-01T06:05:13.057409+0000","last_active":"2020-07-01T06:08:11.284048+0000","last_peered":"2020-07-01T06:08:11.284048+0000","last_clean":"2020-07-01T06:08:11.284048+0000","last_became_active":"2020-07-01T06:05:13.056913+0000","last_became_peered":"2020-07-01T06:05:13.056913+0000","last_unstale":"2020-07-01T06:08:11.284048+0000","last_undegraded":"2020-07-01T06:08:11.284048+0000","last_fullsized":"2020-07-01T06:08:11.284048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5460,"ondisk_log_size":5460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120594660,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":7,"num_read":1901,"num_read_kb":900,"num_write":4828,"num_write_kb":1138749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":2977,"num_flush":850,"num_flush_kb":2461298,"num_evict":712,"num_evict_kb":2056075,"num_promote":929,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'6836","reported_seq":"9123","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.417167+0000","last_change":"2020-07-01T06:05:10.793572+0000","last_active":"2020-07-01T06:08:12.417167+0000","last_peered":"2020-07-01T06:08:12.417167+0000","last_clean":"2020-07-01T06:08:12.417167+0000","last_became_active":"2020-07-01T06:05:10.793143+0000","last_became_peered":"2020-07-01T06:05:10.793143+0000","last_unstale":"2020-07-01T06:08:12.417167+0000","last_undegraded":"2020-07-01T06:08:12.417167+0000","last_fullsized":"2020-07-01T06:08:12.417167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6836,"ondisk_log_size":6836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7620744579,"num_objects":2547,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2547,"num_whiteouts":0,"num_read":3997,"num_read_kb":452821,"num_write":8470,"num_write_kb":4976422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761482+0000","last_change":"2020-07-01T06:05:03.066066+0000","last_active":"2020-07-01T06:07:47.761482+0000","last_peered":"2020-07-01T06:07:47.761482+0000","last_clean":"2020-07-01T06:07:47.761482+0000","last_became_active":"2020-07-01T06:05:03.065610+0000","last_became_peered":"2020-07-01T06:05:03.065610+0000","last_unstale":"2020-07-01T06:07:47.761482+0000","last_undegraded":"2020-07-01T06:07:47.761482+0000","last_fullsized":"2020-07-01T06:07:47.761482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"32'5823","reported_seq":"8053","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.317824+0000","last_change":"2020-07-01T06:05:12.716513+0000","last_active":"2020-07-01T06:08:09.317824+0000","last_peered":"2020-07-01T06:08:09.317824+0000","last_clean":"2020-07-01T06:08:09.317824+0000","last_became_active":"2020-07-01T06:05:12.716139+0000","last_became_peered":"2020-07-01T06:05:12.716139+0000","last_unstale":"2020-07-01T06:08:09.317824+0000","last_undegraded":"2020-07-01T06:08:09.317824+0000","last_fullsized":"2020-07-01T06:08:09.317824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5823,"ondisk_log_size":5823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99175935,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":1958,"num_read_kb":977,"num_write":5128,"num_write_kb":1180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3950,"num_flush":923,"num_flush_kb":2707853,"num_evict":836,"num_evict_kb":2447891,"num_promote":1022,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6573","reported_seq":"8565","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.769540+0000","last_change":"2020-07-01T06:05:10.793817+0000","last_active":"2020-07-01T06:08:11.769540+0000","last_peered":"2020-07-01T06:08:11.769540+0000","last_clean":"2020-07-01T06:08:11.769540+0000","last_became_active":"2020-07-01T06:05:10.793341+0000","last_became_peered":"2020-07-01T06:05:10.793341+0000","last_unstale":"2020-07-01T06:08:11.769540+0000","last_undegraded":"2020-07-01T06:08:11.769540+0000","last_fullsized":"2020-07-01T06:08:11.769540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6573,"ondisk_log_size":6573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7291163600,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":3628,"num_read_kb":287818,"num_write":8172,"num_write_kb":4646077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762140+0000","last_change":"2020-07-01T06:05:02.700518+0000","last_active":"2020-07-01T06:07:47.762140+0000","last_peered":"2020-07-01T06:07:47.762140+0000","last_clean":"2020-07-01T06:07:47.762140+0000","last_became_active":"2020-07-01T06:05:02.700021+0000","last_became_peered":"2020-07-01T06:05:02.700021+0000","last_unstale":"2020-07-01T06:07:47.762140+0000","last_undegraded":"2020-07-01T06:07:47.762140+0000","last_fullsized":"2020-07-01T06:07:47.762140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762255+0000","last_change":"2020-07-01T06:05:02.701920+0000","last_active":"2020-07-01T06:07:47.762255+0000","last_peered":"2020-07-01T06:07:47.762255+0000","last_clean":"2020-07-01T06:07:47.762255+0000","last_became_active":"2020-07-01T06:05:02.701535+0000","last_became_peered":"2020-07-01T06:05:02.701535+0000","last_unstale":"2020-07-01T06:07:47.762255+0000","last_undegraded":"2020-07-01T06:07:47.762255+0000","last_fullsized":"2020-07-01T06:07:47.762255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761267+0000","last_change":"2020-07-01T06:05:03.040661+0000","last_active":"2020-07-01T06:07:47.761267+0000","last_peered":"2020-07-01T06:07:47.761267+0000","last_clean":"2020-07-01T06:07:47.761267+0000","last_became_active":"2020-07-01T06:05:03.040253+0000","last_became_peered":"2020-07-01T06:05:03.040253+0000","last_unstale":"2020-07-01T06:07:47.761267+0000","last_undegraded":"2020-07-01T06:07:47.761267+0000","last_fullsized":"2020-07-01T06:07:47.761267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":432015818,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":37,"num_read":7698,"num_read_kb":3769,"num_write":19912,"num_write_kb":4685754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":680017920,"data_stored":678280898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22527,"ondisk_log_size":22527,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29720965032,"num_objects":9937,"num_object_clones":0,"num_object_copies":19874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9937,"num_whiteouts":0,"num_read":15125,"num_read_kb":1346589,"num_write":33103,"num_write_kb":19229283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38718308352,"data_stored":38572757424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26674,"ondisk_log_size":26674,"up":8,"acting":8,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10616748,"kb_used_data":9555644,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83755092,"statfs":{"total":96636764160,"available":85765214208,"internally_reserved":1073741824,"allocated":9784979456,"data_stored":9748301686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.224},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.999}]},{"osd":1,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.83599999999999997,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.60499999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.407,"15min":1.407},"last":1.03}]},{"osd":2,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.89900000000000002,"15min":0.874},"min":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.0129999999999999,"15min":0.98999999999999999},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.2949999999999999,"5min":6.2949999999999999,"15min":6.2949999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.97999999999999998,"15min":0.98399999999999999},"min":{"1min":0.60699999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4319999999999999,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":4,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.036},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4099999999999999,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1220000000000001,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.89200000000000002}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.282,"5min":1.488,"15min":1.488},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80200000000000005,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.145,"5min":1.387,"15min":1.387},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.214,"5min":1.0029999999999999,"15min":0.97599999999999998},"min":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.98999999999999999}]},{"osd":3,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":2.339,"15min":2.339},"last":1.121},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0800000000000001,"15min":1.0820000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.498,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.323}]},{"osd":5,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4219999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.141,"15min":1.143},"min":{"1min":0.96399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.452,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.3460000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5642524,"kb_used_data":4578092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":88729316,"statfs":{"total":96636764160,"available":90858819584,"internally_reserved":1073741824,"allocated":4687966208,"data_stored":4669691355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.81699999999999995,"15min":0.88400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0569999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1890000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.82099999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:09 2020","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2490000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.876},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85899999999999999,"15min":0.873},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9119999999999999,"5min":3.298,"15min":3.298},"last":1.159},{"interface":"front","average":{"1min":1.01,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64900000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.367,"5min":1.395,"15min":1.395},"last":1.0289999999999999}]},{"osd":4,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92300000000000004,"15min":0.93200000000000005},"min":{"1min":0.65100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.673,"15min":1.673},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.90600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0840000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0960000000000001,"15min":1.097},"min":{"1min":0.76100000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5009999999999999,"5min":1.883,"15min":1.883},"last":0.998}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10796920,"kb_used_data":9747172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83574920,"statfs":{"total":96636764160,"available":85580718080,"internally_reserved":1073741824,"allocated":9981104128,"data_stored":9944000252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.876,"15min":0.81999999999999995},"min":{"1min":0.65600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.81699999999999995,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.626}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.96399999999999997,"15min":0.95599999999999996},"min":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.107},{"interface":"front","average":{"1min":1.214,"5min":1.0389999999999999,"15min":1.044},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.751}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.054,"15min":1.006},"min":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94799999999999995,"15min":0.91500000000000004},"min":{"1min":0.72199999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.038,"15min":1.018},"min":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.224,"15min":1.246},"min":{"1min":0.88,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.9540000000000002,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.2509999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.878,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.1799999999999997,"5min":7.1799999999999997,"15min":7.1799999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.83399999999999996,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.745},{"interface":"front","average":{"1min":1.079,"5min":1.0649999999999999,"15min":1.0900000000000001},"min":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.008}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"min":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.21,"5min":1.1659999999999999,"15min":1.1879999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.153}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.02,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.117,"15min":1.1439999999999999},"min":{"1min":0.78200000000000003,"5min":0.745,"15min":0.745},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.92600000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15378608,"kb_used_data":14296216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":78993232,"statfs":{"total":96636764160,"available":80889069568,"internally_reserved":1073741824,"allocated":14639325184,"data_stored":14583979007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64000000000000001,"15min":0.67800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.496},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.343,"15min":1.343},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7070000000000001,"5min":2.004,"15min":2.004},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.621},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.478,"5min":1.841,"15min":1.841},"last":1.042}]},{"osd":5,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6699999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.117},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.415,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.022}]}]}]}}

2020-07-02T03:26:42.388 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:09:20.831 INFO:tasks.ceph:Checking cluster log for badness...
, 2020-07-01T06:09:20.832 INFO:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1
, 2020-07-01T06:09:20.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com

2020-07-02T03:26:42.389 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:04.152 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.390 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 179 M
, 2020-07-01T06:11:08.889 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check

2020-07-02T03:26:42.390 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:14.404 INFO:teuthology.orchestra.run.smithi042.stdout:  Preparing        :                                                        1/1
, 2020-07-01T06:11:14.434 INFO:teuthology.orchestra.run.smithi042.stdout:  Running scriptlet: ceph-2:15.2.4-4.gabcb13a.el8.x86_64                    1/1
, 2020-07-01T06:11:14.490 INFO:teuthology.orchestra.run.smithi019.stdout:  Preparing        :                                                        1/1

2020-07-02T03:26:42.391 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.392 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.392 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.4-4.gabcb13a.   15/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d   16/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: rbd-mirror-2:15.2.4-4.gabcb13a.el8.x86_64            17/81

2020-07-02T03:26:42.393 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy
, 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:32.048 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-html5lib-1:0.999999999-6.el8.noarch          59/81

2020-07-02T03:26:42.394 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:51.579 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-babel-2.5.1-5.el8.noarch                     26/81
, 2020-07-01T06:11:51.580 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-bcrypt-3.1.6-2.el8.1.x86_64                  27/81
, 2020-07-01T06:11:51.600 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          28/81

2020-07-02T03:26:42.394 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:53.977 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-cachetools-3.1.1-4.el8.noarch                29/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-argparse-2:15.2.4-4.gabcb13a.el8.x86_   30/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-common-2:15.2.4-4.gabcb13a.el8.x86_64   31/81

2020-07-02T03:26:42.395 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:55.468 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-lxml-4.2.3-1.el8.x86_64
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-mako-1.0.6-13.el8.noarch
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-markupsafe-0.23-19.el8.x86_64

2020-07-02T03:26:42.396 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cheroot-8.2.1-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cherrypy-18.4.0-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cssselect-0.9.2-10.el8.noarch

2020-07-02T03:26:42.396 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Remove  1 Package
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 721 k

2020-07-02T03:26:42.397 WARNING:scrape:Ignoring malparsed backtrace:   - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64
, No packages marked for removal.
, 2020-07-01T06:12:09.857 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-rook

2020-07-02T03:26:42.398 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: Package    Arch   Version                 Repository                      Size
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.399 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 2.1 M
, 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check
, 2020-07-01T06:12:20.022 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded.

2020-07-02T03:26:42.400 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : fmt-6.2.1-1.el8.x86_64                                 6/7
, 2020-07-01T06:12:25.450 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : lttng-ust-2.8.1-11.el8.x86_64                          7/7
, Modular dependency problem:

2020-07-02T03:26:42.401 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:30.980 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:31.389 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:12:31.390 INFO:teuthology.orchestra.run.smithi042.stdout:Removed:

2020-07-02T03:26:42.402 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do.
, 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:37.229 INFO:teuthology.orchestra.run.smithi019.stdout:Updating Subscription Management repositories.

2020-07-02T03:26:42.403 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:210 Number of sources = 4
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:===============================================================================

2020-07-02T03:26:42.404 WARNING:scrape:Ignoring malparsed backtrace:     node=self.hostname, label=self.label
, teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'which ceph_test_rados'
, 2020-07-01T06:13:05.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload

2020-07-02T03:26:42.559 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 15.2.4-4-gabcb13a (abcb13ae4e01e1d30857c98a01d0916e952030b9) octopus (stable)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x158) [0x7f4317695afc]
,  2: (()+0x276d16) [0x7f4317695d16]

2020-07-02T03:26:42.561 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:08:18.993 INFO:teuthology.orchestra.run.smithi042.stdout:
, dumped all
, 2020-07-01T06:08:19.005 INFO:teuthology.orchestra.run.smithi042.stdout:{"pg_ready":true,"pg_map":{"version":129,"stamp":"2020-07-01T06:08:17.308951+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":30152980850,"num_objects":10142,"num_object_clones":0,"num_object_copies":20284,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10115,"num_whiteouts":37,"num_read":22823,"num_read_kb":1350358,"num_write":53015,"num_write_kb":23915037,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49201,"ondisk_log_size":49201,"up":32,"acting":32,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":32,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":6,"kb":566231040,"kb_used":44867848,"kb_used_data":38477572,"kb_used_omap":0,"kb_used_meta":6291456,"kb_avail":521363192,"statfs":{"total":579820584960,"available":533875908608,"internally_reserved":6442450944,"allocated":39401033728,"data_stored":39252435110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":6442450944},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":12,"apply_latency_ms":12,"commit_latency_ns":12000000,"apply_latency_ns":12000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":107914797,"num_objects":56,"num_object_clones":0,"num_object_copies":112,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":56,"num_whiteouts":20,"num_read":1042,"num_read_kb":972772,"num_write":580,"num_write_kb":388950,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":1,"num_bytes_hit_set_archive":529,"num_flush":86,"num_flush_kb":243095,"num_evict":29,"num_evict_kb":78346,"num_promote":109,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"10.002150"},"pg_stats":[{"pgid":"1.7","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764251+0000","last_change":"2020-07-01T06:05:03.040752+0000","last_active":"2020-07-01T06:07:47.764251+0000","last_peered":"2020-07-01T06:07:47.764251+0000","last_clean":"2020-07-01T06:07:47.764251+0000","last_became_active":"2020-07-01T06:05:03.040287+0000","last_became_peered":"2020-07-01T06:05:03.040287+0000","last_unstale":"2020-07-01T06:07:47.764251+0000","last_undegraded":"2020-07-01T06:07:47.764251+0000","last_fullsized":"2020-07-01T06:07:47.764251+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761306+0000","last_change":"2020-07-01T06:05:03.066148+0000","last_active":"2020-07-01T06:07:47.761306+0000","last_peered":"2020-07-01T06:07:47.761306+0000","last_clean":"2020-07-01T06:07:47.761306+0000","last_became_active":"2020-07-01T06:05:03.065647+0000","last_became_peered":"2020-07-01T06:05:03.065647+0000","last_unstale":"2020-07-01T06:07:47.761306+0000","last_undegraded":"2020-07-01T06:07:47.761306+0000","last_fullsized":"2020-07-01T06:07:47.761306+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"32'5773","reported_seq":"7987","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.705740+0000","last_change":"2020-07-01T06:05:12.715597+0000","last_active":"2020-07-01T06:08:09.705740+0000","last_peered":"2020-07-01T06:08:09.705740+0000","last_clean":"2020-07-01T06:08:09.705740+0000","last_became_active":"2020-07-01T06:05:12.715286+0000","last_became_peered":"2020-07-01T06:05:12.715286+0000","last_unstale":"2020-07-01T06:08:09.705740+0000","last_undegraded":"2020-07-01T06:08:09.705740+0000","last_fullsized":"2020-07-01T06:08:09.705740+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5773,"ondisk_log_size":5773,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":98787888,"num_objects":50,"num_object_clones":0,"num_object_copies":100,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":12,"num_read":1952,"num_read_kb":971,"num_write":5064,"num_write_kb":1170992,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3949,"num_flush":917,"num_flush_kb":2673482,"num_evict":838,"num_evict_kb":2438479,"num_promote":1026,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"33'6599","reported_seq":"8688","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.427521+0000","last_change":"2020-07-01T06:05:10.793859+0000","last_active":"2020-07-01T06:08:12.427521+0000","last_peered":"2020-07-01T06:08:12.427521+0000","last_clean":"2020-07-01T06:08:12.427521+0000","last_became_active":"2020-07-01T06:05:10.793445+0000","last_became_peered":"2020-07-01T06:05:10.793445+0000","last_unstale":"2020-07-01T06:08:12.427521+0000","last_undegraded":"2020-07-01T06:08:12.427521+0000","last_fullsized":"2020-07-01T06:08:12.427521+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6599,"ondisk_log_size":6599,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7351542432,"num_objects":2460,"num_object_clones":0,"num_object_copies":4920,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2460,"num_whiteouts":0,"num_read":3711,"num_read_kb":319158,"num_write":8205,"num_write_kb":4718998,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.764187+0000","last_change":"2020-07-01T06:05:03.065634+0000","last_active":"2020-07-01T06:07:47.764187+0000","last_peered":"2020-07-01T06:07:47.764187+0000","last_clean":"2020-07-01T06:07:47.764187+0000","last_became_active":"2020-07-01T06:05:03.065163+0000","last_became_peered":"2020-07-01T06:05:03.065163+0000","last_unstale":"2020-07-01T06:07:47.764187+0000","last_undegraded":"2020-07-01T06:07:47.764187+0000","last_fullsized":"2020-07-01T06:07:47.764187+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"33'5471","reported_seq":"7554","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.034923+0000","last_change":"2020-07-01T06:05:13.058750+0000","last_active":"2020-07-01T06:08:11.034923+0000","last_peered":"2020-07-01T06:08:11.034923+0000","last_clean":"2020-07-01T06:08:11.034923+0000","last_became_active":"2020-07-01T06:05:13.058349+0000","last_became_peered":"2020-07-01T06:05:13.058349+0000","last_unstale":"2020-07-01T06:08:11.034923+0000","last_undegraded":"2020-07-01T06:08:11.034923+0000","last_fullsized":"2020-07-01T06:08:11.034923+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5471,"ondisk_log_size":5471,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":113457335,"num_objects":52,"num_object_clones":0,"num_object_copies":104,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":8,"num_read":1887,"num_read_kb":921,"num_write":4892,"num_write_kb":1195597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2644,"num_flush":870,"num_flush_kb":2557735,"num_evict":793,"num_evict_kb":2323729,"num_promote":959,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"33'6666","reported_seq":"8856","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.439313+0000","last_change":"2020-07-01T06:05:10.712962+0000","last_active":"2020-07-01T06:08:12.439313+0000","last_peered":"2020-07-01T06:08:12.439313+0000","last_clean":"2020-07-01T06:08:12.439313+0000","last_became_active":"2020-07-01T06:05:10.712567+0000","last_became_peered":"2020-07-01T06:05:10.712567+0000","last_unstale":"2020-07-01T06:08:12.439313+0000","last_undegraded":"2020-07-01T06:08:12.439313+0000","last_fullsized":"2020-07-01T06:08:12.439313+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6666,"ondisk_log_size":6666,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7457514421,"num_objects":2502,"num_object_clones":0,"num_object_copies":5004,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2502,"num_whiteouts":0,"num_read":3789,"num_read_kb":286792,"num_write":8256,"num_write_kb":4887786,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761389+0000","last_change":"2020-07-01T06:05:03.066158+0000","last_active":"2020-07-01T06:07:47.761389+0000","last_peered":"2020-07-01T06:07:47.761389+0000","last_clean":"2020-07-01T06:07:47.761389+0000","last_became_active":"2020-07-01T06:05:03.065602+0000","last_became_peered":"2020-07-01T06:05:03.065602+0000","last_unstale":"2020-07-01T06:07:47.761389+0000","last_undegraded":"2020-07-01T06:07:47.761389+0000","last_fullsized":"2020-07-01T06:07:47.761389+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.0","version":"33'5460","reported_seq":"7629","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.284048+0000","last_change":"2020-07-01T06:05:13.057409+0000","last_active":"2020-07-01T06:08:11.284048+0000","last_peered":"2020-07-01T06:08:11.284048+0000","last_clean":"2020-07-01T06:08:11.284048+0000","last_became_active":"2020-07-01T06:05:13.056913+0000","last_became_peered":"2020-07-01T06:05:13.056913+0000","last_unstale":"2020-07-01T06:08:11.284048+0000","last_undegraded":"2020-07-01T06:08:11.284048+0000","last_fullsized":"2020-07-01T06:08:11.284048+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5460,"ondisk_log_size":5460,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":120594660,"num_objects":54,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":48,"num_whiteouts":7,"num_read":1901,"num_read_kb":900,"num_write":4828,"num_write_kb":1138749,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":2977,"num_flush":850,"num_flush_kb":2461298,"num_evict":712,"num_evict_kb":2056075,"num_promote":929,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"33'6836","reported_seq":"9123","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:12.417167+0000","last_change":"2020-07-01T06:05:10.793572+0000","last_active":"2020-07-01T06:08:12.417167+0000","last_peered":"2020-07-01T06:08:12.417167+0000","last_clean":"2020-07-01T06:08:12.417167+0000","last_became_active":"2020-07-01T06:05:10.793143+0000","last_became_peered":"2020-07-01T06:05:10.793143+0000","last_unstale":"2020-07-01T06:08:12.417167+0000","last_undegraded":"2020-07-01T06:08:12.417167+0000","last_fullsized":"2020-07-01T06:08:12.417167+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6836,"ondisk_log_size":6836,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7620744579,"num_objects":2547,"num_object_clones":0,"num_object_copies":5094,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2547,"num_whiteouts":0,"num_read":3997,"num_read_kb":452821,"num_write":8470,"num_write_kb":4976422,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761482+0000","last_change":"2020-07-01T06:05:03.066066+0000","last_active":"2020-07-01T06:07:47.761482+0000","last_peered":"2020-07-01T06:07:47.761482+0000","last_clean":"2020-07-01T06:07:47.761482+0000","last_became_active":"2020-07-01T06:05:03.065610+0000","last_became_peered":"2020-07-01T06:05:03.065610+0000","last_unstale":"2020-07-01T06:07:47.761482+0000","last_undegraded":"2020-07-01T06:07:47.761482+0000","last_fullsized":"2020-07-01T06:07:47.761482+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1","version":"32'5823","reported_seq":"8053","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:08:09.317824+0000","last_change":"2020-07-01T06:05:12.716513+0000","last_active":"2020-07-01T06:08:09.317824+0000","last_peered":"2020-07-01T06:08:09.317824+0000","last_clean":"2020-07-01T06:08:09.317824+0000","last_became_active":"2020-07-01T06:05:12.716139+0000","last_became_peered":"2020-07-01T06:05:12.716139+0000","last_unstale":"2020-07-01T06:08:09.317824+0000","last_undegraded":"2020-07-01T06:08:09.317824+0000","last_fullsized":"2020-07-01T06:08:09.317824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:11.706194+0000","last_clean_scrub_stamp":"2020-07-01T06:05:11.706194+0000","log_size":5823,"ondisk_log_size":5823,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":99175935,"num_objects":49,"num_object_clones":0,"num_object_copies":98,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":41,"num_whiteouts":10,"num_read":1958,"num_read_kb":977,"num_write":5128,"num_write_kb":1180416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":8,"num_bytes_hit_set_archive":3950,"num_flush":923,"num_flush_kb":2707853,"num_evict":836,"num_evict_kb":2447891,"num_promote":1022,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":1,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"33'6573","reported_seq":"8565","reported_epoch":"33","state":"active+clean","last_fresh":"2020-07-01T06:08:11.769540+0000","last_change":"2020-07-01T06:05:10.793817+0000","last_active":"2020-07-01T06:08:11.769540+0000","last_peered":"2020-07-01T06:08:11.769540+0000","last_clean":"2020-07-01T06:08:11.769540+0000","last_became_active":"2020-07-01T06:05:10.793341+0000","last_became_peered":"2020-07-01T06:05:10.793341+0000","last_unstale":"2020-07-01T06:08:11.769540+0000","last_undegraded":"2020-07-01T06:08:11.769540+0000","last_fullsized":"2020-07-01T06:08:11.769540+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:09.701689+0000","last_clean_scrub_stamp":"2020-07-01T06:05:09.701689+0000","log_size":6573,"ondisk_log_size":6573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":7291163600,"num_objects":2428,"num_object_clones":0,"num_object_copies":4856,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2428,"num_whiteouts":0,"num_read":3628,"num_read_kb":287818,"num_write":8172,"num_write_kb":4646077,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762140+0000","last_change":"2020-07-01T06:05:02.700518+0000","last_active":"2020-07-01T06:07:47.762140+0000","last_peered":"2020-07-01T06:07:47.762140+0000","last_clean":"2020-07-01T06:07:47.762140+0000","last_became_active":"2020-07-01T06:05:02.700021+0000","last_became_peered":"2020-07-01T06:05:02.700021+0000","last_unstale":"2020-07-01T06:07:47.762140+0000","last_undegraded":"2020-07-01T06:07:47.762140+0000","last_fullsized":"2020-07-01T06:07:47.762140+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"26","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.762255+0000","last_change":"2020-07-01T06:05:02.701920+0000","last_active":"2020-07-01T06:07:47.762255+0000","last_peered":"2020-07-01T06:07:47.762255+0000","last_clean":"2020-07-01T06:07:47.762255+0000","last_became_active":"2020-07-01T06:05:02.701535+0000","last_became_peered":"2020-07-01T06:05:02.701535+0000","last_unstale":"2020-07-01T06:07:47.762255+0000","last_undegraded":"2020-07-01T06:07:47.762255+0000","last_fullsized":"2020-07-01T06:07:47.762255+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"25","reported_epoch":"32","state":"active+clean","last_fresh":"2020-07-01T06:07:47.761267+0000","last_change":"2020-07-01T06:05:03.040661+0000","last_active":"2020-07-01T06:07:47.761267+0000","last_peered":"2020-07-01T06:07:47.761267+0000","last_clean":"2020-07-01T06:07:47.761267+0000","last_became_active":"2020-07-01T06:05:03.040253+0000","last_became_peered":"2020-07-01T06:05:03.040253+0000","last_unstale":"2020-07-01T06:07:47.761267+0000","last_undegraded":"2020-07-01T06:07:47.761267+0000","last_fullsized":"2020-07-01T06:07:47.761267+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-07-01T06:05:01.689777+0000","last_clean_scrub_stamp":"2020-07-01T06:05:01.689777+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]}],"pool_stats":[{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":432015818,"num_objects":205,"num_object_clones":0,"num_object_copies":410,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":37,"num_read":7698,"num_read_kb":3769,"num_write":19912,"num_write_kb":4685754,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":27,"num_bytes_hit_set_archive":13520,"num_flush":3560,"num_flush_kb":10400368,"num_evict":3179,"num_evict_kb":9266174,"num_promote":3936,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":4,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":680017920,"data_stored":678280898,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22527,"ondisk_log_size":22527,"up":8,"acting":8,"num_store_stats":5},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":6},{"poolid":2,"num_pg":4,"stat_sum":{"num_bytes":29720965032,"num_objects":9937,"num_object_clones":0,"num_object_copies":19874,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9937,"num_whiteouts":0,"num_read":15125,"num_read_kb":1346589,"num_write":33103,"num_write_kb":19229283,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":38718308352,"data_stored":38572757424,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":26674,"ondisk_log_size":26674,"up":8,"acting":8,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":11,"seq":47244640299,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10616748,"kb_used_data":9555644,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83755092,"statfs":{"total":96636764160,"available":85765214208,"internally_reserved":1073741824,"allocated":9784979456,"data_stored":9748301686,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":0.70699999999999996,"5min":0.71699999999999997,"15min":0.72799999999999998},"min":{"1min":0.39400000000000002,"5min":0.36299999999999999,"15min":0.36299999999999999},"max":{"1min":1.3500000000000001,"5min":1.3500000000000001,"15min":1.3500000000000001},"last":1.224},{"interface":"front","average":{"1min":0.92500000000000004,"5min":0.92100000000000004,"15min":0.92100000000000004},"min":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.999}]},{"osd":1,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":0.83599999999999997,"15min":0.79700000000000004},"min":{"1min":0.53700000000000003,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.7460000000000004,"5min":6.7460000000000004,"15min":6.7460000000000004},"last":0.73099999999999998},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.85599999999999998,"15min":0.85999999999999999},"min":{"1min":0.60499999999999998,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.3009999999999999,"5min":1.407,"15min":1.407},"last":1.03}]},{"osd":2,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0229999999999999,"5min":0.89900000000000002,"15min":0.874},"min":{"1min":0.58199999999999996,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":2.4169999999999998,"5min":2.4169999999999998,"15min":2.4169999999999998},"last":1.2549999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.0129999999999999,"15min":0.98999999999999999},"min":{"1min":0.624,"5min":0.56599999999999995,"15min":0.56599999999999995},"max":{"1min":6.2949999999999999,"5min":6.2949999999999999,"15min":6.2949999999999999},"last":0.85399999999999998}]},{"osd":3,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.044,"5min":0.97999999999999998,"15min":0.98399999999999999},"min":{"1min":0.60699999999999998,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":2.9449999999999998,"5min":2.9449999999999998,"15min":2.9449999999999998},"last":0.69099999999999995},{"interface":"front","average":{"1min":0.94499999999999995,"5min":1.0369999999999999,"15min":1.0649999999999999},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":1.4319999999999999,"5min":1.452,"15min":1.452},"last":1.0840000000000001}]},{"osd":4,"last update":"Wed Jul  1 06:08:06 2020","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.02,"15min":1.036},"min":{"1min":0.70299999999999996,"5min":0.67500000000000004,"15min":0.67500000000000004},"max":{"1min":1.4099999999999999,"5min":2.2690000000000001,"15min":2.2690000000000001},"last":0.82499999999999996},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.1220000000000001,"15min":1.121},"min":{"1min":0.81200000000000006,"5min":0.79100000000000004,"15min":0.79100000000000004},"max":{"1min":4.0640000000000001,"5min":4.0640000000000001,"15min":4.0640000000000001},"last":0.89200000000000002}]}]},{"osd":4,"up_from":11,"seq":47244640298,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.70599999999999996,"5min":0.71299999999999997,"15min":0.73899999999999999},"min":{"1min":0.40999999999999998,"5min":0.40999999999999998,"15min":0.40999999999999998},"max":{"1min":1.282,"5min":1.488,"15min":1.488},"last":0.79400000000000004},{"interface":"front","average":{"1min":0.77200000000000002,"5min":0.80200000000000005,"15min":0.82999999999999996},"min":{"1min":0.49099999999999999,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.796,"5min":1.796,"15min":1.796},"last":0.81899999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.79400000000000004,"5min":0.81000000000000005,"15min":0.83199999999999996},"min":{"1min":0.55300000000000005,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":1.145,"5min":1.387,"15min":1.387},"last":1.1579999999999999},{"interface":"front","average":{"1min":0.70599999999999996,"5min":0.80500000000000005,"15min":0.83299999999999996},"min":{"1min":0.54400000000000004,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.133,"5min":1.4279999999999999,"15min":1.4279999999999999},"last":0.85699999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.80500000000000005,"5min":0.86199999999999999,"15min":0.89100000000000001},"min":{"1min":0.60699999999999998,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":1.149,"5min":2.1080000000000001,"15min":2.1080000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.214,"5min":1.0029999999999999,"15min":0.97599999999999998},"min":{"1min":0.76900000000000002,"5min":0.74099999999999999,"15min":0.74099999999999999},"max":{"1min":6.9950000000000001,"5min":6.9950000000000001,"15min":6.9950000000000001},"last":0.98999999999999999}]},{"osd":3,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.98199999999999998,"5min":0.90900000000000003,"15min":0.90100000000000002},"min":{"1min":0.68400000000000005,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.474,"5min":2.339,"15min":2.339},"last":1.121},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0800000000000001,"15min":1.0820000000000001},"min":{"1min":0.76500000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.498,"5min":1.7110000000000001,"15min":1.7110000000000001},"last":1.323}]},{"osd":5,"last update":"Wed Jul  1 06:08:05 2020","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.96199999999999997,"15min":0.95999999999999996},"min":{"1min":0.68100000000000005,"5min":0.59499999999999997,"15min":0.59499999999999997},"max":{"1min":1.4219999999999999,"5min":2.2509999999999999,"15min":2.2509999999999999},"last":1.2809999999999999},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.141,"15min":1.143},"min":{"1min":0.96399999999999997,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":1.452,"5min":2.7050000000000001,"15min":2.7050000000000001},"last":1.3460000000000001}]}]},{"osd":3,"up_from":11,"seq":47244640297,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5642524,"kb_used_data":4578092,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":88729316,"statfs":{"total":96636764160,"available":90858819584,"internally_reserved":1073741824,"allocated":4687966208,"data_stored":4669691355,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.64900000000000002,"5min":0.81699999999999995,"15min":0.88400000000000001},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":1.0569999999999999,"5min":2.7810000000000001,"15min":2.7810000000000001},"last":0.73199999999999998},{"interface":"front","average":{"1min":0.83799999999999997,"5min":0.95399999999999996,"15min":0.99099999999999999},"min":{"1min":0.63700000000000001,"5min":0.504,"15min":0.504},"max":{"1min":1.1890000000000001,"5min":2.9980000000000002,"15min":2.9980000000000002},"last":0.82099999999999995}]},{"osd":1,"last update":"Wed Jul  1 06:08:09 2020","interfaces":[{"interface":"back","average":{"1min":0.80300000000000005,"5min":0.77800000000000002,"15min":0.80200000000000005},"min":{"1min":0.501,"5min":0.49399999999999999,"15min":0.49399999999999999},"max":{"1min":1.2490000000000001,"5min":2.3690000000000002,"15min":2.3690000000000002},"last":0.876},{"interface":"front","average":{"1min":0.83299999999999996,"5min":0.85899999999999999,"15min":0.873},"min":{"1min":0.52000000000000002,"5min":0.52000000000000002,"15min":0.52000000000000002},"max":{"1min":1.4910000000000001,"5min":1.8939999999999999,"15min":1.8939999999999999},"last":0.56799999999999995}]},{"osd":2,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.95299999999999996,"5min":0.92600000000000005,"15min":0.94899999999999995},"min":{"1min":0.61499999999999999,"5min":0.57799999999999996,"15min":0.57799999999999996},"max":{"1min":1.9119999999999999,"5min":3.298,"15min":3.298},"last":1.159},{"interface":"front","average":{"1min":1.01,"5min":0.98499999999999999,"15min":0.995},"min":{"1min":0.64900000000000002,"5min":0.628,"15min":0.628},"max":{"1min":1.367,"5min":1.395,"15min":1.395},"last":1.0289999999999999}]},{"osd":4,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":0.97899999999999998,"5min":0.92300000000000004,"15min":0.93200000000000005},"min":{"1min":0.65100000000000002,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.5009999999999999,"5min":1.673,"15min":1.673},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.093,"5min":1.0529999999999999,"15min":1.0569999999999999},"min":{"1min":0.90600000000000003,"5min":0.81799999999999995,"15min":0.81799999999999995},"max":{"1min":1.5620000000000001,"5min":1.5620000000000001,"15min":1.5620000000000001},"last":1.1339999999999999}]},{"osd":5,"last update":"Wed Jul  1 06:08:02 2020","interfaces":[{"interface":"back","average":{"1min":1.157,"5min":1.0840000000000001,"15min":1.0760000000000001},"min":{"1min":0.80200000000000005,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":1.952,"5min":1.952,"15min":1.952},"last":1.2929999999999999},{"interface":"front","average":{"1min":1.056,"5min":1.0960000000000001,"15min":1.097},"min":{"1min":0.76100000000000001,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.5009999999999999,"5min":1.883,"15min":1.883},"last":0.998}]}]},{"osd":2,"up_from":11,"seq":47244640298,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":10796920,"kb_used_data":9747172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":83574920,"statfs":{"total":96636764160,"available":85580718080,"internally_reserved":1073741824,"allocated":9981104128,"data_stored":9944000252,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.75800000000000001,"5min":0.65700000000000003,"15min":0.64900000000000002},"min":{"1min":0.40000000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":1.597,"5min":1.597,"15min":1.597},"last":0.54200000000000004},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.82599999999999996,"15min":0.81699999999999995},"min":{"1min":0.48699999999999999,"5min":0.48699999999999999,"15min":0.48699999999999999},"max":{"1min":2.5950000000000002,"5min":2.5950000000000002,"15min":2.5950000000000002},"last":0.77100000000000002}]},{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.202,"5min":0.876,"15min":0.81999999999999995},"min":{"1min":0.65600000000000003,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"last":0.94399999999999995},{"interface":"front","average":{"1min":1.1579999999999999,"5min":0.81699999999999995,"15min":0.76400000000000001},"min":{"1min":0.51400000000000001,"5min":0.51400000000000001,"15min":0.51400000000000001},"max":{"1min":4.6230000000000002,"5min":4.6230000000000002,"15min":4.6230000000000002},"last":0.626}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.071,"5min":0.96399999999999997,"15min":0.95599999999999996},"min":{"1min":0.627,"5min":0.58999999999999997,"15min":0.58999999999999997},"max":{"1min":2.681,"5min":2.681,"15min":2.681},"last":1.107},{"interface":"front","average":{"1min":1.214,"5min":1.0389999999999999,"15min":1.044},"min":{"1min":0.65000000000000002,"5min":0.55500000000000005,"15min":0.55500000000000005},"max":{"1min":3.5209999999999999,"5min":3.5209999999999999,"15min":3.5209999999999999},"last":0.751}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.448,"5min":1.054,"15min":1.006},"min":{"1min":0.65800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":4.3360000000000003,"5min":4.3360000000000003,"15min":4.3360000000000003},"last":0.89900000000000002},{"interface":"front","average":{"1min":1.1180000000000001,"5min":0.94799999999999995,"15min":0.91500000000000004},"min":{"1min":0.72199999999999998,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.274,"5min":4.274,"15min":4.274},"last":0.85699999999999998}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.179,"5min":1.038,"15min":1.018},"min":{"1min":0.72599999999999998,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":4.4699999999999998,"5min":4.4699999999999998,"15min":4.4699999999999998},"last":0.97899999999999998},{"interface":"front","average":{"1min":1.2709999999999999,"5min":1.224,"15min":1.246},"min":{"1min":0.88,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":2.9540000000000002,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.2509999999999999}]}]},{"osd":0,"up_from":11,"seq":47244640297,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1216524,"kb_used_data":150224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93155316,"statfs":{"total":96636764160,"available":95391043584,"internally_reserved":1073741824,"allocated":153829376,"data_stored":153231405,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.81299999999999994,"5min":0.67300000000000004,"15min":0.63500000000000001},"min":{"1min":0.45900000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":2.407,"5min":2.407,"15min":2.407},"last":0.58199999999999996},{"interface":"front","average":{"1min":0.79700000000000004,"5min":0.72499999999999998,"15min":0.72399999999999998},"min":{"1min":0.44400000000000001,"5min":0.435,"15min":0.435},"max":{"1min":2.153,"5min":2.153,"15min":2.153},"last":0.70399999999999996}]},{"osd":2,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.337,"5min":0.878,"15min":0.80900000000000005},"min":{"1min":0.48999999999999999,"5min":0.48999999999999999,"15min":0.48999999999999999},"max":{"1min":7.1799999999999997,"5min":7.1799999999999997,"15min":7.1799999999999997},"last":0.78100000000000003},{"interface":"front","average":{"1min":1.0700000000000001,"5min":0.83399999999999996,"15min":0.81200000000000006},"min":{"1min":0.52400000000000002,"5min":0.51900000000000002,"15min":0.51900000000000002},"max":{"1min":6.9749999999999996,"5min":6.9749999999999996,"15min":6.9749999999999996},"last":0.81499999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.94199999999999995,"15min":0.97999999999999998},"min":{"1min":0.57199999999999995,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":3.4849999999999999,"5min":3.4849999999999999,"15min":3.4849999999999999},"last":0.745},{"interface":"front","average":{"1min":1.079,"5min":1.0649999999999999,"15min":1.0900000000000001},"min":{"1min":0.78800000000000003,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":3.0409999999999999,"5min":3.0409999999999999,"15min":3.0409999999999999},"last":1.008}]},{"osd":4,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.0269999999999999,"5min":0.99399999999999999,"15min":1.0169999999999999},"min":{"1min":0.61399999999999999,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":3.5779999999999998,"5min":3.5779999999999998,"15min":3.5779999999999998},"last":0.83499999999999996},{"interface":"front","average":{"1min":1.21,"5min":1.1659999999999999,"15min":1.1879999999999999},"min":{"1min":0.69499999999999995,"5min":0.69499999999999995,"15min":0.69499999999999995},"max":{"1min":2.9199999999999999,"5min":2.9199999999999999,"15min":2.9199999999999999},"last":1.153}]},{"osd":5,"last update":"Wed Jul  1 06:08:04 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.0700000000000001,"15min":1.0900000000000001},"min":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"max":{"1min":2.02,"5min":2.4590000000000001,"15min":2.4590000000000001},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1539999999999999,"5min":1.117,"15min":1.1439999999999999},"min":{"1min":0.78200000000000003,"5min":0.745,"15min":0.745},"max":{"1min":3.649,"5min":3.649,"15min":3.649},"last":0.92600000000000005}]}]},{"osd":1,"up_from":11,"seq":47244640297,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":15378608,"kb_used_data":14296216,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":78993232,"statfs":{"total":96636764160,"available":80889069568,"internally_reserved":1073741824,"allocated":14639325184,"data_stored":14583979007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.55000000000000004,"5min":0.64000000000000001,"15min":0.67800000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.88200000000000001,"5min":1.2210000000000001,"15min":1.2210000000000001},"last":0.496},{"interface":"front","average":{"1min":0.81000000000000005,"5min":0.78600000000000003,"15min":0.79400000000000004},"min":{"1min":0.60199999999999998,"5min":0.47099999999999997,"15min":0.47099999999999997},"max":{"1min":1.413,"5min":1.413,"15min":1.413},"last":0.73199999999999998}]},{"osd":2,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.69799999999999995,"5min":0.70699999999999996,"15min":0.69399999999999995},"min":{"1min":0.47599999999999998,"5min":0.47599999999999998,"15min":0.47599999999999998},"max":{"1min":1.1599999999999999,"5min":1.343,"15min":1.343},"last":0.53200000000000003},{"interface":"front","average":{"1min":0.79000000000000004,"5min":0.81699999999999995,"15min":0.85499999999999998},"min":{"1min":0.58099999999999996,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.7070000000000001,"5min":2.004,"15min":2.004},"last":0.68899999999999995}]},{"osd":3,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.90100000000000002,"5min":0.88700000000000001,"15min":0.90900000000000003},"min":{"1min":0.59899999999999998,"5min":0.50900000000000001,"15min":0.50900000000000001},"max":{"1min":1.8240000000000001,"5min":1.8240000000000001,"15min":1.8240000000000001},"last":0.621},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.93600000000000005,"15min":0.98299999999999998},"min":{"1min":0.61399999999999999,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":1.577,"5min":1.577,"15min":1.577},"last":0.85699999999999998}]},{"osd":4,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":0.97099999999999997,"5min":0.92900000000000005,"15min":0.92900000000000005},"min":{"1min":0.66500000000000004,"5min":0.64600000000000002,"15min":0.64600000000000002},"max":{"1min":1.603,"5min":1.603,"15min":1.603},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.0309999999999999,"5min":1.0509999999999999,"15min":1.085},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.478,"5min":1.841,"15min":1.841},"last":1.042}]},{"osd":5,"last update":"Wed Jul  1 06:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":1.056,"15min":1.079},"min":{"1min":0.75,"5min":0.75,"15min":0.75},"max":{"1min":1.6699999999999999,"5min":1.8999999999999999,"15min":1.8999999999999999},"last":0.81100000000000005},{"interface":"front","average":{"1min":1.0760000000000001,"5min":1.113,"15min":1.117},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.415,"5min":1.6379999999999999,"15min":1.6379999999999999},"last":1.022}]}]}]}}

2020-07-02T03:26:42.563 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:09:20.831 INFO:tasks.ceph:Checking cluster log for badness...
, 2020-07-01T06:09:20.832 INFO:teuthology.orchestra.run.smithi042:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v 'but it is still running' | egrep -v 'slow request' | egrep -v 'overall HEALTH_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | head -n 1
, 2020-07-01T06:09:20.911 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi042.front.sepia.ceph.com

2020-07-02T03:26:42.564 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:04.152 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction Summary
, 2020-07-01T06:11:04.153 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.565 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:11:08.888 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 179 M
, 2020-07-01T06:11:08.889 INFO:teuthology.orchestra.run.smithi019.stdout:Running transaction check

2020-07-02T03:26:42.565 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:14.404 INFO:teuthology.orchestra.run.smithi042.stdout:  Preparing        :                                                        1/1
, 2020-07-01T06:11:14.434 INFO:teuthology.orchestra.run.smithi042.stdout:  Running scriptlet: ceph-2:15.2.4-4.gabcb13a.el8.x86_64                    1/1
, 2020-07-01T06:11:14.490 INFO:teuthology.orchestra.run.smithi019.stdout:  Preparing        :                                                        1/1

2020-07-02T03:26:42.566 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.467 INFO:teuthology.orchestra.run.smithi042.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.468 INFO:teuthology.orchestra.run.smithi042.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.567 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-google-auth             noarch  1:1.1.1-10.el8                        @epel                              306 k
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-html5lib                noarch  1:0.999999999-6.el8                   @rhel-8-for-x86_64-appstream-rpms  1.1 M
, 2020-07-01T06:11:19.595 INFO:teuthology.orchestra.run.smithi019.stdout: python3-jaraco                  noarch  6.2-6.el8                             @epel                              4.0 k

2020-07-02T03:26:42.567 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: ceph-mgr-diskprediction-local-2:15.2.4-4.gabcb13a.   15/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-scipy-1.0.0-20.module+el8.1.0+3334+5cb623d   16/81
, 2020-07-01T06:11:24.269 INFO:teuthology.orchestra.run.smithi019.stdout:  Running scriptlet: rbd-mirror-2:15.2.4-4.gabcb13a.el8.x86_64            17/81

2020-07-02T03:26:42.568 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:warning: directory /var/lib/ceph: remove failed: Device or resource busy
, 2020-07-01T06:11:31.903 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:11:32.048 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : python3-html5lib-1:0.999999999-6.el8.noarch          59/81

2020-07-02T03:26:42.569 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:51.579 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-babel-2.5.1-5.el8.noarch                     26/81
, 2020-07-01T06:11:51.580 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-bcrypt-3.1.6-2.el8.1.x86_64                  27/81
, 2020-07-01T06:11:51.600 INFO:teuthology.orchestra.run.smithi019.stdout:  Verifying        : python3-beautifulsoup4-4.6.3-2.el8.1.noarch          28/81

2020-07-02T03:26:42.569 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:53.977 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-cachetools-3.1.1-4.el8.noarch                29/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-argparse-2:15.2.4-4.gabcb13a.el8.x86_   30/81
, 2020-07-01T06:11:53.978 INFO:teuthology.orchestra.run.smithi042.stdout:  Verifying        : python3-ceph-common-2:15.2.4-4.gabcb13a.el8.x86_64   31/81

2020-07-02T03:26:42.570 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:55.468 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-lxml-4.2.3-1.el8.x86_64
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-mako-1.0.6-13.el8.noarch
, 2020-07-01T06:11:55.469 INFO:teuthology.orchestra.run.smithi019.stdout:  python3-markupsafe-0.23-19.el8.x86_64

2020-07-02T03:26:42.570 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cheroot-8.2.1-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cherrypy-18.4.0-1.el8.noarch
, 2020-07-01T06:11:58.230 INFO:teuthology.orchestra.run.smithi042.stdout:  python3-cssselect-0.9.2-10.el8.noarch

2020-07-02T03:26:42.571 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Remove  1 Package
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:
, 2020-07-01T06:12:01.933 INFO:teuthology.orchestra.run.smithi019.stdout:Freed space: 721 k

2020-07-02T03:26:42.572 WARNING:scrape:Ignoring malparsed backtrace:   - nothing provides module(perl:5.26) needed by module perl-YAML:1.24:8010020190322131811:a5949e2e-0.x86_64
, No packages marked for removal.
, 2020-07-01T06:12:09.857 INFO:teuthology.orchestra.run.smithi019.stdout:No match for argument: ceph-mgr-rook

2020-07-02T03:26:42.572 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout: Package    Arch   Version                 Repository                      Size
, 2020-07-01T06:12:15.172 INFO:teuthology.orchestra.run.smithi042.stdout:================================================================================

2020-07-02T03:26:42.573 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Freed space: 2.1 M
, 2020-07-01T06:12:20.021 INFO:teuthology.orchestra.run.smithi042.stdout:Running transaction check
, 2020-07-01T06:12:20.022 INFO:teuthology.orchestra.run.smithi042.stdout:Transaction check succeeded.

2020-07-02T03:26:42.574 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:25.449 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : fmt-6.2.1-1.el8.x86_64                                 6/7
, 2020-07-01T06:12:25.450 INFO:teuthology.orchestra.run.smithi019.stdout:  Erasing          : lttng-ust-2.8.1-11.el8.x86_64                          7/7
, Modular dependency problem:

2020-07-02T03:26:42.574 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:30.980 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:31.389 INFO:teuthology.orchestra.run.smithi042.stdout:
, 2020-07-01T06:12:31.390 INFO:teuthology.orchestra.run.smithi042.stdout:Removed:

2020-07-02T03:26:42.575 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Nothing to do.
, 2020-07-01T06:12:36.738 INFO:teuthology.orchestra.run.smithi019.stdout:Complete!
, 2020-07-01T06:12:37.229 INFO:teuthology.orchestra.run.smithi019.stdout:Updating Subscription Management repositories.

2020-07-02T03:26:42.575 WARNING:scrape:Ignoring malparsed backtrace: 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:210 Number of sources = 4
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:MS Name/IP address         Stratum Poll Reach LastRx Last sample
, 2020-07-01T06:12:43.167 INFO:teuthology.orchestra.run.smithi019.stdout:===============================================================================

2020-07-02T03:26:42.576 WARNING:scrape:Ignoring malparsed backtrace:     node=self.hostname, label=self.label
, teuthology.exceptions.CommandFailedError: Command failed on smithi019 with status 1: 'which ceph_test_rados'
, 2020-07-01T06:13:05.846 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload

2020-07-02T03:26:44.016 INFO:scrape:Found 6 distinct failure reasons
2020-07-02T03:26:44.018 INFO:scrape:Failure: reached maximum tries (180) after waiting for 180 seconds
2020-07-02T03:26:44.018 INFO:scrape:4 jobs: ['5192528', '5192615', '5192558', '5192688']
2020-07-02T03:26:44.019 INFO:scrape:suites intersection: ['ceph', 'clusters/{openstack', 'distro$/{centos_7.6}', 'rados', 'thrashosds-health', 'three-plus-one}']
2020-07-02T03:26:44.019 INFO:scrape:suites union: ['1-install/mimic', '1-install/mimic-v1only', '1-install/nautilus-v2only', 'backoff/normal', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/off', 'distro$/{centos_7.6}', 'msgr-failures/fastclose', 'msgr-failures/few', 'rados', 'rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size', 'thrashers/careful', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-snaps}', 'workloads/rbd_cls}', 'workloads/snaps-few-objects}']
2020-07-02T03:26:44.020 INFO:scrape:
2020-07-02T03:26:44.020 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=abcb13ae4e01e1d30857c98a01d0916e952030b9 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
2020-07-02T03:26:44.021 INFO:scrape:1 jobs: ['5192610']
2020-07-02T03:26:44.021 INFO:scrape:suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}']
2020-07-02T03:26:44.022 INFO:scrape:
2020-07-02T03:26:44.022 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base'
2020-07-02T03:26:44.022 INFO:scrape:1 jobs: ['5192479']
2020-07-02T03:26:44.023 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'supported-random-distro$/{rhel_latest}}']
2020-07-02T03:26:44.023 INFO:scrape:
2020-07-02T03:26:44.024 INFO:scrape:Failure: "2020-07-01T06:05:59.491156+0000 mds.b (mds.0) 1 : cluster [WRN] evicting unresponsive client smithi025:z (5816), after 302.34 seconds" in cluster log
2020-07-02T03:26:44.024 INFO:scrape:1 jobs: ['5192487']
2020-07-02T03:26:44.024 INFO:scrape:suites: ['debug/mgr', 'objectstore/bluestore-bitmap', 'rados/mgr/{clusters/{2-node-mgr}', 'supported-random-distro$/{rhel_latest}', 'tasks/module_selftest}']
2020-07-02T03:26:44.025 INFO:scrape:
2020-07-02T03:26:44.025 INFO:scrape:Failure: Command failed on smithi093 with status 1: 'sudo yum -y install ceph-mgr-diskprediction-local'
2020-07-02T03:26:44.026 INFO:scrape:1 jobs: ['5192564']
2020-07-02T03:26:44.026 INFO:scrape:suites: ['msgr-failures/few', 'msgr/async', 'no_pools', 'objectstore/bluestore-low-osd-mem-target', 'rados', 'rados/multimon/{clusters/21', 'supported-random-distro$/{centos_latest}', 'tasks/mon_recovery}']
2020-07-02T03:26:44.027 INFO:scrape:
2020-07-02T03:26:44.027 INFO:scrape:Failure: failed to reach quorum size 9 before timeout expired
2020-07-02T03:26:44.027 INFO:scrape:1 jobs: ['5192536']
2020-07-02T03:26:44.028 INFO:scrape:suites: ['clusters/9-mons', 'msgr-failures/mon-delay', 'msgr/async-v1only', 'objectstore/bluestore-comp-zlib', 'rados', 'rados/monthrash/{ceph', 'supported-random-distro$/{centos_latest}', 'thrashers/force-sync-many', 'workloads/rados_mon_osdmap_prune}']
2020-07-02T03:26:44.028 INFO:scrape:
2020-07-02T03:26:44.046 INFO:teuthology.results:Sending results to ceph-qa@ceph.io: Test Run: teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi
=================================================================
info:    http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/
logs:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/
failed:  8
dead:    1
running: 0
waiting: 0
queued:  0
passed:  321


Fail
=================================================================
[5192479]  rados/singleton/{all/thrash_cache_writeback_proxy_none msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}}
-----------------------------------------------------------------
time:   00:17:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192479/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192479/

    Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage
    /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000
    --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000
    --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op
    delete 50 --op copy_from 50 --op write_excl 50 --pool base'

[5192487]  rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{rhel_latest} tasks/module_selftest}
-----------------------------------------------------------------
time:   00:31:06
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192487/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192487/

    "2020-07-01T06:05:59.491156+0000 mds.b (mds.0) 1 : cluster [WRN] evicting
    unresponsive client smithi025:z (5816), after 302.34 seconds" in cluster
    log

[5192528]  rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/mimic-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/rbd_cls}
-----------------------------------------------------------------
time:   00:24:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192528/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192528/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=02f8773216784031861065eb8a49afb9

    reached maximum tries (180) after waiting for 180 seconds

[5192536]  rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/force-sync-many workloads/rados_mon_osdmap_prune}
-----------------------------------------------------------------
time:   00:46:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192536/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192536/

    failed to reach quorum size 9 before timeout expired

[5192558]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/mimic backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/snaps-few-objects}
-----------------------------------------------------------------
time:   00:24:07
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192558/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192558/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=3f3fc1cf406e4f7f8349628a1ce61af9

    reached maximum tries (180) after waiting for 180 seconds

[5192564]  rados/multimon/{clusters/21 msgr-failures/few msgr/async no_pools objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
-----------------------------------------------------------------
time:   00:04:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192564/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192564/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=666e40d75dfc4e51a0706c753bc1827d

    Command failed on smithi093 with status 1: 'sudo yum -y install ceph-mgr-
    diskprediction-local'

[5192610]  rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados tasks/rados_api_tests validater/valgrind}
-----------------------------------------------------------------
time:   03:02:53
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192610/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192610/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=043caa74003c43478d0edd5e4a924e31

    Command failed (workunit test rados/test.sh) on smithi007 with status 1:
    'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd --
    /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1
    CEPH_REF=abcb13ae4e01e1d30857c98a01d0916e952030b9
    TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0"
    PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0
    CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 ALLOW_TIMEOUTS=1 adjust-
    ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h
    /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'

[5192615]  rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/nautilus-v2only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/cache-snaps}
-----------------------------------------------------------------
time:   00:24:13
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192615/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192615/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=c8d289bbb49f481cbcc554ec171eae12

    reached maximum tries (180) after waiting for 180 seconds



Dead
=================================================================
[5192688]  rados/objectstore/{backends/objectstore supported-random-distro$/{ubuntu_latest}}
-----------------------------------------------------------------
time:   00:00:00
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192688/
log:    http://qa-proxy.ceph.com/teuthology/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192688/
sentry: http://sentry.ceph.com/sepia/teuthology/?q=fb760227bf8546db8ecf2bfbcc7c3fc6

    reached maximum tries (60) after waiting for 900 seconds



Pass
=================================================================
[5192381] rados/singleton/{all/radostool msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:14:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192381/

[5192382] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192382/

[5192383] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/mon_recovery validater/lockdep}
time:   00:10:26
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192383/

[5192384] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start}
time:   00:11:56
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192384/

[5192385] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/write_fadvise_dontneed}
time:   00:13:52
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192385/

[5192386] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/hammer backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/few rados thrashers/none thrashosds-health workloads/rbd_cls}
time:   00:17:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192386/

[5192387] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_api_tests}
time:   00:37:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192387/

[5192388] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{rhel_latest} tasks/crash}
time:   00:13:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192388/

[5192389] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write}
time:   00:17:31
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192389/

[5192390] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:36:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192390/

[5192391] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192391/

[5192392] rados/singleton/{all/random-eio msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest}}
time:   00:24:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192392/

[5192393] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-bitmap supported-random-distro$/{ubuntu_latest} tasks/dashboard}
time:   01:03:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192393/

[5192394] rados/objectstore/{backends/alloc-hint supported-random-distro$/{rhel_latest}}
time:   00:15:51
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192394/

[5192395] rados/rest/{mgr-restful supported-random-distro$/{ubuntu_latest}}
time:   00:12:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192395/

[5192396] rados/singleton-nomsgr/{all/admin_socket_output rados supported-random-distro$/{centos_latest}}
time:   00:14:54
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192396/

[5192397] rados/standalone/{supported-random-distro$/{centos_latest} workloads/crush}
time:   00:13:52
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192397/

[5192398] rados/upgrade/mimic-x-singleton/{0-cluster/{openstack start} 1-install/mimic 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest}
time:   05:46:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192398/

[5192399] rados/valgrind-leaks/{1-start 2-inject-leak/mon centos_latest}
time:   00:19:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192399/

[5192400] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:18:56
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192400/

[5192401] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{ubuntu_latest}}
time:   00:11:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192401/

[5192402] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/readwrite}
time:   00:11:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192402/

[5192403] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:31
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192403/

[5192404] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:07:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192404/

[5192405] rados/cephadm/smoke/{distro/centos_7 fixed-2 start}
time:   00:14:12
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192405/

[5192406] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:26:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192406/

[5192407] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-agent-big}
time:   00:14:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192407/

[5192408] rados/singleton/{all/rebuild-mondb msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{rhel_latest}}
time:   00:18:43
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192408/

[5192409] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/many workloads/rados_mon_osdmap_prune}
time:   01:13:15
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192409/

[5192410] rados/cephadm/smoke-roleless/{distro/centos_7 start}
time:   00:13:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192410/

[5192411] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-small}
time:   00:16:28
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192411/

[5192412] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write}
time:   00:18:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192412/

[5192413] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{centos_latest} fixed-2}
time:   00:14:53
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192413/

[5192414] rados/singleton/{all/recovery-preemption msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:16:01
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192414/

[5192415] rados/singleton-nomsgr/{all/balancer rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192415/

[5192416] rados/cephadm/workunits/{distro/centos_latest task/test_adoption}
time:   00:11:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192416/

[5192417] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:28:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192417/

[5192418] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:25:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192418/

[5192419] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados tasks/rados_api_tests validater/valgrind}
time:   01:08:44
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192419/

[5192420] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/snaps-few-objects}
time:   00:37:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192420/

[5192421] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_python}
time:   00:27:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192421/

[5192422] rados/singleton/{all/resolve_stuck_peering msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:08:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192422/

[5192423] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_latest} tasks/failover}
time:   00:16:00
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192423/

[5192424] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps}
time:   00:27:05
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192424/

[5192425] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} tasks/repair_test}
time:   00:19:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192425/

[5192426] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:30:01
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192426/

[5192427] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start}
time:   00:11:22
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192427/

[5192428] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:13:53
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192428/

[5192429] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-snaps-few-objects-overwrites}
time:   00:25:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192429/

[5192430] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-zlib rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:28
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192430/

[5192431] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{rhel_latest} tasks/dashboard}
time:   01:06:01
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192431/

[5192432] rados/objectstore/{backends/ceph_objectstore_tool supported-random-distro$/{ubuntu_latest}}
time:   00:12:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192432/

[5192433] rados/singleton/{all/test-crash msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:13:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192433/

[5192434] rados/cephadm/smoke-roleless/{distro/centos_8.0 start}
time:   00:11:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192434/

[5192435] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/cache-snaps-balanced}
time:   00:24:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192435/

[5192436] rados/singleton-nomsgr/{all/cache-fs-trunc rados supported-random-distro$/{rhel_latest}}
time:   00:12:29
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192436/

[5192437] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v2only no_pools objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} tasks/mon_clock_with_skews}
time:   00:11:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192437/

[5192438] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-radosbench}
time:   02:29:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192438/

[5192439] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/one workloads/pool-create-delete}
time:   00:16:55
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192439/

[5192440] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm}
time:   00:21:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192440/

[5192441] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps}
time:   00:23:07
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192441/

[5192442] rados/singleton/{all/test_envlibrados_for_rocksdb msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192442/

[5192443] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/erasure-code}
time:   00:40:47
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192443/

[5192444] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async start tasks/rados_api_tests}
time:   00:35:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192444/

[5192445] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:12:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192445/

[5192446] rados/cephadm/smoke/{distro/centos_latest fixed-2 start}
time:   00:11:10
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192446/

[5192447] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/jewel backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/careful thrashosds-health workloads/test_rbd_api}
time:   00:20:27
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192447/

[5192448] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/cache}
time:   00:10:39
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192448/

[5192449] rados/singleton/{all/thrash-backfill-full msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_latest}}
time:   01:09:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192449/

[5192450] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192450/

[5192451] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados tasks/rados_cls_all validater/lockdep}
time:   00:17:14
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192451/

[5192452] rados/cephadm/smoke-roleless/{distro/centos_latest start}
time:   00:10:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192452/

[5192453] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} tasks/scrub_test}
time:   00:14:47
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192453/

[5192454] rados/singleton-nomsgr/{all/ceph-kvstore-tool rados supported-random-distro$/{rhel_latest}}
time:   00:15:05
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192454/

[5192455] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/dedup_tier}
time:   00:11:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192455/

[5192456] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{centos_latest} tasks/insights}
time:   00:11:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192456/

[5192457] rados/cephadm/smoke/{distro/rhel_7 fixed-2 start}
time:   00:13:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192457/

[5192458] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:25:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192458/

[5192459] rados/singleton/{all/thrash-eio msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:37:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192459/

[5192460] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:28
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192460/

[5192461] rados/cephadm/smoke-roleless/{distro/rhel_7 start}
time:   00:12:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192461/

[5192462] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/pool-snaps-few-objects}
time:   00:25:10
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192462/

[5192463] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_read}
time:   00:10:31
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192463/

[5192464] rados/multimon/{clusters/3 msgr-failures/many msgr/async no_pools objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} tasks/mon_recovery}
time:   00:10:25
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192464/

[5192465] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos}
time:   00:08:02
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192465/

[5192466] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:35:57
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192466/

[5192467] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-small-objects-balanced}
time:   00:25:55
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192467/

[5192468] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{rhel_latest} tasks/dashboard}
time:   01:05:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192468/

[5192469] rados/objectstore/{backends/filejournal supported-random-distro$/{rhel_latest}}
time:   00:11:54
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192469/

[5192470] rados/singleton/{all/thrash-rados/{thrash-rados thrashosds-health} msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest}}
time:   00:21:56
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192470/

[5192471] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/sync-many workloads/rados_5925}
time:   00:10:20
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192471/

[5192472] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/rados_api_tests}
time:   00:33:44
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192472/

[5192473] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async-v1only start tasks/rados_python}
time:   00:26:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192473/

[5192474] rados/singleton-nomsgr/{all/ceph-post-file rados supported-random-distro$/{centos_latest}}
time:   00:10:28
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192474/

[5192475] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/luminous-v1only backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/cache-snaps}
time:   00:32:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192475/

[5192476] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:24:00
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192476/

[5192477] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start}
time:   00:14:32
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192477/

[5192478] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/radosbench-high-concurrency}
time:   00:56:57
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192478/

[5192480] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} tasks/rados_api_tests}
time:   00:26:39
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192480/

[5192481] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start}
time:   00:13:44
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192481/

[5192482] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_rw}
time:   00:10:56
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192482/

[5192483] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:25:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192483/

[5192484] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zlib rados tasks/mon_recovery validater/valgrind}
time:   00:26:27
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192484/

[5192485] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/radosbench}
time:   01:29:44
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192485/

[5192486] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python}
time:   00:23:31
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192486/

[5192488] rados/singleton/{all/watch-notify-same-primary msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:08:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192488/

[5192489] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/mgr}
time:   00:13:58
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192489/

[5192490] rados/singleton-nomsgr/{all/export-after-evict rados supported-random-distro$/{centos_latest}}
time:   00:08:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192490/

[5192491] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:06
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192491/

[5192492] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:27
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192492/

[5192493] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption}
time:   00:13:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192493/

[5192494] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/redirect}
time:   00:15:30
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192494/

[5192495] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start}
time:   00:13:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192495/

[5192496] rados/singleton/{all/admin-socket msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:07:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192496/

[5192497] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:07:33
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192497/

[5192498] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4M_rand_write}
time:   00:11:15
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192498/

[5192499] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read}
time:   00:24:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192499/

[5192500] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/redirect_promote_tests}
time:   00:19:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192500/

[5192501] rados/cephadm/smoke-roleless/{distro/rhel_latest start}
time:   00:12:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192501/

[5192502] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest} thrashers/sync workloads/rados_api_tests}
time:   00:29:08
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192502/

[5192503] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/luminous backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/radosbench}
time:   01:20:12
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192503/

[5192504] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{ubuntu_latest} tasks/dashboard}
time:   01:03:27
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192504/

[5192505] rados/objectstore/{backends/filestore-idempotent-aio-journal supported-random-distro$/{centos_latest}}
time:   02:29:27
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192505/

[5192506] rados/valgrind-leaks/{1-start 2-inject-leak/none centos_latest}
time:   00:17:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192506/

[5192507] rados/singleton/{all/deduptool msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest}}
time:   00:15:52
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192507/

[5192508] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v2only start tasks/rados_api_tests}
time:   00:32:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192508/

[5192509] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} tasks/rados_cls_all}
time:   00:17:43
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192509/

[5192510] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/redirect_set_object}
time:   00:18:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192510/

[5192511] rados/singleton-nomsgr/{all/full-tiering rados supported-random-distro$/{ubuntu_latest}}
time:   00:07:44
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192511/

[5192512] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start}
time:   00:12:58
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192512/

[5192513] rados/singleton/{all/divergent_priors msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest}}
time:   00:13:08
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192513/

[5192514] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:14:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192514/

[5192515] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados tasks/rados_api_tests validater/lockdep}
time:   00:23:51
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192515/

[5192516] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/set-chunk-promote-flush}
time:   00:20:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192516/

[5192517] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start}
time:   00:12:02
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192517/

[5192518] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_4K_rand_read}
time:   00:11:58
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192518/

[5192519] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-lz4 supported-random-distro$/{ubuntu_latest} tasks/progress}
time:   00:15:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192519/

[5192520] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm}
time:   00:16:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192520/

[5192521] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:23:01
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192521/

[5192522] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:16:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192522/

[5192523] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/set-chunks-read}
time:   00:19:07
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192523/

[5192524] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:22:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192524/

[5192525] rados/singleton/{all/divergent_priors2 msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:09:03
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192525/

[5192526] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python}
time:   00:28:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192526/

[5192527] rados/singleton-nomsgr/{all/health-warnings rados supported-random-distro$/{ubuntu_latest}}
time:   00:12:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192527/

[5192529] rados/multimon/{clusters/9 msgr-failures/many msgr/async-v2only no_pools objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:07:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192529/

[5192530] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/small-objects-balanced}
time:   00:22:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192530/

[5192531] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start}
time:   00:14:01
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192531/

[5192532] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few objectstore/bluestore-comp-zstd rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-many-deletes}
time:   00:29:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192532/

[5192533] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} tasks/rados_python}
time:   00:17:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192533/

[5192534] rados/singleton/{all/dump-stuck msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest}}
time:   00:09:10
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192534/

[5192535] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4K_seq_read}
time:   00:10:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192535/

[5192537] rados/standalone/{supported-random-distro$/{centos_latest} workloads/misc}
time:   00:27:25
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192537/

[5192538] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start}
time:   00:12:29
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192538/

[5192539] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/small-objects-localized}
time:   00:18:28
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192539/

[5192540] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:36:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192540/

[5192541] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{rhel_latest} tasks/dashboard}
time:   01:08:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192541/

[5192542] rados/objectstore/{backends/filestore-idempotent supported-random-distro$/{rhel_latest}}
time:   02:27:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192542/

[5192543] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos}
time:   00:07:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192543/

[5192544] rados/singleton/{all/ec-lost-unfound msgr-failures/many msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest}}
time:   00:31:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192544/

[5192545] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/small-objects}
time:   00:20:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192545/

[5192546] rados/cephadm/smoke/{distro/ubuntu_latest fixed-2 start}
time:   00:13:03
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192546/

[5192547] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:27:25
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192547/

[5192548] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async objectstore/bluestore-hybrid rados tasks/rados_cls_all validater/valgrind}
time:   01:48:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192548/

[5192549] rados/singleton-nomsgr/{all/large-omap-object-warnings rados supported-random-distro$/{centos_latest}}
time:   00:11:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192549/

[5192550] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-snappy supported-random-distro$/{ubuntu_latest} tasks/prometheus}
time:   00:10:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192550/

[5192551] rados/cephadm/smoke-roleless/{distro/ubuntu_latest start}
time:   00:12:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192551/

[5192552] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/radosbench_4M_rand_read}
time:   00:11:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192552/

[5192553] rados/singleton/{all/erasure-code-nonregression msgr-failures/few msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest}}
time:   00:14:18
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192553/

[5192554] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:20
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192554/

[5192555] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/snaps-few-objects-balanced}
time:   00:28:08
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192555/

[5192556] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests}
time:   00:36:29
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192556/

[5192557] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:47
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192557/

[5192559] rados/upgrade/nautilus-x-singleton/{0-cluster/{openstack start} 1-install/nautilus 2-partial-upgrade/firsthalf 3-thrash/default 4-workload/{rbd-cls rbd-import-export readwrite snaps-few-objects} 5-workload/{radosbench rbd_api} 6-finish-upgrade 7-octopus 8-workload/{rbd-python snaps-many-objects} bluestore-bitmap thrashosds-health ubuntu_latest}
time:   03:47:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192559/

[5192560] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-zlib rados supported-random-distro$/{rhel_latest} tasks/rados_stress_watch}
time:   00:24:34
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192560/

[5192561] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/snaps-few-objects-localized}
time:   00:31:51
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192561/

[5192562] rados/cephadm/orchestrator_cli/{2-node-mgr orchestrator_cli supported-random-distro$/{rhel_latest}}
time:   00:16:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192562/

[5192563] rados/singleton/{all/lost-unfound-delete msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:27:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192563/

[5192565] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/osd-delay objectstore/bluestore-hybrid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/minsize_recovery thrashosds-health workloads/ec-small-objects}
time:   00:24:32
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192565/

[5192566] rados/cephadm/smoke/{distro/centos_7 fixed-2 start}
time:   00:16:22
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192566/

[5192567] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} thrashers/many workloads/rados_mon_workunits}
time:   00:30:03
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192567/

[5192568] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/few rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:25:30
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192568/

[5192569] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/snaps-few-objects}
time:   00:24:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192569/

[5192570] rados/singleton-nomsgr/{all/lazy_omap_stats_output rados supported-random-distro$/{rhel_latest}}
time:   00:13:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192570/

[5192571] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/radosbench_4M_seq_read}
time:   00:11:05
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192571/

[5192572] rados/singleton/{all/lost-unfound msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest}}
time:   00:31:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192572/

[5192573] rados/cephadm/smoke-roleless/{distro/centos_7 start}
time:   00:13:22
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192573/

[5192574] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-partial-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{rhel_latest} thrashers/morepggrow thrashosds-health workloads/write_fadvise_dontneed}
time:   00:18:20
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192574/

[5192575] rados/cephadm/upgrade/{1-start 2-start-upgrade 3-wait distro$/{rhel_7} fixed-2}
time:   00:17:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192575/

[5192576] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{rhel_latest} tasks/dashboard}
time:   01:07:33
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192576/

[5192577] rados/objectstore/{backends/fusestore supported-random-distro$/{rhel_latest}}
time:   00:14:06
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192577/

[5192578] rados/singleton/{all/max-pg-per-osd.from-mon msgr-failures/many msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{rhel_latest}}
time:   00:11:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192578/

[5192579] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-active-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192579/

[5192580] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados tasks/mon_recovery validater/lockdep}
time:   00:10:35
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192580/

[5192581] rados/cephadm/workunits/{distro/centos_latest task/test_adoption}
time:   00:11:52
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192581/

[5192582] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zlib supported-random-distro$/{rhel_latest} tasks/workunits}
time:   00:15:33
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192582/

[5192583] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/mon}
time:   00:56:25
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192583/

[5192584] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:14:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192584/

[5192585] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/none thrashosds-health workloads/admin_socket_objecter_requests}
time:   00:19:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192585/

[5192586] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus-v1only backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/pggrow thrashosds-health workloads/test_rbd_api}
time:   00:21:06
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192586/

[5192587] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python}
time:   00:26:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192587/

[5192588] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/radosbench_4M_write}
time:   00:10:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192588/

[5192589] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest} tasks/rados_striper}
time:   00:09:08
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192589/

[5192590] rados/singleton-nomsgr/{all/librados_hello_world rados supported-random-distro$/{centos_latest}}
time:   00:12:54
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192590/

[5192591] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:30:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192591/

[5192592] rados/singleton/{all/max-pg-per-osd.from-primary msgr-failures/few msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192592/

[5192593] rados/cephadm/smoke/{distro/centos_8.0 fixed-2 start}
time:   00:11:39
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192593/

[5192594] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/pggrow thrashosds-health workloads/cache-agent-big}
time:   00:19:32
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192594/

[5192595] rados/multimon/{clusters/3 msgr-failures/many msgr/async-v1only no_pools objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} tasks/mon_clock_no_skews}
time:   00:07:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192595/

[5192596] rados/cephadm/smoke-roleless/{distro/centos_8.0 start}
time:   00:11:08
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192596/

[5192597] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/fastclose objectstore/bluestore-low-osd-mem-target rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=clay-k=4-m=2}
time:   00:30:38
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192597/

[5192598] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/cache-agent-small}
time:   00:11:52
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192598/

[5192599] rados/singleton/{all/max-pg-per-osd.from-replica msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{ubuntu_latest}}
time:   00:11:57
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192599/

[5192600] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} thrashers/one workloads/snaps-few-objects}
time:   00:40:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192600/

[5192601] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm}
time:   00:21:25
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192601/

[5192602] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/radosbench_omap_write}
time:   00:21:52
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192602/

[5192603] rados/cephadm/with-work/{distro/ubuntu_18.04_podman fixed-2 mode/root msgr/async start tasks/rados_api_tests}
time:   00:35:53
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192603/

[5192604] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/cache-pool-snaps-readproxy}
time:   00:22:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192604/

[5192605] rados/singleton-nomsgr/{all/msgr rados supported-random-distro$/{centos_latest}}
time:   00:14:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192605/

[5192606] rados/singleton/{all/mon-auth-caps msgr-failures/few msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:12:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192606/

[5192607] rados/cephadm/smoke/{distro/centos_latest fixed-2 start}
time:   00:11:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192607/

[5192608] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-comp-zstd supported-random-distro$/{ubuntu_latest} tasks/crash}
time:   00:10:09
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192608/

[5192609] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:30:05
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192609/

[5192611] rados/singleton-bluestore/{all/cephtool msgr-failures/many msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest}}
time:   00:36:34
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192611/

[5192612] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{default} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/cache-pool-snaps}
time:   00:27:14
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192612/

[5192613] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-pool-snaps-few-objects-overwrites}
time:   00:29:22
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192613/

[5192614] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:30
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192614/

[5192616] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{centos_latest} tasks/dashboard}
time:   01:02:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192616/

[5192617] rados/objectstore/{backends/keyvaluedb supported-random-distro$/{rhel_latest}}
time:   00:11:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192617/

[5192618] rados/valgrind-leaks/{1-start 2-inject-leak/osd centos_latest}
time:   00:20:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192618/

[5192619] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async-v1only objectstore/bluestore-hybrid rados supported-random-distro$/{ubuntu_latest} tasks/rados_workunit_loadgen_big}
time:   00:34:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192619/

[5192620] rados/cephadm/smoke-roleless/{distro/centos_latest start}
time:   00:10:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192620/

[5192621] rados/singleton/{all/mon-config-key-caps msgr-failures/many msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:13:54
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192621/

[5192622] rados/cephadm/with-work/{distro/centos_8.0 fixed-2 mode/packaged msgr/async start tasks/rados_python}
time:   00:23:47
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192622/

[5192623] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/cache-snaps-balanced}
time:   00:24:21
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192623/

[5192624] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-async-partial-recovery} supported-random-distro$/{centos_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:24:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192624/

[5192625] rados/perf/{ceph objectstore/bluestore-low-osd-mem-target openstack settings/optimized ubuntu_latest workloads/sample_fio}
time:   00:12:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192625/

[5192626] rados/cephadm/smoke/{distro/rhel_7 fixed-2 start}
time:   00:13:47
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192626/

[5192627] rados/singleton/{all/mon-config-keys msgr-failures/few msgr/async-v1only objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest}}
time:   00:20:20
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192627/

[5192628] rados/singleton-nomsgr/{all/multi-backfill-reject rados supported-random-distro$/{rhel_latest}}
time:   00:25:53
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192628/

[5192629] rados/multimon/{clusters/6 msgr-failures/few msgr/async-v2only no_pools objectstore/filestore-xfs rados supported-random-distro$/{centos_latest} tasks/mon_clock_with_skews}
time:   00:07:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192629/

[5192630] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest} thrashers/none thrashosds-health workloads/cache-snaps}
time:   00:19:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192630/

[5192631] rados/standalone/{supported-random-distro$/{rhel_latest} workloads/osd}
time:   02:55:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192631/

[5192632] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/few objectstore/bluestore-stupid rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/pggrow thrashosds-health workloads/ec-rados-plugin=jerasure-k=2-m=1}
time:   00:30:14
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192632/

[5192633] rados/cephadm/smoke-roleless/{distro/rhel_7 start}
time:   00:12:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192633/

[5192634] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{rhel_latest} thrashers/sync-many workloads/pool-create-delete}
time:   00:19:26
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192634/

[5192635] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm_repos}
time:   00:07:58
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192635/

[5192636] rados/singleton/{all/mon-config msgr-failures/many msgr/async-v2only objectstore/filestore-xfs rados supported-random-distro$/{centos_latest}}
time:   00:12:46
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192636/

[5192637] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/cache}
time:   00:11:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192637/

[5192638] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/sample_radosbench}
time:   00:10:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192638/

[5192639] rados/cephadm/smoke/{distro/rhel_8.0 fixed-2 start}
time:   00:16:43
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192639/

[5192640] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/nautilus backoff/peering ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_7.6} msgr-failures/few rados thrashers/default thrashosds-health workloads/radosbench}
time:   01:39:28
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192640/

[5192641] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v2only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{centos_latest} tasks/rados_workunit_loadgen_mix}
time:   00:24:05
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192641/

[5192642] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest} thrashers/careful thrashosds-health workloads/dedup_tier}
time:   00:12:32
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192642/

[5192643] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-hybrid supported-random-distro$/{ubuntu_latest} tasks/failover}
time:   00:12:16
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192643/

[5192644] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/osd-delay objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:15:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192644/

[5192645] rados/singleton/{all/osd-backfill msgr-failures/few msgr/async objectstore/bluestore-bitmap rados supported-random-distro$/{ubuntu_latest}}
time:   00:19:57
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192645/

[5192646] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:10:29
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192646/

[5192647] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/none msgr-failures/few msgr/async objectstore/filestore-xfs rados tasks/rados_cls_all validater/lockdep}
time:   00:16:20
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192647/

[5192648] rados/cephadm/smoke-roleless/{distro/rhel_8.0 start}
time:   00:13:58
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192648/

[5192649] rados/singleton-nomsgr/{all/osd_stale_reads rados supported-random-distro$/{ubuntu_latest}}
time:   00:17:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192649/

[5192650] rados/cephadm/with-work/{distro/centos_latest fixed-2 mode/root msgr/async-v1only start tasks/rados_api_tests}
time:   00:33:53
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192650/

[5192651] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{ubuntu_latest} tasks/dashboard}
time:   01:04:03
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192651/

[5192652] rados/objectstore/{backends/objectcacher-stress supported-random-distro$/{ubuntu_latest}}
time:   00:31:42
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192652/

[5192653] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{default} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-hybrid rados supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/pool-snaps-few-objects}
time:   00:33:29
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192653/

[5192654] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:27:38
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192654/

[5192655] rados/singleton/{all/osd-recovery-incomplete msgr-failures/many msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:20:33
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192655/

[5192656] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_adoption}
time:   00:13:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192656/

[5192657] rados/perf/{ceph objectstore/bluestore-stupid openstack settings/optimized ubuntu_latest workloads/cosbench_64K_read_write}
time:   00:16:38
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192657/

[5192658] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/rados_api_tests}
time:   00:24:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192658/

[5192659] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay rados recovery-overrides/{more-active-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-small-objects-fast-read-overwrites}
time:   00:25:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192659/

[5192660] rados/multimon/{clusters/9 msgr-failures/many msgr/async no_pools objectstore/bluestore-bitmap rados supported-random-distro$/{rhel_latest} tasks/mon_recovery}
time:   00:19:36
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192660/

[5192661] rados/cephadm/smoke/{distro/rhel_latest fixed-2 start}
time:   00:13:10
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192661/

[5192662] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/fast msgr-failures/osd-delay objectstore/filestore-xfs rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=jerasure-k=3-m=1}
time:   00:23:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192662/

[5192663] rados/singleton/{all/osd-recovery msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-snappy rados supported-random-distro$/{centos_latest}}
time:   00:13:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192663/

[5192664] rados/cephadm/smoke-roleless/{distro/rhel_latest start}
time:   00:12:40
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192664/

[5192665] rados/singleton-nomsgr/{all/pool-access rados supported-random-distro$/{centos_latest}}
time:   00:11:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192665/

[5192666] rados/monthrash/{ceph clusters/9-mons msgr-failures/mon-delay msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/sync workloads/rados_5925}
time:   00:10:13
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192666/

[5192667] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-stupid rados supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/radosbench-high-concurrency}
time:   00:40:35
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192667/

[5192668] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/many msgr/async objectstore/bluestore-stupid rados supported-random-distro$/{rhel_latest} tasks/rados_workunit_loadgen_mostlyread}
time:   00:35:31
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192668/

[5192669] rados/thrash-old-clients/{0-size-min-size-overrides/2-size-2-min-size 1-install/hammer backoff/peering_and_degraded ceph clusters/{openstack three-plus-one} d-balancer/crush-compat distro$/{centos_7.6} msgr-failures/osd-delay rados thrashers/mapgap thrashosds-health workloads/rbd_cls}
time:   00:20:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192669/

[5192670] rados/cephadm/with-work/{distro/rhel_8.0 fixed-2 mode/packaged msgr/async-v2only start tasks/rados_python}
time:   00:28:26
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192670/

[5192671] rados/singleton/{all/peer msgr-failures/many msgr/async objectstore/bluestore-comp-zlib rados supported-random-distro$/{ubuntu_latest}}
time:   00:08:24
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192671/

[5192672] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-partial-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/none thrashosds-health workloads/radosbench}
time:   01:11:11
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192672/

[5192673] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/fastclose objectstore/bluestore-comp-snappy rados recovery-overrides/{more-active-recovery} supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:31
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192673/

[5192674] rados/perf/{ceph objectstore/bluestore-basic-min-osd-mem-target openstack settings/optimized ubuntu_latest workloads/cosbench_64K_write}
time:   00:16:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192674/

[5192675] rados/cephadm/smoke/{distro/ubuntu_18.04 fixed-2 start}
time:   00:13:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192675/

[5192676] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-low-osd-mem-target supported-random-distro$/{ubuntu_latest} tasks/insights}
time:   00:12:19
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192676/

[5192677] rados/standalone/{supported-random-distro$/{ubuntu_latest} workloads/scrub}
time:   01:19:22
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192677/

[5192678] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/mapgap thrashosds-health workloads/ec-rados-plugin=jerasure-k=4-m=2}
time:   00:26:57
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192678/

[5192679] rados/verify/{centos_latest ceph clusters/{fixed-2 openstack} d-thrash/default/{default thrashosds-health} msgr-failures/few msgr/async-v1only objectstore/bluestore-bitmap rados tasks/rados_cls_all validater/valgrind}
time:   01:50:29
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192679/

[5192680] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04 start}
time:   00:12:25
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192680/

[5192681] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-bitmap rados supported-random-distro$/{centos_latest} thrashers/pggrow thrashosds-health workloads/redirect}
time:   00:12:37
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192681/

[5192682] rados/singleton/{all/pg-autoscaler msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-zstd rados supported-random-distro$/{centos_latest}}
time:   00:13:43
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192682/

[5192683] rados/cephadm/workunits/{distro/centos_latest task/test_cephadm}
time:   00:16:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192683/

[5192684] rados/singleton-nomsgr/{all/recovery-unfound-found rados supported-random-distro$/{ubuntu_latest}}
time:   00:28:04
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192684/

[5192685] rados/singleton-bluestore/{all/cephtool msgr-failures/few msgr/async-v1only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest}}
time:   00:36:51
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192685/

[5192686] rados/thrash-erasure-code-isa/{arch/x86_64 ceph clusters/{fixed-2 openstack} msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{default} supported-random-distro$/{centos_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=isa-k=2-m=1}
time:   00:26:30
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192686/

[5192687] rados/dashboard/{clusters/{2-node-mgr} debug/mgr objectstore/filestore-xfs supported-random-distro$/{ubuntu_latest} tasks/dashboard}
time:   01:02:48
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192687/

[5192689] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering ceph clusters/{fixed-2 openstack} d-balancer/off msgr-failures/few msgr/async-v2only objectstore/bluestore-comp-lz4 rados supported-random-distro$/{ubuntu_latest} thrashers/careful thrashosds-health workloads/redirect_promote_tests}
time:   00:14:44
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192689/

[5192690] rados/cephadm/with-work/{distro/rhel_latest fixed-2 mode/root msgr/async start tasks/rados_api_tests}
time:   00:37:00
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192690/

[5192691] rados/singleton/{all/pg-removal-interruption msgr-failures/many msgr/async-v2only objectstore/bluestore-hybrid rados supported-random-distro$/{centos_latest}}
time:   00:07:51
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192691/

[5192692] rados/multimon/{clusters/21 msgr-failures/few msgr/async-v1only no_pools objectstore/bluestore-comp-lz4 rados supported-random-distro$/{centos_latest} tasks/mon_clock_no_skews}
time:   00:07:50
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192692/

[5192693] rados/perf/{ceph objectstore/bluestore-bitmap openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_read}
time:   00:12:18
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192693/

[5192694] rados/cephadm/smoke/{distro/ubuntu_18.04_podman fixed-2 start}
time:   00:14:00
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192694/

[5192695] rados/thrash-erasure-code/{ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose objectstore/bluestore-bitmap rados recovery-overrides/{more-partial-recovery} supported-random-distro$/{rhel_latest} thrashers/default thrashosds-health workloads/ec-radosbench}
time:   01:45:05
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192695/

[5192696] rados/basic/{ceph clusters/{fixed-2 openstack} msgr-failures/few msgr/async-v1only objectstore/filestore-xfs rados supported-random-distro$/{ubuntu_latest} tasks/readwrite}
time:   00:11:17
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192696/

[5192697] rados/thrash/{0-size-min-size-overrides/2-size-2-min-size 1-pg-log-overrides/normal_pg_log 2-recovery-overrides/{more-active-recovery} backoff/peering_and_degraded ceph clusters/{fixed-2 openstack} d-balancer/upmap msgr-failures/osd-delay msgr/async objectstore/bluestore-comp-snappy rados supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/redirect_set_object}
time:   00:13:20
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192697/

[5192698] rados/thrash-old-clients/{0-size-min-size-overrides/3-size-2-min-size 1-install/jewel-v1only backoff/normal ceph clusters/{openstack three-plus-one} d-balancer/off distro$/{centos_7.6} msgr-failures/fastclose rados thrashers/morepggrow thrashosds-health workloads/snaps-few-objects}
time:   00:37:45
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192698/

[5192699] rados/monthrash/{ceph clusters/3-mons msgr-failures/few msgr/async objectstore/filestore-xfs rados supported-random-distro$/{rhel_latest} thrashers/force-sync-many workloads/rados_api_tests}
time:   00:29:49
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192699/

[5192700] rados/cephadm/smoke-roleless/{distro/ubuntu_18.04_podman start}
time:   00:12:23
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192700/

[5192701] rados/singleton/{all/radostool msgr-failures/few msgr/async objectstore/bluestore-low-osd-mem-target rados supported-random-distro$/{ubuntu_latest}}
time:   00:16:26
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192701/

[5192702] rados/thrash/{0-size-min-size-overrides/3-size-2-min-size 1-pg-log-overrides/short_pg_log 2-recovery-overrides/{more-async-recovery} backoff/normal ceph clusters/{fixed-2 openstack} d-balancer/crush-compat msgr-failures/fastclose msgr/async-v1only objectstore/bluestore-comp-zlib rados supported-random-distro$/{centos_latest} thrashers/mapgap thrashosds-health workloads/set-chunk-promote-flush}
time:   00:12:59
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192702/

[5192703] rados/singleton-nomsgr/{all/version-number-sanity rados supported-random-distro$/{centos_latest}}
time:   00:12:15
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192703/

[5192704] rados/cephadm/workunits/{distro/ubuntu_18.04_podman task/test_cephadm_repos}
time:   00:07:55
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192704/

[5192705] rados/thrash-erasure-code-overwrites/{bluestore-bitmap ceph clusters/{fixed-2 openstack} fast/normal msgr-failures/fastclose rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/fastread thrashosds-health workloads/ec-small-objects-overwrites}
time:   00:21:13
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192705/

[5192706] rados/thrash-erasure-code-shec/{ceph clusters/{fixed-4 openstack} msgr-failures/few objectstore/bluestore-comp-zlib rados recovery-overrides/{more-async-recovery} supported-random-distro$/{ubuntu_latest} thrashers/default thrashosds-health workloads/ec-rados-plugin=shec-k=4-m=3-c=2}
time:   00:11:56
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192706/

[5192707] rados/mgr/{clusters/{2-node-mgr} debug/mgr objectstore/bluestore-stupid supported-random-distro$/{rhel_latest} tasks/module_selftest}
time:   00:30:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192707/

[5192708] rados/cephadm/with-work/{distro/ubuntu_18.04 fixed-2 mode/packaged msgr/async-v1only start tasks/rados_python}
time:   00:26:41
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192708/

[5192709] rados/perf/{ceph objectstore/bluestore-comp openstack settings/optimized ubuntu_latest workloads/fio_4K_rand_rw}
time:   00:13:32
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192709/

[5192710] rados/thrash-erasure-code-big/{ceph cluster/{12-osds openstack} msgr-failures/few objectstore/bluestore-comp-lz4 rados recovery-overrides/{default} supported-random-distro$/{ubuntu_latest} thrashers/morepggrow thrashosds-health workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}
time:   00:11:12
info:   http://pulpito.ceph.com/teuthology-2020-07-01_03:30:03-rados-octopus-distro-basic-smithi/5192710/