Found 6 jobs Ignoring malparsed backtrace: ceph version 14.2.11-111-g93c5d14 (93c5d149177634d9a3196c2990e4c0af398f8a4d) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7fe009429524] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x13e8) [0x559bae079378] Ignoring malparsed backtrace: 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout:{ , 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "a244e989-1818-4ba5-ad4f-fb2f6364d428", , 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout: "health": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_osds": 8, , 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_up_osds": 8, , 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_in_osds": 8, Ignoring malparsed backtrace: 2020-11-12T12:07:52.054 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.054 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.055 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_max_iterations": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_HOST": { , 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_HOST", , 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:52.140 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.140 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.141 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.209 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:07:52.209 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", , 2020-11-12T12:07:52.210 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "diskprediction_server": { , 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_server", , 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.237 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.237 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.238 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.293 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption1", , 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", , 2020-11-12T12:07:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "address", , 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "proxy": { , 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "proxy", , 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_sender": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_port": { , 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_port", , 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:52.401 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.401 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.402 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0.001", , 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "0.999", , 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.429 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", , 2020-11-12T12:07:52.429 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", , 2020-11-12T12:07:52.430 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.456 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.456 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "REST_REQUESTS_TIMEOUT": { , 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "REST_REQUESTS_TIMEOUT", , 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:52.483 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.483 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.484 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:52.497 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.498 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.498 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically mark OSD if it may fail before this long", , 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.579 INFO:teuthology.orchestra.run.smithi044.stdout: "username": { , 2020-11-12T12:07:52.580 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "username", , 2020-11-12T12:07:52.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: "prefix": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to persist completed events", , 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, , 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", , 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": {} Ignoring malparsed backtrace: 2020-11-12T12:07:52.634 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.634 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.648 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.649 INFO:teuthology.orchestra.run.smithi044.stdout: "testnewline": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", , 2020-11-12T12:07:52.664 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.664 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", , 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.691 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:07:52.691 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", , 2020-11-12T12:07:52.692 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, Ignoring malparsed backtrace: 2020-11-12T12:07:52.705 INFO:teuthology.orchestra.run.smithi044.stdout: "services": {} , 2020-11-12T12:07:52.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.706 INFO:teuthology.orchestra.run.smithi044.stdout: "progress_events": {} Ignoring malparsed backtrace: 2020-11-12 12:08:16.930 7f2f3f453700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:08:17.043 7f2f3f453700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T12:08:17.084 INFO:teuthology.orchestra.run.smithi044.stdout:1052266987607 Ignoring malparsed backtrace: 2020-11-12T12:08:26.986 INFO:teuthology.orchestra.run.smithi044.stdout: "a", , 2020-11-12T12:08:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: "b", , 2020-11-12T12:08:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: "c" Ignoring malparsed backtrace: 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: "state_name": "active+clean+scrubbing", , 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: "count": 1 , 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: } Ignoring malparsed backtrace: 2020-11-12T12:08:27.026 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.027 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.047 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.047 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.048 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.064 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.064 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:08:27.065 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "pgs,objects,bytes", Ignoring malparsed backtrace: 2020-11-12T12:08:27.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", , 2020-11-12T12:08:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, Ignoring malparsed backtrace: 2020-11-12T12:08:27.092 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", , 2020-11-12T12:08:27.093 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.093 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.106 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.106 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.107 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.122 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.123 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SECRET_KEY": { , 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SECRET_KEY", , 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:08:27.150 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.151 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.151 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.164 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.165 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise health warning if OSD may fail before this long", , 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "localhost", , 2020-11-12T12:08:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "influx", Ignoring malparsed backtrace: 2020-11-12T12:08:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default replica count for any created local pool", , 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "50", , 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stale_cache_strategy", , 2020-11-12T12:08:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.415 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.415 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.416 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.440 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/report", , 2020-11-12T12:08:27.440 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.441 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.458 INFO:teuthology.orchestra.run.smithi044.stdout: } , 2020-11-12T12:08:27.459 INFO:teuthology.orchestra.run.smithi044.stdout: ], , 2020-11-12T12:08:27.459 INFO:teuthology.orchestra.run.smithi044.stdout: "modules": [ Ignoring malparsed backtrace: 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "balancer", Ignoring malparsed backtrace: 2020-11-12T12:08:27.505 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.505 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_cephfs": { , 2020-11-12T12:08:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_cephfs", Ignoring malparsed backtrace: 2020-11-12T12:08:27.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", , 2020-11-12T12:08:27.550 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.593 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.594 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.607 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "sharedsecret", , 2020-11-12T12:08:27.608 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "retention_period": { , 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retention_period", , 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", Ignoring malparsed backtrace: 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: "diskprediction_user": { , 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_user", Ignoring malparsed backtrace: 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "true", , 2020-11-12T12:08:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "rack", Ignoring malparsed backtrace: 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption3": { , 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption3", , 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", Ignoring malparsed backtrace: 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssh", , 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, , 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:29.828 INFO:teuthology.orchestra.run.smithi044.stdout: , dumped all , 2020-11-12T12:08:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":975,"stamp":"2020-11-12 12:08:28.580429","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":9000640,"kb_used_data":611968,"kb_used_omap":1496,"kb_used_meta":8387111,"kb_avail":745974080,"statfs":{"total":773094113280,"available":763877457920,"internally_reserved":8589934592,"allocated":626655232,"data_stored":749813723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1532414,"internal_metadata":8588402178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003615"},"pg_stats":[{"pgid":"2.f","version":"605'975","reported_seq":"5179","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.048094","last_change":"2020-11-12 12:07:44.339133","last_active":"2020-11-12 12:08:13.048094","last_peered":"2020-11-12 12:08:13.048094","last_clean":"2020-11-12 12:08:13.048094","last_became_active":"2020-11-12 12:07:43.542344","last_became_peered":"2020-11-12 12:07:43.542344","last_unstale":"2020-11-12 12:08:13.048094","last_undegraded":"2020-11-12 12:08:13.048094","last_fullsized":"2020-11-12 12:08:13.048094","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":975,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":36964515,"num_objects":22,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":222,"num_read_kb":276029,"num_write":279,"num_write_kb":64344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":676764753,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"606'755","reported_seq":"3298","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053607","last_change":"2020-11-12 12:07:45.720783","last_active":"2020-11-12 12:08:13.053607","last_peered":"2020-11-12 12:08:13.053607","last_clean":"2020-11-12 12:08:13.053607","last_became_active":"2020-11-12 12:07:44.559898","last_became_peered":"2020-11-12 12:07:44.559898","last_unstale":"2020-11-12 12:08:13.053607","last_undegraded":"2020-11-12 12:08:13.053607","last_fullsized":"2020-11-12 12:08:13.053607","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":44542027,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":142,"num_read_kb":168636,"num_write":206,"num_write_kb":48990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":220359844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"126","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.561197","last_change":"2020-11-12 12:07:34.980292","last_active":"2020-11-12 12:08:12.561197","last_peered":"2020-11-12 12:08:12.561197","last_clean":"2020-11-12 12:08:12.561197","last_became_active":"2020-11-12 12:07:34.979587","last_became_peered":"2020-11-12 12:07:34.979587","last_unstale":"2020-11-12 12:08:12.561197","last_undegraded":"2020-11-12 12:08:12.561197","last_fullsized":"2020-11-12 12:08:12.561197","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:50.045143","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:01:01.411425","last_clean_scrub_stamp":"2020-11-12 12:06:50.045143","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"607'1034","reported_seq":"4531","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567601","last_change":"2020-11-12 12:07:45.706465","last_active":"2020-11-12 12:08:12.567601","last_peered":"2020-11-12 12:08:12.567601","last_clean":"2020-11-12 12:08:12.567601","last_became_active":"2020-11-12 12:07:45.566064","last_became_peered":"2020-11-12 12:07:45.566064","last_unstale":"2020-11-12 12:08:12.567601","last_undegraded":"2020-11-12 12:08:12.567601","last_fullsized":"2020-11-12 12:08:12.567601","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":1034,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63069801,"num_objects":33,"num_object_clones":27,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":227,"num_read_kb":245644,"num_write":327,"num_write_kb":79050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":626,"num_bytes_recovered":710613985,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376795","last_change":"2020-11-12 12:07:07.510609","last_active":"2020-11-12 12:08:13.376795","last_peered":"2020-11-12 12:08:13.376795","last_clean":"2020-11-12 12:08:13.376795","last_became_active":"2020-11-12 12:06:38.531854","last_became_peered":"2020-11-12 12:06:38.531854","last_unstale":"2020-11-12 12:08:13.376795","last_undegraded":"2020-11-12 12:08:13.376795","last_fullsized":"2020-11-12 12:08:13.376795","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:07.510477","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:07:07.510477","last_clean_scrub_stamp":"2020-11-12 12:07:07.510477","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"605'571","reported_seq":"3045","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376977","last_change":"2020-11-12 12:07:44.295346","last_active":"2020-11-12 12:08:13.376977","last_peered":"2020-11-12 12:08:13.376977","last_clean":"2020-11-12 12:08:13.376977","last_became_active":"2020-11-12 12:07:43.546299","last_became_peered":"2020-11-12 12:07:43.546299","last_unstale":"2020-11-12 12:08:13.376977","last_undegraded":"2020-11-12 12:08:13.376977","last_fullsized":"2020-11-12 12:08:13.376977","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":571,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41575305,"num_objects":15,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":110,"num_read_kb":112384,"num_write":178,"num_write_kb":39453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":214562650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"631","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047347","last_change":"2020-11-12 12:07:05.341895","last_active":"2020-11-12 12:08:13.047347","last_peered":"2020-11-12 12:08:13.047347","last_clean":"2020-11-12 12:08:13.047347","last_became_active":"2020-11-12 12:06:37.605758","last_became_peered":"2020-11-12 12:06:37.605758","last_unstale":"2020-11-12 12:08:13.047347","last_undegraded":"2020-11-12 12:08:13.047347","last_fullsized":"2020-11-12 12:08:13.047347","mapping_epoch":559,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":560,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:05.341782","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:05.341782","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"605'852","reported_seq":"3625","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053157","last_change":"2020-11-12 12:07:43.726533","last_active":"2020-11-12 12:08:13.053157","last_peered":"2020-11-12 12:08:13.053157","last_clean":"2020-11-12 12:08:13.053157","last_became_active":"2020-11-12 12:07:43.552867","last_became_peered":"2020-11-12 12:07:43.552867","last_unstale":"2020-11-12 12:08:13.053157","last_undegraded":"2020-11-12 12:08:13.053157","last_fullsized":"2020-11-12 12:08:13.053157","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":852,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40651861,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":176,"num_read_kb":237784,"num_write":229,"num_write_kb":51463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":336631858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"423","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566243","last_change":"2020-11-12 12:07:06.161566","last_active":"2020-11-12 12:08:12.566243","last_peered":"2020-11-12 12:08:12.566243","last_clean":"2020-11-12 12:08:12.566243","last_became_active":"2020-11-12 12:07:02.730087","last_became_peered":"2020-11-12 12:07:02.730087","last_unstale":"2020-11-12 12:08:12.566243","last_undegraded":"2020-11-12 12:08:12.566243","last_fullsized":"2020-11-12 12:08:12.566243","mapping_epoch":580,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:06.161501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:06.161501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"605'787","reported_seq":"3194","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376911","last_change":"2020-11-12 12:07:43.680183","last_active":"2020-11-12 12:08:13.376911","last_peered":"2020-11-12 12:08:13.376911","last_clean":"2020-11-12 12:08:13.376911","last_became_active":"2020-11-12 12:07:43.540815","last_became_peered":"2020-11-12 12:07:43.540815","last_unstale":"2020-11-12 12:08:13.376911","last_undegraded":"2020-11-12 12:08:13.376911","last_fullsized":"2020-11-12 12:08:13.376911","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":787,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43160093,"num_objects":20,"num_object_clones":17,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":133,"num_read_kb":120761,"num_write":220,"num_write_kb":54232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":209150928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"134","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.560847","last_change":"2020-11-12 12:07:44.529416","last_active":"2020-11-12 12:08:12.560847","last_peered":"2020-11-12 12:08:12.560847","last_clean":"2020-11-12 12:08:12.560847","last_became_active":"2020-11-12 12:07:40.996832","last_became_peered":"2020-11-12 12:07:40.996832","last_unstale":"2020-11-12 12:08:12.560847","last_undegraded":"2020-11-12 12:08:12.560847","last_fullsized":"2020-11-12 12:08:12.560847","mapping_epoch":601,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":602,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:44.529241","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:44.529241","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"607'461","reported_seq":"3496","reported_epoch":"619","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:08:13.376948","last_change":"2020-11-12 12:07:48.505159","last_active":"2020-11-12 12:08:13.376948","last_peered":"2020-11-12 12:08:13.376948","last_clean":"2020-11-12 12:08:13.376948","last_became_active":"2020-11-12 12:07:45.558646","last_became_peered":"2020-11-12 12:07:45.558646","last_unstale":"2020-11-12 12:08:13.376948","last_undegraded":"2020-11-12 12:08:13.376948","last_fullsized":"2020-11-12 12:08:13.376948","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":461,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22082484,"num_objects":10,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":79,"num_read_kb":73364,"num_write":120,"num_write_kb":28596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":226411123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376678","last_change":"2020-11-12 12:07:14.479425","last_active":"2020-11-12 12:08:13.376678","last_peered":"2020-11-12 12:08:13.376678","last_clean":"2020-11-12 12:08:13.376678","last_became_active":"2020-11-12 12:06:38.526587","last_became_peered":"2020-11-12 12:06:38.526587","last_unstale":"2020-11-12 12:08:13.376678","last_undegraded":"2020-11-12 12:08:13.376678","last_fullsized":"2020-11-12 12:08:13.376678","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:14.479334","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:14.479334","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"605'236","reported_seq":"2602","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376934","last_change":"2020-11-12 12:07:43.679033","last_active":"2020-11-12 12:08:13.376934","last_peered":"2020-11-12 12:08:13.376934","last_clean":"2020-11-12 12:08:13.376934","last_became_active":"2020-11-12 12:07:43.544179","last_became_peered":"2020-11-12 12:07:43.544179","last_unstale":"2020-11-12 12:08:13.376934","last_undegraded":"2020-11-12 12:08:13.376934","last_fullsized":"2020-11-12 12:08:13.376934","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":236,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8892018,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":52270,"num_write":58,"num_write_kb":14437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":101718835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"605'185","reported_seq":"2708","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566247","last_change":"2020-11-12 12:07:43.627236","last_active":"2020-11-12 12:08:12.566247","last_peered":"2020-11-12 12:08:12.566247","last_clean":"2020-11-12 12:08:12.566247","last_became_active":"2020-11-12 12:07:43.549723","last_became_peered":"2020-11-12 12:07:43.549723","last_unstale":"2020-11-12 12:08:12.566247","last_undegraded":"2020-11-12 12:08:12.566247","last_fullsized":"2020-11-12 12:08:12.566247","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5743030,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":84824,"num_write":57,"num_write_kb":16290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":83699520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"242","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047777","last_change":"2020-11-12 12:07:26.910728","last_active":"2020-11-12 12:08:13.047777","last_peered":"2020-11-12 12:08:13.047777","last_clean":"2020-11-12 12:08:13.047777","last_became_active":"2020-11-12 12:07:26.910195","last_became_peered":"2020-11-12 12:07:26.910195","last_unstale":"2020-11-12 12:08:13.047777","last_undegraded":"2020-11-12 12:08:13.047777","last_fullsized":"2020-11-12 12:08:13.047777","mapping_epoch":591,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":592,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:29.446679","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:06:29.446679","last_clean_scrub_stamp":"2020-11-12 12:06:29.446679","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"606'930","reported_seq":"3709","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376799","last_change":"2020-11-12 12:07:45.132173","last_active":"2020-11-12 12:08:13.376799","last_peered":"2020-11-12 12:08:13.376799","last_clean":"2020-11-12 12:08:13.376799","last_became_active":"2020-11-12 12:07:44.583667","last_became_peered":"2020-11-12 12:07:44.583667","last_unstale":"2020-11-12 12:08:13.376799","last_undegraded":"2020-11-12 12:08:13.376799","last_fullsized":"2020-11-12 12:08:13.376799","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":930,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33313503,"num_objects":17,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":256,"num_read_kb":367173,"num_write":237,"num_write_kb":57709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":350399398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"46","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053762","last_change":"2020-11-12 12:07:35.980717","last_active":"2020-11-12 12:08:13.053762","last_peered":"2020-11-12 12:08:13.053762","last_clean":"2020-11-12 12:08:13.053762","last_became_active":"2020-11-12 12:07:35.977675","last_became_peered":"2020-11-12 12:07:35.977675","last_unstale":"2020-11-12 12:08:13.053762","last_undegraded":"2020-11-12 12:08:13.053762","last_fullsized":"2020-11-12 12:08:13.053762","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:28.871630","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:06:28.871630","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"606'846","reported_seq":"4089","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.046782","last_change":"2020-11-12 12:07:44.693996","last_active":"2020-11-12 12:08:13.046782","last_peered":"2020-11-12 12:08:13.046782","last_clean":"2020-11-12 12:08:13.046782","last_became_active":"2020-11-12 12:07:44.564657","last_became_peered":"2020-11-12 12:07:44.564657","last_unstale":"2020-11-12 12:08:13.046782","last_undegraded":"2020-11-12 12:08:13.046782","last_fullsized":"2020-11-12 12:08:13.046782","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46543737,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":151,"num_read_kb":169538,"num_write":238,"num_write_kb":60205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":496256418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"605'674","reported_seq":"3005","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053321","last_change":"2020-11-12 12:07:43.712637","last_active":"2020-11-12 12:08:13.053321","last_peered":"2020-11-12 12:08:13.053321","last_clean":"2020-11-12 12:08:13.053321","last_became_active":"2020-11-12 12:07:43.548419","last_became_peered":"2020-11-12 12:07:43.548419","last_unstale":"2020-11-12 12:08:13.053321","last_undegraded":"2020-11-12 12:08:13.053321","last_fullsized":"2020-11-12 12:08:13.053321","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":674,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38169296,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":114,"num_read_kb":131891,"num_write":165,"num_write_kb":37225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":225335475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"607'796","reported_seq":"4267","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148284","last_change":"2020-11-12 12:07:46.152581","last_active":"2020-11-12 12:08:13.148284","last_peered":"2020-11-12 12:08:13.148284","last_clean":"2020-11-12 12:08:13.148284","last_became_active":"2020-11-12 12:07:46.028375","last_became_peered":"2020-11-12 12:07:46.028375","last_unstale":"2020-11-12 12:08:13.148284","last_undegraded":"2020-11-12 12:08:13.148284","last_fullsized":"2020-11-12 12:08:13.148284","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27857526,"num_objects":19,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":183,"num_read_kb":219470,"num_write":240,"num_write_kb":56199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":578,"num_bytes_recovered":558493168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"607'559","reported_seq":"3316","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376918","last_change":"2020-11-12 12:07:45.654658","last_active":"2020-11-12 12:08:13.376918","last_peered":"2020-11-12 12:08:13.376918","last_clean":"2020-11-12 12:08:13.376918","last_became_active":"2020-11-12 12:07:45.564480","last_became_peered":"2020-11-12 12:07:45.564480","last_unstale":"2020-11-12 12:08:13.376918","last_undegraded":"2020-11-12 12:08:13.376918","last_fullsized":"2020-11-12 12:08:13.376918","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":559,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25883952,"num_objects":13,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":118,"num_read_kb":136818,"num_write":164,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":322062895,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"2143","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148442","last_change":"2020-11-12 12:07:43.587052","last_active":"2020-11-12 12:08:13.148442","last_peered":"2020-11-12 12:08:13.148442","last_clean":"2020-11-12 12:08:13.148442","last_became_active":"2020-11-12 12:07:43.547557","last_became_peered":"2020-11-12 12:07:43.547557","last_unstale":"2020-11-12 12:08:13.148442","last_undegraded":"2020-11-12 12:08:13.148442","last_fullsized":"2020-11-12 12:08:13.148442","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"605'367","reported_seq":"3037","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567889","last_change":"2020-11-12 12:07:43.624765","last_active":"2020-11-12 12:08:12.567889","last_peered":"2020-11-12 12:08:12.567889","last_clean":"2020-11-12 12:08:12.567889","last_became_active":"2020-11-12 12:07:43.545290","last_became_peered":"2020-11-12 12:07:43.545290","last_unstale":"2020-11-12 12:08:12.567889","last_undegraded":"2020-11-12 12:08:12.567889","last_fullsized":"2020-11-12 12:08:12.567889","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17515677,"num_objects":8,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":106,"num_read_kb":144046,"num_write":108,"num_write_kb":25330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":222679804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565510144,"data_stored":709827531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":580,"seq":2491081031699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1110124,"kb_used_data":61540,"kb_used_omap":341,"kb_used_meta":1048234,"kb_avail":93261716,"statfs":{"total":96636764160,"available":95499997184,"internally_reserved":1073741824,"allocated":63016960,"data_stored":83410636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":349956,"internal_metadata":1073391868},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":7.3140000000000001,"5min":7.3140000000000001,"15min":7.3140000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":99.079999999999998,"5min":99.079999999999998,"15min":99.079999999999998},"last":2.25},{"interface":"front","average":{"1min":1.859,"5min":1.859,"15min":1.859},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":3.2839999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.198}]},{"osd":2,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":1.95,"15min":1.95},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":2.1339999999999999},{"interface":"front","average":{"1min":49.286000000000001,"5min":49.286000000000001,"15min":49.286000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":706.08500000000004,"5min":706.08500000000004,"15min":706.08500000000004},"last":2.2040000000000002}]},{"osd":3,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":8.4600000000000009,"5min":8.4600000000000009,"15min":8.4600000000000009},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":99.426000000000002,"5min":99.426000000000002,"15min":99.426000000000002},"last":2.851},{"interface":"front","average":{"1min":8.2059999999999995,"5min":8.2059999999999995,"15min":8.2059999999999995},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":98.793999999999997,"5min":98.793999999999997,"15min":98.793999999999997},"last":2.29}]},{"osd":4,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":2.101,"15min":2.101},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":3.3620000000000001},{"interface":"front","average":{"1min":8.1159999999999997,"5min":8.1159999999999997,"15min":8.1159999999999997},"min":{"1min":1.216,"5min":1.216,"15min":1.216},"max":{"1min":99.373000000000005,"5min":99.373000000000005,"15min":99.373000000000005},"last":2.7770000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":6,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":8.3239999999999998,"5min":8.3239999999999998,"15min":8.3239999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":99.757999999999996,"5min":99.757999999999996,"15min":99.757999999999996},"last":3.649},{"interface":"front","average":{"1min":8.1349999999999998,"5min":8.1349999999999998,"15min":8.1349999999999998},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":99.138999999999996,"5min":99.138999999999996,"15min":99.138999999999996},"last":2.6259999999999999}]}]},{"osd":6,"up_from":559,"seq":2400886718488,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118092,"kb_used_data":69508,"kb_used_omap":353,"kb_used_meta":1048222,"kb_avail":93253748,"statfs":{"total":96636764160,"available":95491837952,"internally_reserved":1073741824,"allocated":71176192,"data_stored":96297885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361858,"internal_metadata":1073379966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":19.876000000000001,"5min":19.876000000000001,"15min":19.876000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":348.53300000000002,"5min":348.53300000000002,"15min":348.53300000000002},"last":1.579},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.95}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8500000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.621},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":2.0350000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":1.877,"15min":1.877},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":2.8900000000000001},{"interface":"front","average":{"1min":1.982,"5min":1.982,"15min":1.982},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":2.6589999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":9.4610000000000003,"5min":9.4610000000000003,"15min":9.4610000000000003},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":85.281000000000006,"5min":85.281000000000006,"15min":85.281000000000006},"last":2.7679999999999998},{"interface":"front","average":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.909}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9300000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.448,"5min":2.448,"15min":2.448},"min":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":2.4900000000000002},{"interface":"front","average":{"1min":2.544,"5min":2.544,"15min":2.544},"min":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":3.1869999999999998}]}]},{"osd":5,"up_from":601,"seq":2581275344907,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1134676,"kb_used_data":86092,"kb_used_omap":333,"kb_used_meta":1048242,"kb_avail":93237164,"statfs":{"total":96636764160,"available":95474855936,"internally_reserved":1073741824,"allocated":88158208,"data_stored":123673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341564,"internal_metadata":1073400260},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.798}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.556}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":69.540999999999997}]}]},{"osd":4,"up_from":391,"seq":1679332212795,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1157624,"kb_used_data":109040,"kb_used_omap":102,"kb_used_meta":1048473,"kb_avail":93214216,"statfs":{"total":96636764160,"available":95451357184,"internally_reserved":1073741824,"allocated":111656960,"data_stored":107806845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104910,"internal_metadata":1073636914},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":10.739000000000001,"15min":5.0789999999999997},"min":{"1min":1.0109999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.5600000000000001,"5min":488.81999999999999,"15min":488.81999999999999},"last":1.9239999999999999},{"interface":"front","average":{"1min":78.942999999999998,"5min":17.462,"15min":7.1600000000000001},"min":{"1min":0.99399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":807.53499999999997,"5min":807.53499999999997,"15min":807.53499999999997},"last":2.1600000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:06:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":2.3820000000000001,"15min":2.3500000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.444,"5min":8.9039999999999999,"15min":8.9039999999999999},"last":1.982},{"interface":"front","average":{"1min":42.069000000000003,"5min":10.15,"15min":4.782},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":763.53800000000001,"5min":763.53800000000001,"15min":763.53800000000001},"last":2.085}]},{"osd":2,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.968,"5min":2.0760000000000001,"15min":2.0099999999999998},"min":{"1min":1.0129999999999999,"5min":0.752,"15min":0.752},"max":{"1min":3.1509999999999998,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.1600000000000001,"5min":14.77,"15min":25.498000000000001},"min":{"1min":1.5900000000000001,"5min":0.875,"15min":0.875},"max":{"1min":3.2549999999999999,"5min":514.11400000000003,"15min":514.11400000000003},"last":2.2309999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":29.265999999999998,"15min":48.031999999999996},"min":{"1min":1.1739999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.75,"5min":994.74000000000001,"15min":994.74000000000001},"last":2.4049999999999998},{"interface":"front","average":{"1min":2.2949999999999999,"5min":2.5470000000000002,"15min":2.3180000000000001},"min":{"1min":1.556,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.7400000000000002,"5min":39.203000000000003,"15min":39.203000000000003},"last":2.359}]},{"osd":5,"last update":"Thu Nov 12 12:06:50 2020","interfaces":[{"interface":"back","average":{"1min":2.266,"5min":31.542000000000002,"15min":44.463999999999999},"min":{"1min":1.1679999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5139999999999998,"5min":874.86199999999997,"15min":874.86199999999997},"last":2.2879999999999998},{"interface":"front","average":{"1min":2.3959999999999999,"5min":7.7599999999999998,"15min":4.1580000000000004},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.7750000000000004,"5min":566.75599999999997,"15min":566.75599999999997},"last":3.2709999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:07:39 2020","interfaces":[{"interface":"back","average":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":3.3239999999999998},{"interface":"front","average":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":3.4239999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:08:01 2020","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"max":{"1min":24.954000000000001,"5min":24.954000000000001,"15min":24.954000000000001},"last":3.3570000000000002},{"interface":"front","average":{"1min":38.518000000000001,"5min":38.518000000000001,"15min":38.518000000000001},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":699.61099999999999,"5min":699.61099999999999,"15min":699.61099999999999},"last":2.452}]}]},{"osd":0,"up_from":245,"seq":1052266987609,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1115620,"kb_used_data":67036,"kb_used_omap":106,"kb_used_meta":1048469,"kb_avail":93256220,"statfs":{"total":96636764160,"available":95494369280,"internally_reserved":1073741824,"allocated":68644864,"data_stored":89861077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108685,"internal_metadata":1073633139},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":41.598999999999997,"5min":9.7609999999999992,"15min":4.3330000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":672.25900000000001,"5min":672.25900000000001,"15min":672.25900000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":2.1259999999999999,"5min":2.3660000000000001,"15min":1.9890000000000001},"min":{"1min":0.70799999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.5830000000000002,"5min":53.067999999999998,"15min":53.067999999999998},"last":2.2559999999999998}]},{"osd":2,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.6459999999999999,"15min":6.4080000000000004},"min":{"1min":0.85599999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.6989999999999998,"5min":9.7680000000000007,"15min":452.94999999999999},"last":2.1589999999999998},{"interface":"front","average":{"1min":1.8360000000000001,"5min":8.6699999999999999,"15min":4.0919999999999996},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.7480000000000002,"5min":346.39299999999997,"15min":346.39299999999997},"last":1.593}]},{"osd":3,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":8.4309999999999992,"15min":4.3170000000000002},"min":{"1min":0.93700000000000006,"5min":0.875,"15min":0.875},"max":{"1min":3.8039999999999998,"5min":504.71600000000001,"15min":504.71600000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.992,"5min":1.962,"15min":2.1850000000000001},"min":{"1min":0.96499999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.9199999999999999,"5min":3.9910000000000001,"15min":4.9349999999999996},"last":2.694}]},{"osd":4,"last update":"Thu Nov 12 12:07:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.5699999999999998,"15min":2.653},"min":{"1min":1.5640000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.1230000000000002,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":2.52},{"interface":"front","average":{"1min":49.655000000000001,"5min":11.961,"15min":5.5970000000000004},"min":{"1min":1.365,"5min":1.155,"15min":1.155},"max":{"1min":688.81700000000001,"5min":688.81700000000001,"15min":688.81700000000001},"last":2.4630000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":2.3239999999999998,"5min":18.879999999999999,"15min":7.952},"min":{"1min":1.1140000000000001,"5min":0.995,"15min":0.995},"max":{"1min":3.6749999999999998,"5min":994.72000000000003,"15min":994.72000000000003},"last":2.5750000000000002},{"interface":"front","average":{"1min":2.4390000000000001,"5min":2.5939999999999999,"15min":2.7879999999999998},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":3.7999999999999998,"5min":6.2990000000000004,"15min":6.2990000000000004},"last":2.4199999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:07:38 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.919,"15min":1.919},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":2.4969999999999999},{"interface":"front","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":2.6099999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:08:05 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"min":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":2.8769999999999998},{"interface":"front","average":{"1min":2.794,"5min":2.794,"15min":2.794},"min":{"1min":1.899,"5min":1.899,"15min":1.899},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":2.899}]}]},{"osd":1,"up_from":596,"seq":2559800508428,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102500,"kb_used_data":53916,"kb_used_omap":259,"kb_used_meta":1048316,"kb_avail":93269340,"statfs":{"total":96636764160,"available":95507804160,"internally_reserved":1073741824,"allocated":55209984,"data_stored":58313765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265441,"internal_metadata":1073476383},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3530000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4489999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118312,"kb_used_data":69728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253528,"statfs":{"total":96636764160,"available":95491612672,"internally_reserved":1073741824,"allocated":71401472,"data_stored":92861124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:31 2020","interfaces":[{"interface":"back","average":{"1min":26.920000000000002,"5min":6.9329999999999998,"15min":3.4769999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":502.202,"5min":502.202,"15min":502.202},"last":2.6789999999999998},{"interface":"front","average":{"1min":26.835999999999999,"5min":17.888999999999999,"15min":7.0039999999999996},"min":{"1min":1.0369999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":502.17099999999999,"5min":991.13400000000001,"15min":991.13400000000001},"last":2.5390000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:07:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4329999999999998,"5min":16.178999999999998,"15min":16.425000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.745},"max":{"1min":7.3559999999999999,"5min":942.04200000000003,"15min":942.04200000000003},"last":1.536},{"interface":"front","average":{"1min":2.016,"5min":1.982,"15min":2.6589999999999998},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.8550000000000004,"5min":4.8550000000000004,"15min":24.553999999999998},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:08:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9019999999999999,"5min":7.8150000000000004,"15min":4.5190000000000001},"min":{"1min":0.91600000000000004,"5min":0.628,"15min":0.628},"max":{"1min":5.6379999999999999,"5min":542.86500000000001,"15min":542.86500000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":5.9299999999999997,"5min":20.946000000000002,"15min":12.846},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.68500000000000005},"max":{"1min":84.096999999999994,"5min":891.42700000000002,"15min":952.51499999999999},"last":2.2229999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:07:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.125,"15min":2.0569999999999999},"min":{"1min":1.3939999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":3.5960000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":2.6059999999999999},{"interface":"front","average":{"1min":2.1539999999999999,"5min":2.3159999999999998,"15min":2.4199999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":4.46,"5min":4.907,"15min":4.907},"last":2.1890000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:06:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":12.215999999999999,"15min":13.023},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":5.202,"5min":505.05900000000003,"15min":694.89999999999998},"last":2.2850000000000001},{"interface":"front","average":{"1min":2.5419999999999998,"5min":2.5870000000000002,"15min":3.2709999999999999},"min":{"1min":1.2130000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":4.1710000000000003,"5min":4.9569999999999999,"15min":25.744},"last":2.0310000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":2.339,"15min":2.339},"min":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"max":{"1min":4.673,"5min":4.673,"15min":4.673},"last":3.234},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":2.069}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"min":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":3.1909999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":2.4750000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":97589153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":12.253,"15min":5.5800000000000001},"min":{"1min":0.90800000000000003,"5min":0.64400000000000002,"15min":0.63900000000000001},"max":{"1min":3.6949999999999998,"5min":878.05899999999997,"15min":878.05899999999997},"last":2.0350000000000001},{"interface":"front","average":{"1min":2.1299999999999999,"5min":5.484,"15min":3.1499999999999999},"min":{"1min":1.0329999999999999,"5min":0.745,"15min":0.745},"max":{"1min":3.7719999999999998,"5min":366.03699999999998,"15min":366.03699999999998},"last":1.982}]},{"osd":1,"last update":"Thu Nov 12 12:06:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":9.7279999999999998,"15min":4.3680000000000003},"min":{"1min":0.96399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.472,"5min":718.05899999999997,"15min":718.05899999999997},"last":1.526},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.8620000000000001,"15min":2.1219999999999999},"min":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.68500000000000005},"max":{"1min":2.7839999999999998,"5min":4.2690000000000001,"15min":5.125},"last":2.2120000000000002}]},{"osd":2,"last update":"Thu Nov 12 12:07:54 2020","interfaces":[{"interface":"back","average":{"1min":2.3490000000000002,"5min":2.4500000000000002,"15min":3.2210000000000001},"min":{"1min":1.206,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.0379999999999998,"5min":12.622,"15min":203.68299999999999},"last":2.0939999999999999},{"interface":"front","average":{"1min":1.887,"5min":10.071999999999999,"15min":5.2080000000000002},"min":{"1min":0.91700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.863,"5min":513.51400000000001,"15min":513.51400000000001},"last":2.278}]},{"osd":4,"last update":"Thu Nov 12 12:07:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9219999999999999,"5min":13.967000000000001,"15min":25.974},"min":{"1min":1.1719999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.9350000000000001,"5min":661.80200000000002,"15min":661.80200000000002},"last":2.6309999999999998},{"interface":"front","average":{"1min":2.5,"5min":8.5939999999999994,"15min":14.772},"min":{"1min":1.2669999999999999,"5min":1.028,"15min":1.028},"max":{"1min":3.7669999999999999,"5min":341.209,"15min":341.209},"last":3.1070000000000002}]},{"osd":5,"last update":"Thu Nov 12 12:05:53 2020","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":2.4220000000000002,"15min":13.692},"min":{"1min":1.1699999999999999,"5min":1.044,"15min":1.044},"max":{"1min":3.7330000000000001,"5min":4.4539999999999997,"15min":626.23000000000002},"last":3.048},{"interface":"front","average":{"1min":2.2690000000000001,"5min":2.415,"15min":2.456},"min":{"1min":1.2330000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":3.8279999999999998,"5min":5.2599999999999998,"15min":5.9889999999999999},"last":2.077}]},{"osd":6,"last update":"Thu Nov 12 12:07:41 2020","interfaces":[{"interface":"back","average":{"1min":54.368000000000002,"5min":54.368000000000002,"15min":54.368000000000002},"min":{"1min":1.375,"5min":1.375,"15min":1.375},"max":{"1min":941.26800000000003,"5min":941.26800000000003,"15min":941.26800000000003},"last":3.008},{"interface":"front","average":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"min":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":3.024}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.673,"5min":2.673,"15min":2.673},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":2.8149999999999999},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"min":{"1min":1.728,"5min":1.728,"15min":1.728},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":2.8330000000000002}]}]}]}} Ignoring malparsed backtrace: 2020-11-12T12:08:40.601 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:40.602 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:40.602 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:10:02.981 7eff326d9700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:10:03.071 7eff326d9700 -1 WARNING: all dangerous and experimental features are enabled. , dumped all Ignoring malparsed backtrace: 2020-11-12T12:11:05.469 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:07:05.341782 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:05.469 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:05.470 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:11:18.897 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b , 2020-11-12 12:11:19.117 7f70b391a700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:11:19.197 7f70b391a700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:12:22.846 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:22.846 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-11-12T12:12:42.848 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json Ignoring malparsed backtrace: 2020-11-12 12:13:26.563 7f57dd282700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 1.7 on osd.1 to deep-scrub , 2020-11-12T12:13:26.862 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.4 Ignoring malparsed backtrace: 2020-11-12T12:14:01.024 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:01.025 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-12 12:07:44.529241 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=44, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:01.025 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:15:03.154 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:15:03.154 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:15:03.155 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:15:50.647 7f0048e4a700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:15:50.764 7f0048e4a700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.7s0 on osd.3 to deep-scrub Ignoring malparsed backtrace: 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:07:05.341782 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:17:43.327 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:43.328 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:43.328 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:18:14.146 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.0 , 2020-11-12 12:18:14.382 7fef50eef700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:18:14.479 7fef4b59e700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:19:21.510 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-12 12:06:50.045143 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:19:21.511 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:19:21.511 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-12 12:07:07.510477 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=7, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:20:23.654 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:23.655 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:23.655 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:20:38.083 7f5cd22b7700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.cs0 on osd.6 to deep-scrub , 2020-11-12T12:20:38.408 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.d Ignoring malparsed backtrace: 2020-11-12T12:22:01.408 INFO:teuthology.orchestra.run.smithi044.stdout: , 2020-11-12T12:22:01.424 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1381,"stamp":"2020-11-12 12:22:00.849563","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":9000640,"kb_used_data":611968,"kb_used_omap":1496,"kb_used_meta":8387111,"kb_avail":745974080,"statfs":{"total":773094113280,"available":763877457920,"internally_reserved":8589934592,"allocated":626655232,"data_stored":749813723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1532414,"internal_metadata":8588402178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004045"},"pg_stats":[{"pgid":"2.f","version":"605'975","reported_seq":"5179","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.048094","last_change":"2020-11-12 12:07:44.339133","last_active":"2020-11-12 12:08:13.048094","last_peered":"2020-11-12 12:08:13.048094","last_clean":"2020-11-12 12:08:13.048094","last_became_active":"2020-11-12 12:07:43.542344","last_became_peered":"2020-11-12 12:07:43.542344","last_unstale":"2020-11-12 12:08:13.048094","last_undegraded":"2020-11-12 12:08:13.048094","last_fullsized":"2020-11-12 12:08:13.048094","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":975,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":36964515,"num_objects":22,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":222,"num_read_kb":276029,"num_write":279,"num_write_kb":64344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":676764753,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"606'755","reported_seq":"3298","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053607","last_change":"2020-11-12 12:07:45.720783","last_active":"2020-11-12 12:08:13.053607","last_peered":"2020-11-12 12:08:13.053607","last_clean":"2020-11-12 12:08:13.053607","last_became_active":"2020-11-12 12:07:44.559898","last_became_peered":"2020-11-12 12:07:44.559898","last_unstale":"2020-11-12 12:08:13.053607","last_undegraded":"2020-11-12 12:08:13.053607","last_fullsized":"2020-11-12 12:08:13.053607","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":44542027,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":142,"num_read_kb":168636,"num_write":206,"num_write_kb":48990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":220359844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"126","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.561197","last_change":"2020-11-12 12:07:34.980292","last_active":"2020-11-12 12:08:12.561197","last_peered":"2020-11-12 12:08:12.561197","last_clean":"2020-11-12 12:08:12.561197","last_became_active":"2020-11-12 12:07:34.979587","last_became_peered":"2020-11-12 12:07:34.979587","last_unstale":"2020-11-12 12:08:12.561197","last_undegraded":"2020-11-12 12:08:12.561197","last_fullsized":"2020-11-12 12:08:12.561197","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:50.045143","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:01:01.411425","last_clean_scrub_stamp":"2020-11-12 12:06:50.045143","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"607'1034","reported_seq":"4531","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567601","last_change":"2020-11-12 12:07:45.706465","last_active":"2020-11-12 12:08:12.567601","last_peered":"2020-11-12 12:08:12.567601","last_clean":"2020-11-12 12:08:12.567601","last_became_active":"2020-11-12 12:07:45.566064","last_became_peered":"2020-11-12 12:07:45.566064","last_unstale":"2020-11-12 12:08:12.567601","last_undegraded":"2020-11-12 12:08:12.567601","last_fullsized":"2020-11-12 12:08:12.567601","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":1034,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63069801,"num_objects":33,"num_object_clones":27,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":227,"num_read_kb":245644,"num_write":327,"num_write_kb":79050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":626,"num_bytes_recovered":710613985,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376795","last_change":"2020-11-12 12:07:07.510609","last_active":"2020-11-12 12:08:13.376795","last_peered":"2020-11-12 12:08:13.376795","last_clean":"2020-11-12 12:08:13.376795","last_became_active":"2020-11-12 12:06:38.531854","last_became_peered":"2020-11-12 12:06:38.531854","last_unstale":"2020-11-12 12:08:13.376795","last_undegraded":"2020-11-12 12:08:13.376795","last_fullsized":"2020-11-12 12:08:13.376795","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:07.510477","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:07:07.510477","last_clean_scrub_stamp":"2020-11-12 12:07:07.510477","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"605'571","reported_seq":"3045","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376977","last_change":"2020-11-12 12:07:44.295346","last_active":"2020-11-12 12:08:13.376977","last_peered":"2020-11-12 12:08:13.376977","last_clean":"2020-11-12 12:08:13.376977","last_became_active":"2020-11-12 12:07:43.546299","last_became_peered":"2020-11-12 12:07:43.546299","last_unstale":"2020-11-12 12:08:13.376977","last_undegraded":"2020-11-12 12:08:13.376977","last_fullsized":"2020-11-12 12:08:13.376977","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":571,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41575305,"num_objects":15,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":110,"num_read_kb":112384,"num_write":178,"num_write_kb":39453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":214562650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"631","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047347","last_change":"2020-11-12 12:07:05.341895","last_active":"2020-11-12 12:08:13.047347","last_peered":"2020-11-12 12:08:13.047347","last_clean":"2020-11-12 12:08:13.047347","last_became_active":"2020-11-12 12:06:37.605758","last_became_peered":"2020-11-12 12:06:37.605758","last_unstale":"2020-11-12 12:08:13.047347","last_undegraded":"2020-11-12 12:08:13.047347","last_fullsized":"2020-11-12 12:08:13.047347","mapping_epoch":559,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":560,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:05.341782","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:05.341782","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"605'852","reported_seq":"3625","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053157","last_change":"2020-11-12 12:07:43.726533","last_active":"2020-11-12 12:08:13.053157","last_peered":"2020-11-12 12:08:13.053157","last_clean":"2020-11-12 12:08:13.053157","last_became_active":"2020-11-12 12:07:43.552867","last_became_peered":"2020-11-12 12:07:43.552867","last_unstale":"2020-11-12 12:08:13.053157","last_undegraded":"2020-11-12 12:08:13.053157","last_fullsized":"2020-11-12 12:08:13.053157","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":852,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40651861,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":176,"num_read_kb":237784,"num_write":229,"num_write_kb":51463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":336631858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"441","reported_epoch":"620","state":"active+clean","last_fresh":"2020-11-12 12:20:44.645575","last_change":"2020-11-12 12:20:44.645681","last_active":"2020-11-12 12:20:44.645575","last_peered":"2020-11-12 12:20:44.645575","last_clean":"2020-11-12 12:20:44.645575","last_became_active":"2020-11-12 12:07:02.730087","last_became_peered":"2020-11-12 12:07:02.730087","last_unstale":"2020-11-12 12:20:44.645575","last_undegraded":"2020-11-12 12:20:44.645575","last_fullsized":"2020-11-12 12:20:44.645575","mapping_epoch":580,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:20:44.645547","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:20:44.645547","last_clean_scrub_stamp":"2020-11-12 12:20:44.645547","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"605'787","reported_seq":"3194","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376911","last_change":"2020-11-12 12:07:43.680183","last_active":"2020-11-12 12:08:13.376911","last_peered":"2020-11-12 12:08:13.376911","last_clean":"2020-11-12 12:08:13.376911","last_became_active":"2020-11-12 12:07:43.540815","last_became_peered":"2020-11-12 12:07:43.540815","last_unstale":"2020-11-12 12:08:13.376911","last_undegraded":"2020-11-12 12:08:13.376911","last_fullsized":"2020-11-12 12:08:13.376911","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":787,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43160093,"num_objects":20,"num_object_clones":17,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":133,"num_read_kb":120761,"num_write":220,"num_write_kb":54232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":209150928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"134","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.560847","last_change":"2020-11-12 12:07:44.529416","last_active":"2020-11-12 12:08:12.560847","last_peered":"2020-11-12 12:08:12.560847","last_clean":"2020-11-12 12:08:12.560847","last_became_active":"2020-11-12 12:07:40.996832","last_became_peered":"2020-11-12 12:07:40.996832","last_unstale":"2020-11-12 12:08:12.560847","last_undegraded":"2020-11-12 12:08:12.560847","last_fullsized":"2020-11-12 12:08:12.560847","mapping_epoch":601,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":602,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:44.529241","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:44.529241","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"607'461","reported_seq":"3496","reported_epoch":"619","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:08:13.376948","last_change":"2020-11-12 12:07:48.505159","last_active":"2020-11-12 12:08:13.376948","last_peered":"2020-11-12 12:08:13.376948","last_clean":"2020-11-12 12:08:13.376948","last_became_active":"2020-11-12 12:07:45.558646","last_became_peered":"2020-11-12 12:07:45.558646","last_unstale":"2020-11-12 12:08:13.376948","last_undegraded":"2020-11-12 12:08:13.376948","last_fullsized":"2020-11-12 12:08:13.376948","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":461,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22082484,"num_objects":10,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":79,"num_read_kb":73364,"num_write":120,"num_write_kb":28596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":226411123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376678","last_change":"2020-11-12 12:07:14.479425","last_active":"2020-11-12 12:08:13.376678","last_peered":"2020-11-12 12:08:13.376678","last_clean":"2020-11-12 12:08:13.376678","last_became_active":"2020-11-12 12:06:38.526587","last_became_peered":"2020-11-12 12:06:38.526587","last_unstale":"2020-11-12 12:08:13.376678","last_undegraded":"2020-11-12 12:08:13.376678","last_fullsized":"2020-11-12 12:08:13.376678","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:14.479334","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:14.479334","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"605'236","reported_seq":"2602","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376934","last_change":"2020-11-12 12:07:43.679033","last_active":"2020-11-12 12:08:13.376934","last_peered":"2020-11-12 12:08:13.376934","last_clean":"2020-11-12 12:08:13.376934","last_became_active":"2020-11-12 12:07:43.544179","last_became_peered":"2020-11-12 12:07:43.544179","last_unstale":"2020-11-12 12:08:13.376934","last_undegraded":"2020-11-12 12:08:13.376934","last_fullsized":"2020-11-12 12:08:13.376934","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":236,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8892018,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":52270,"num_write":58,"num_write_kb":14437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":101718835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"605'185","reported_seq":"2708","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566247","last_change":"2020-11-12 12:07:43.627236","last_active":"2020-11-12 12:08:12.566247","last_peered":"2020-11-12 12:08:12.566247","last_clean":"2020-11-12 12:08:12.566247","last_became_active":"2020-11-12 12:07:43.549723","last_became_peered":"2020-11-12 12:07:43.549723","last_unstale":"2020-11-12 12:08:12.566247","last_undegraded":"2020-11-12 12:08:12.566247","last_fullsized":"2020-11-12 12:08:12.566247","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5743030,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":84824,"num_write":57,"num_write_kb":16290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":83699520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"242","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047777","last_change":"2020-11-12 12:07:26.910728","last_active":"2020-11-12 12:08:13.047777","last_peered":"2020-11-12 12:08:13.047777","last_clean":"2020-11-12 12:08:13.047777","last_became_active":"2020-11-12 12:07:26.910195","last_became_peered":"2020-11-12 12:07:26.910195","last_unstale":"2020-11-12 12:08:13.047777","last_undegraded":"2020-11-12 12:08:13.047777","last_fullsized":"2020-11-12 12:08:13.047777","mapping_epoch":591,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":592,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:29.446679","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:06:29.446679","last_clean_scrub_stamp":"2020-11-12 12:06:29.446679","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"606'930","reported_seq":"3709","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376799","last_change":"2020-11-12 12:07:45.132173","last_active":"2020-11-12 12:08:13.376799","last_peered":"2020-11-12 12:08:13.376799","last_clean":"2020-11-12 12:08:13.376799","last_became_active":"2020-11-12 12:07:44.583667","last_became_peered":"2020-11-12 12:07:44.583667","last_unstale":"2020-11-12 12:08:13.376799","last_undegraded":"2020-11-12 12:08:13.376799","last_fullsized":"2020-11-12 12:08:13.376799","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":930,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33313503,"num_objects":17,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":256,"num_read_kb":367173,"num_write":237,"num_write_kb":57709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":350399398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"46","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053762","last_change":"2020-11-12 12:07:35.980717","last_active":"2020-11-12 12:08:13.053762","last_peered":"2020-11-12 12:08:13.053762","last_clean":"2020-11-12 12:08:13.053762","last_became_active":"2020-11-12 12:07:35.977675","last_became_peered":"2020-11-12 12:07:35.977675","last_unstale":"2020-11-12 12:08:13.053762","last_undegraded":"2020-11-12 12:08:13.053762","last_fullsized":"2020-11-12 12:08:13.053762","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:28.871630","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:06:28.871630","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"606'846","reported_seq":"4089","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.046782","last_change":"2020-11-12 12:07:44.693996","last_active":"2020-11-12 12:08:13.046782","last_peered":"2020-11-12 12:08:13.046782","last_clean":"2020-11-12 12:08:13.046782","last_became_active":"2020-11-12 12:07:44.564657","last_became_peered":"2020-11-12 12:07:44.564657","last_unstale":"2020-11-12 12:08:13.046782","last_undegraded":"2020-11-12 12:08:13.046782","last_fullsized":"2020-11-12 12:08:13.046782","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46543737,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":151,"num_read_kb":169538,"num_write":238,"num_write_kb":60205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":496256418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"605'674","reported_seq":"3005","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053321","last_change":"2020-11-12 12:07:43.712637","last_active":"2020-11-12 12:08:13.053321","last_peered":"2020-11-12 12:08:13.053321","last_clean":"2020-11-12 12:08:13.053321","last_became_active":"2020-11-12 12:07:43.548419","last_became_peered":"2020-11-12 12:07:43.548419","last_unstale":"2020-11-12 12:08:13.053321","last_undegraded":"2020-11-12 12:08:13.053321","last_fullsized":"2020-11-12 12:08:13.053321","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":674,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38169296,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":114,"num_read_kb":131891,"num_write":165,"num_write_kb":37225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":225335475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"607'796","reported_seq":"4267","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148284","last_change":"2020-11-12 12:07:46.152581","last_active":"2020-11-12 12:08:13.148284","last_peered":"2020-11-12 12:08:13.148284","last_clean":"2020-11-12 12:08:13.148284","last_became_active":"2020-11-12 12:07:46.028375","last_became_peered":"2020-11-12 12:07:46.028375","last_unstale":"2020-11-12 12:08:13.148284","last_undegraded":"2020-11-12 12:08:13.148284","last_fullsized":"2020-11-12 12:08:13.148284","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27857526,"num_objects":19,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":183,"num_read_kb":219470,"num_write":240,"num_write_kb":56199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":578,"num_bytes_recovered":558493168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"607'559","reported_seq":"3316","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376918","last_change":"2020-11-12 12:07:45.654658","last_active":"2020-11-12 12:08:13.376918","last_peered":"2020-11-12 12:08:13.376918","last_clean":"2020-11-12 12:08:13.376918","last_became_active":"2020-11-12 12:07:45.564480","last_became_peered":"2020-11-12 12:07:45.564480","last_unstale":"2020-11-12 12:08:13.376918","last_undegraded":"2020-11-12 12:08:13.376918","last_fullsized":"2020-11-12 12:08:13.376918","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":559,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25883952,"num_objects":13,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":118,"num_read_kb":136818,"num_write":164,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":322062895,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"2143","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148442","last_change":"2020-11-12 12:07:43.587052","last_active":"2020-11-12 12:08:13.148442","last_peered":"2020-11-12 12:08:13.148442","last_clean":"2020-11-12 12:08:13.148442","last_became_active":"2020-11-12 12:07:43.547557","last_became_peered":"2020-11-12 12:07:43.547557","last_unstale":"2020-11-12 12:08:13.148442","last_undegraded":"2020-11-12 12:08:13.148442","last_fullsized":"2020-11-12 12:08:13.148442","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"605'367","reported_seq":"3037","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567889","last_change":"2020-11-12 12:07:43.624765","last_active":"2020-11-12 12:08:12.567889","last_peered":"2020-11-12 12:08:12.567889","last_clean":"2020-11-12 12:08:12.567889","last_became_active":"2020-11-12 12:07:43.545290","last_became_peered":"2020-11-12 12:07:43.545290","last_unstale":"2020-11-12 12:08:12.567889","last_undegraded":"2020-11-12 12:08:12.567889","last_fullsized":"2020-11-12 12:08:12.567889","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17515677,"num_objects":8,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":106,"num_read_kb":144046,"num_write":108,"num_write_kb":25330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":222679804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565510144,"data_stored":709827531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":580,"seq":2491081031861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1110124,"kb_used_data":61540,"kb_used_omap":341,"kb_used_meta":1048234,"kb_avail":93261716,"statfs":{"total":96636764160,"available":95499997184,"internally_reserved":1073741824,"allocated":63016960,"data_stored":83410636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":349956,"internal_metadata":1073391868},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.0960000000000001,"5min":3.028,"15min":5.2709999999999999},"min":{"1min":1.4390000000000001,"5min":1.2649999999999999,"15min":0.77200000000000002},"max":{"1min":2.8799999999999999,"5min":80.197000000000003,"15min":578.29399999999998},"last":1.6950000000000001},{"interface":"front","average":{"1min":2.3370000000000002,"5min":2.5019999999999998,"15min":7.5540000000000003},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":0.66800000000000004},"max":{"1min":3.4900000000000002,"5min":5.1509999999999998,"15min":794.80100000000004},"last":1.79}]},{"osd":1,"last update":"Thu Nov 12 12:21:04 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":15.01,"15min":6.7469999999999999},"min":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":0.64200000000000002},"max":{"1min":2.9689999999999999,"5min":963.428,"15min":963.428},"last":3.3359999999999999},{"interface":"front","average":{"1min":3.8479999999999999,"5min":8.9949999999999992,"15min":5.2290000000000001},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":0.69899999999999995},"max":{"1min":24.513999999999999,"5min":503.04300000000001,"15min":503.04300000000001},"last":2.0299999999999998}]},{"osd":2,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.839,"5min":2.952,"15min":5.7800000000000002},"min":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":0.77600000000000002},"max":{"1min":3.6829999999999998,"5min":5.2009999999999996,"15min":514.13499999999999},"last":2.5739999999999998},{"interface":"front","average":{"1min":3.004,"5min":3.0609999999999999,"15min":9.1950000000000003},"min":{"1min":2.4510000000000001,"5min":2.2909999999999999,"15min":0.75800000000000001},"max":{"1min":3.7160000000000002,"5min":5.2409999999999997,"15min":706.08500000000004},"last":2.6070000000000002}]},{"osd":3,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.714,"5min":2.7290000000000001,"15min":4.5330000000000004},"min":{"1min":1.782,"5min":1.6100000000000001,"15min":1.1930000000000001},"max":{"1min":3.238,"5min":4.7190000000000003,"15min":198.44300000000001},"last":3.3980000000000001},{"interface":"front","average":{"1min":2.8029999999999999,"5min":8.2970000000000006,"15min":9.8409999999999993},"min":{"1min":1.819,"5min":1.776,"15min":1.272},"max":{"1min":3.3149999999999999,"5min":270.86700000000002,"15min":995.274},"last":3.4489999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.8050000000000002,"5min":2.7730000000000001,"15min":2.669},"min":{"1min":1.55,"5min":1.55,"15min":0.83199999999999996},"max":{"1min":3.617,"5min":4.3520000000000003,"15min":4.9290000000000003},"last":2.0859999999999999},{"interface":"front","average":{"1min":2.9700000000000002,"5min":10.747999999999999,"15min":9.5129999999999999},"min":{"1min":1.964,"5min":1.871,"15min":1.216},"max":{"1min":3.7970000000000002,"5min":494.08800000000002,"15min":893.58399999999995},"last":2.649}]},{"osd":5,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6640000000000001,"5min":8.7230000000000008,"15min":5.6319999999999997},"min":{"1min":1.722,"5min":1.722,"15min":0.996},"max":{"1min":3.2280000000000002,"5min":781.50199999999995,"15min":781.50199999999995},"last":3.1970000000000001},{"interface":"front","average":{"1min":3.1309999999999998,"5min":3.1619999999999999,"15min":11.958},"min":{"1min":2.4740000000000002,"5min":2.2189999999999999,"15min":1.4490000000000001},"max":{"1min":3.9500000000000002,"5min":5.282,"15min":946.62800000000004},"last":2.867}]},{"osd":6,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":53.386000000000003,"5min":20.541,"15min":9.2829999999999995},"min":{"1min":1.7629999999999999,"5min":1.542,"15min":1.02},"max":{"1min":771.18399999999997,"5min":771.18399999999997,"15min":771.18399999999997},"last":1.75},{"interface":"front","average":{"1min":2.9300000000000002,"5min":2.9390000000000001,"15min":3.6320000000000001},"min":{"1min":2.3799999999999999,"5min":1.9079999999999999,"15min":1.2569999999999999},"max":{"1min":3.4060000000000001,"5min":4.75,"15min":99.138999999999996},"last":3.2690000000000001}]}]},{"osd":6,"up_from":559,"seq":2400886718650,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118092,"kb_used_data":69508,"kb_used_omap":353,"kb_used_meta":1048222,"kb_avail":93253748,"statfs":{"total":96636764160,"available":95491837952,"internally_reserved":1073741824,"allocated":71176192,"data_stored":96297885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361858,"internal_metadata":1073379966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":4.9470000000000001,"15min":10.51},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.74099999999999999},"max":{"1min":3.0569999999999999,"5min":322.50999999999999,"15min":779.93200000000002},"last":2.5569999999999999},{"interface":"front","average":{"1min":9.2080000000000002,"5min":16.710999999999999,"15min":8.6549999999999994},"min":{"1min":1.218,"5min":1.218,"15min":0.996},"max":{"1min":169.53100000000001,"5min":757.51700000000005,"15min":757.51700000000005},"last":1.7629999999999999}]},{"osd":1,"last update":"Thu Nov 12 12:21:15 2020","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":4.9569999999999999,"15min":9.5760000000000005},"min":{"1min":1.7070000000000001,"5min":1.6160000000000001,"15min":1.327},"max":{"1min":2.964,"5min":308.35899999999998,"15min":892.83299999999997},"last":2.177},{"interface":"front","average":{"1min":2.7250000000000001,"5min":2.6640000000000001,"15min":5.9859999999999998},"min":{"1min":1.6539999999999999,"5min":1.573,"15min":1.0800000000000001},"max":{"1min":3.2959999999999998,"5min":3.609,"15min":855.77499999999998},"last":2.327}]},{"osd":2,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":30.806999999999999,"5min":12.675000000000001,"15min":9.7360000000000007},"min":{"1min":1.45,"5min":1.1799999999999999,"15min":0.76600000000000001},"max":{"1min":503.40800000000002,"5min":503.40800000000002,"15min":954.77599999999995},"last":1.7},{"interface":"front","average":{"1min":23.172000000000001,"5min":8.7880000000000003,"15min":5.3780000000000001},"min":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":0.92800000000000005},"max":{"1min":502.86900000000003,"5min":502.86900000000003,"15min":502.86900000000003},"last":1.8260000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":11.449999999999999,"15min":7.1360000000000001},"min":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.139},"max":{"1min":3.403,"5min":502.762,"15min":502.762},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.7090000000000001,"5min":2.621,"15min":5.2380000000000004},"min":{"1min":1.6000000000000001,"5min":1.4930000000000001,"15min":0.873},"max":{"1min":3.4889999999999999,"5min":3.569,"15min":857.01900000000001},"last":1.9039999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.367,"5min":8.2059999999999995,"15min":13.836},"min":{"1min":1.609,"5min":1.609,"15min":0.86899999999999999},"max":{"1min":3.4510000000000001,"5min":483.43799999999999,"15min":981.596},"last":3.2759999999999998},{"interface":"front","average":{"1min":2.7919999999999998,"5min":2.6640000000000001,"15min":2.5619999999999998},"min":{"1min":2.02,"5min":1.476,"15min":0.80800000000000005},"max":{"1min":3.2269999999999999,"5min":3.5369999999999999,"15min":4.7519999999999998},"last":1.9630000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":30.065000000000001,"5min":8.4640000000000004,"15min":4.7699999999999996},"min":{"1min":2.2440000000000002,"5min":2.1150000000000002,"15min":1.2889999999999999},"max":{"1min":626.11800000000005,"5min":626.11800000000005,"15min":626.11800000000005},"last":2.6949999999999998},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.036,"15min":5.0570000000000004},"min":{"1min":2.3330000000000002,"5min":2.0979999999999999,"15min":1.4750000000000001},"max":{"1min":3.6930000000000001,"5min":4.1029999999999998,"15min":190.36000000000001},"last":2.633}]},{"osd":7,"last update":"Thu Nov 12 12:21:25 2020","interfaces":[{"interface":"back","average":{"1min":44.843000000000004,"5min":19.739000000000001,"15min":8.3789999999999996},"min":{"1min":2.028,"5min":1.8340000000000001,"15min":1.5069999999999999},"max":{"1min":886.11500000000001,"5min":886.11500000000001,"15min":886.11500000000001},"last":3.3290000000000002},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.75,"15min":4.4379999999999997},"min":{"1min":2.1880000000000002,"5min":1.8819999999999999,"15min":1.282},"max":{"1min":3.4910000000000001,"5min":3.7360000000000002,"15min":403.28500000000003},"last":3.198}]}]},{"osd":5,"up_from":601,"seq":2581275345072,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1134676,"kb_used_data":86092,"kb_used_omap":333,"kb_used_meta":1048242,"kb_avail":93237164,"statfs":{"total":96636764160,"available":95474855936,"internally_reserved":1073741824,"allocated":88158208,"data_stored":123673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341564,"internal_metadata":1073400260},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":71.390000000000001,"5min":18.588000000000001,"15min":10.76},"min":{"1min":1.2250000000000001,"5min":1.0269999999999999,"15min":0.92300000000000004},"max":{"1min":949.11800000000005,"5min":949.11800000000005,"15min":949.11800000000005},"last":1.306},{"interface":"front","average":{"1min":10.993,"5min":3.9060000000000001,"15min":4.9370000000000003},"min":{"1min":1.296,"5min":1.264,"15min":1.115},"max":{"1min":150.06700000000001,"5min":150.06700000000001,"15min":680.75099999999998},"last":4.3140000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.1930000000000001,"5min":2.238,"15min":4.7930000000000001},"min":{"1min":1.3120000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"max":{"1min":3.2189999999999999,"5min":3.633,"15min":768.50300000000004},"last":2.5699999999999998},{"interface":"front","average":{"1min":59.518000000000001,"5min":13.85,"15min":7.0039999999999996},"min":{"1min":1.357,"5min":1.258,"15min":1.258},"max":{"1min":864.66999999999996,"5min":864.66999999999996,"15min":864.66999999999996},"last":2.4430000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.4529999999999998,"5min":7.9770000000000003,"15min":6.8780000000000001},"min":{"1min":1.7190000000000001,"5min":1.5660000000000001,"15min":1.167},"max":{"1min":3.2789999999999999,"5min":483.91899999999998,"15min":502.81400000000002},"last":2.9449999999999998},{"interface":"front","average":{"1min":2.6299999999999999,"5min":4.915,"15min":4.9050000000000002},"min":{"1min":1.956,"5min":1.772,"15min":1.3129999999999999},"max":{"1min":3.2599999999999998,"5min":276.31599999999997,"15min":503.221},"last":4.4119999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":2.536,"15min":8.5790000000000006},"min":{"1min":1.8939999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"max":{"1min":3.3029999999999999,"5min":3.7879999999999998,"15min":852.14400000000001},"last":2.6480000000000001},{"interface":"front","average":{"1min":2.427,"5min":2.496,"15min":6.5019999999999998},"min":{"1min":1.7909999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.1259999999999999,"5min":3.4279999999999999,"15min":800.87099999999998},"last":4.4500000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.629,"15min":6.673},"min":{"1min":1.78,"5min":1.5840000000000001,"15min":1.5840000000000001},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":964.16600000000005},"last":2.5179999999999998},{"interface":"front","average":{"1min":2.5350000000000001,"5min":19.498000000000001,"15min":14.134},"min":{"1min":1.4690000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"max":{"1min":3.198,"5min":947.64800000000002,"15min":947.64800000000002},"last":4.3719999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6920000000000002,"5min":2.6480000000000001,"15min":3.4140000000000001},"min":{"1min":1.831,"5min":1.669,"15min":1.385},"max":{"1min":3.3420000000000001,"5min":3.7949999999999999,"15min":191.37799999999999},"last":2.8780000000000001},{"interface":"front","average":{"1min":2.8140000000000001,"5min":2.8410000000000002,"15min":6.3970000000000002},"min":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":1.758},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":618.96500000000003},"last":3.0830000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":6.1639999999999997,"15min":20.687999999999999},"min":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.508},"max":{"1min":3.79,"5min":403.16699999999997,"15min":973.43899999999996},"last":2.6459999999999999},{"interface":"front","average":{"1min":2.976,"5min":13.462,"15min":11.574999999999999},"min":{"1min":2.5539999999999998,"5min":2.1389999999999998,"15min":1.663},"max":{"1min":3.6459999999999999,"5min":902.87900000000002,"15min":902.87900000000002},"last":2.29}]}]},{"osd":4,"up_from":391,"seq":1679332212959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1157624,"kb_used_data":109040,"kb_used_omap":102,"kb_used_meta":1048473,"kb_avail":93214216,"statfs":{"total":96636764160,"available":95451357184,"internally_reserved":1073741824,"allocated":111656960,"data_stored":107806845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104910,"internal_metadata":1073636914},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.0659999999999998,"5min":12.178000000000001,"15min":5.5030000000000001},"min":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":0.52500000000000002},"max":{"1min":3.069,"5min":411.19299999999998,"15min":411.19299999999998},"last":2.597},{"interface":"front","average":{"1min":2.0569999999999999,"5min":22.204000000000001,"15min":15.141999999999999},"min":{"1min":1.4430000000000001,"5min":1.2929999999999999,"15min":0.94099999999999995},"max":{"1min":3.1349999999999998,"5min":1440.327,"15min":1440.327},"last":2.5190000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:21:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1629999999999998,"5min":2.2320000000000002,"15min":4.4870000000000001},"min":{"1min":1.397,"5min":1.264,"15min":1.1719999999999999},"max":{"1min":3.2679999999999998,"5min":3.847,"15min":652.88999999999999},"last":2.4660000000000002},{"interface":"front","average":{"1min":3.7290000000000001,"5min":2.4340000000000002,"15min":5.5830000000000002},"min":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.153},"max":{"1min":35.875999999999998,"5min":35.875999999999998,"15min":944.33299999999997},"last":2.8029999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":8.8260000000000005,"15min":4.6340000000000003},"min":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":0.752},"max":{"1min":3.5150000000000001,"5min":551.68899999999996,"15min":551.68899999999996},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.609,"5min":2.8610000000000002,"15min":2.71},"min":{"1min":1.671,"5min":1.671,"15min":0.875},"max":{"1min":3.5529999999999999,"5min":3.8300000000000001,"15min":3.883},"last":2.8420000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:21:28 2020","interfaces":[{"interface":"back","average":{"1min":36.609999999999999,"5min":9.3030000000000008,"15min":12.561999999999999},"min":{"1min":1.776,"5min":1.698,"15min":1.1739999999999999},"max":{"1min":653.18799999999999,"5min":653.18799999999999,"15min":859.346},"last":2.6640000000000001},{"interface":"front","average":{"1min":2.48,"5min":2.8820000000000001,"15min":6.1150000000000002},"min":{"1min":2.0800000000000001,"5min":1.653,"15min":0.83899999999999997},"max":{"1min":3.169,"5min":4.1280000000000001,"15min":503.52699999999999},"last":2.419}]},{"osd":5,"last update":"Thu Nov 12 12:21:14 2020","interfaces":[{"interface":"back","average":{"1min":2.7570000000000001,"5min":2.6240000000000001,"15min":4.1210000000000004},"min":{"1min":2.2069999999999999,"5min":1.716,"15min":1.589},"max":{"1min":3.238,"5min":4.056,"15min":576.83399999999995},"last":2.742},{"interface":"front","average":{"1min":20.073,"5min":12.494999999999999,"15min":8.0109999999999992},"min":{"1min":1.875,"5min":1.5960000000000001,"15min":1.5960000000000001},"max":{"1min":365.61500000000001,"5min":684.90800000000002,"15min":684.90800000000002},"last":2.5590000000000002}]},{"osd":6,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":2.7850000000000001,"5min":2.7389999999999999,"15min":5.1509999999999998},"min":{"1min":1.9630000000000001,"5min":1.9159999999999999,"15min":0.79700000000000004},"max":{"1min":3.3839999999999999,"5min":3.9860000000000002,"15min":596.68799999999999},"last":2.9009999999999998},{"interface":"front","average":{"1min":8.0250000000000004,"5min":3.8519999999999999,"15min":3.1869999999999998},"min":{"1min":2.0030000000000001,"5min":1.9630000000000001,"15min":1.097},"max":{"1min":115.961,"5min":115.961,"15min":115.961},"last":3.2879999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":12.087999999999999,"15min":12.523999999999999},"min":{"1min":2.0019999999999998,"5min":1.6830000000000001,"15min":1.3149999999999999},"max":{"1min":3.4620000000000002,"5min":503.88600000000002,"15min":962.88099999999997},"last":3.0550000000000002},{"interface":"front","average":{"1min":34.366,"5min":22.047000000000001,"15min":14.087999999999999},"min":{"1min":2.4569999999999999,"5min":1.996,"15min":1.3600000000000001},"max":{"1min":597.74800000000005,"5min":659.97199999999998,"15min":699.61099999999999},"last":3.0800000000000001}]}]},{"osd":0,"up_from":245,"seq":1052266987773,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1115620,"kb_used_data":67036,"kb_used_omap":106,"kb_used_meta":1048469,"kb_avail":93256220,"statfs":{"total":96636764160,"available":95494369280,"internally_reserved":1073741824,"allocated":68644864,"data_stored":89861077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108685,"internal_metadata":1073633139},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":17.526,"5min":5.4950000000000001,"15min":4.7249999999999996},"min":{"1min":1.173,"5min":1.173,"15min":0.94799999999999995},"max":{"1min":323.76999999999998,"5min":323.76999999999998,"15min":414.45699999999999},"last":3.1059999999999999},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.946,"15min":12.289999999999999},"min":{"1min":1.2290000000000001,"5min":1.2030000000000001,"15min":0.86899999999999999},"max":{"1min":2.4340000000000002,"5min":3.508,"15min":721.47000000000003},"last":2.2810000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:21:41 2020","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.7829999999999999,"15min":10.721},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.629},"max":{"1min":2.052,"5min":3.1579999999999999,"15min":941.245},"last":1.877},{"interface":"front","average":{"1min":1.8,"5min":2.3929999999999998,"15min":3.6320000000000001},"min":{"1min":1.071,"5min":1.071,"15min":0.80800000000000005},"max":{"1min":2.7000000000000002,"5min":4.4900000000000002,"15min":346.39299999999997},"last":2.0459999999999998}]},{"osd":3,"last update":"Thu Nov 12 12:21:41 2020","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":12.808,"15min":6.9340000000000002},"min":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":0.875},"max":{"1min":2.706,"5min":406.66899999999998,"15min":406.66899999999998},"last":1.9830000000000001},{"interface":"front","average":{"1min":2.073,"5min":5.8300000000000001,"15min":3.5049999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.66000000000000003},"max":{"1min":4.3879999999999999,"5min":205.96600000000001,"15min":205.96600000000001},"last":1.5669999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:21:22 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":6.3869999999999996,"15min":9.923},"min":{"1min":2.0569999999999999,"5min":1.7909999999999999,"15min":1.2749999999999999},"max":{"1min":4.1619999999999999,"5min":355.63999999999999,"15min":855.26300000000003},"last":3.222},{"interface":"front","average":{"1min":2.7970000000000002,"5min":25.908999999999999,"15min":19.613},"min":{"1min":1.345,"5min":1.345,"15min":1.155},"max":{"1min":4.1020000000000003,"5min":677.99099999999999,"15min":1379.0840000000001},"last":2.782}]},{"osd":5,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.8730000000000002,"5min":2.851,"15min":4.4779999999999998},"min":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.5349999999999999},"max":{"1min":4.3399999999999999,"5min":4.5330000000000004,"15min":270.59300000000002},"last":3.0419999999999998},{"interface":"front","average":{"1min":3.125,"5min":6.7850000000000001,"15min":12.808999999999999},"min":{"1min":1.9730000000000001,"5min":1.925,"15min":1.4630000000000001},"max":{"1min":4.2830000000000004,"5min":353.98200000000003,"15min":558.88199999999995},"last":2.7429999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":3.141,"15min":6.2329999999999997},"min":{"1min":2.1139999999999999,"5min":1.788,"15min":1.0820000000000001},"max":{"1min":4.4550000000000001,"5min":4.4550000000000001,"15min":962.05700000000002},"last":3.1499999999999999},{"interface":"front","average":{"1min":3.2389999999999999,"5min":4.532,"15min":5.8209999999999997},"min":{"1min":2.1549999999999998,"5min":2.1040000000000001,"15min":1.071},"max":{"1min":4.5549999999999997,"5min":128.83099999999999,"15min":408.70999999999998},"last":3.1829999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:21:30 2020","interfaces":[{"interface":"back","average":{"1min":49.468000000000004,"5min":19.488,"15min":8.6349999999999998},"min":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.7170000000000001},"max":{"1min":307.64299999999997,"5min":708.64599999999996,"15min":708.64599999999996},"last":2.8149999999999999},{"interface":"front","average":{"1min":3.0750000000000002,"5min":6.9489999999999998,"15min":9.9139999999999997},"min":{"1min":2.101,"5min":2.101,"15min":1.899},"max":{"1min":4.625,"5min":392.08100000000002,"15min":936.08799999999997},"last":2.8450000000000002}]}]},{"osd":1,"up_from":596,"seq":2559800508591,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102500,"kb_used_data":53916,"kb_used_omap":259,"kb_used_meta":1048316,"kb_avail":93269340,"statfs":{"total":96636764160,"available":95507804160,"internally_reserved":1073741824,"allocated":55209984,"data_stored":58313765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265441,"internal_metadata":1073476383},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:05 2020","interfaces":[{"interface":"back","average":{"1min":2.278,"5min":2.2959999999999998,"15min":2.1699999999999999},"min":{"1min":1.502,"5min":1.006,"15min":0.84499999999999997},"max":{"1min":3.5499999999999998,"5min":4.1299999999999999,"15min":4.1299999999999999},"last":2.79},{"interface":"front","average":{"1min":1.988,"5min":4.008,"15min":4.2859999999999996},"min":{"1min":1.01,"5min":0.97899999999999998,"15min":0.82699999999999996},"max":{"1min":3.3130000000000002,"5min":186.274,"15min":418.93299999999999},"last":2.2629999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.4460000000000002,"15min":4.7679999999999998},"min":{"1min":1.7210000000000001,"5min":1.048,"15min":0.73899999999999999},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":697.46699999999998},"last":1.919},{"interface":"front","average":{"1min":2.2970000000000002,"5min":12.449999999999999,"15min":5.7069999999999999},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.121},"max":{"1min":3.3780000000000001,"5min":952.149,"15min":952.149},"last":2.1850000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.9850000000000001,"15min":4.952},"min":{"1min":0.96799999999999997,"5min":0.95599999999999996,"15min":0.84199999999999997},"max":{"1min":2.7040000000000002,"5min":3.6989999999999998,"15min":745.18499999999995},"last":1.7809999999999999},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.7799999999999998,"15min":4.3979999999999997},"min":{"1min":1.55,"5min":1.1599999999999999,"15min":1.046},"max":{"1min":4.96,"5min":6.1619999999999999,"15min":556.56600000000003},"last":2.7360000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":7.3369999999999997,"15min":7.4809999999999999},"min":{"1min":2.0219999999999998,"5min":1.306,"15min":1.2370000000000001},"max":{"1min":5.0789999999999997,"5min":296.50599999999997,"15min":907.37900000000002},"last":1.9630000000000001},{"interface":"front","average":{"1min":2.6379999999999999,"5min":9.0129999999999999,"15min":10.769},"min":{"1min":1.405,"5min":1.242,"15min":1.0369999999999999},"max":{"1min":4.7220000000000004,"5min":713.56299999999999,"15min":962.79999999999995},"last":3.153}]},{"osd":5,"last update":"Thu Nov 12 12:21:10 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":2.9159999999999999,"15min":11.224},"min":{"1min":1.4810000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":4.7999999999999998,"5min":4.7999999999999998,"15min":882.23599999999999},"last":3.0649999999999999},{"interface":"front","average":{"1min":3.1160000000000001,"5min":3.0419999999999998,"15min":2.9129999999999998},"min":{"1min":2.1110000000000002,"5min":1.349,"15min":1.349},"max":{"1min":5.1420000000000003,"5min":5.1420000000000003,"15min":5.1420000000000003},"last":2.8300000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":16.097999999999999,"5min":11.843,"15min":15.132},"min":{"1min":1.7789999999999999,"5min":1.6519999999999999,"15min":1.2270000000000001},"max":{"1min":248.56800000000001,"5min":703.36000000000001,"15min":712.46100000000001},"last":2.6499999999999999},{"interface":"front","average":{"1min":3.1520000000000001,"5min":10.99,"15min":11.157999999999999},"min":{"1min":2.262,"5min":1.758,"15min":1.2989999999999999},"max":{"1min":4.8879999999999999,"5min":862.61199999999997,"15min":862.61199999999997},"last":3.1920000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:21:05 2020","interfaces":[{"interface":"back","average":{"1min":3.214,"5min":10.917,"15min":8.3499999999999996},"min":{"1min":2.1429999999999998,"5min":2.028,"15min":1.6140000000000001},"max":{"1min":5.226,"5min":889.41300000000001,"15min":889.41300000000001},"last":2.8650000000000002},{"interface":"front","average":{"1min":3.02,"5min":8.3350000000000009,"15min":8.1820000000000004},"min":{"1min":2.0139999999999998,"5min":1.7809999999999999,"15min":1.623},"max":{"1min":5.0279999999999996,"5min":590.93899999999996,"15min":910.41899999999998},"last":3.1160000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118312,"kb_used_data":69728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253528,"statfs":{"total":96636764160,"available":95491612672,"internally_reserved":1073741824,"allocated":71401472,"data_stored":92861124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:20:56 2020","interfaces":[{"interface":"back","average":{"1min":6.3799999999999999,"5min":2.9380000000000002,"15min":7.702},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.68300000000000005},"max":{"1min":101.264,"5min":101.264,"15min":910.56200000000001},"last":1.897},{"interface":"front","average":{"1min":2.3769999999999998,"5min":2.2490000000000001,"15min":5.0590000000000002},"min":{"1min":1.026,"5min":1.014,"15min":0.78100000000000003},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":502.17099999999999},"last":2.0219999999999998}]},{"osd":1,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":1.9490000000000001,"5min":6.6769999999999996,"15min":11.897},"min":{"1min":1.1759999999999999,"5min":0.88200000000000001,"15min":0.71899999999999997},"max":{"1min":3.1560000000000001,"5min":421.51299999999998,"15min":915.37400000000002},"last":2.2109999999999999},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.347,"15min":11.691000000000001},"min":{"1min":1.167,"5min":1.167,"15min":0.85599999999999998},"max":{"1min":3.3330000000000002,"5min":3.508,"15min":899.26800000000003},"last":2.6099999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:21:35 2020","interfaces":[{"interface":"back","average":{"1min":34.923999999999999,"5min":9.7409999999999997,"15min":9.2260000000000009},"min":{"1min":1.071,"5min":1.071,"15min":0.628},"max":{"1min":826.27700000000004,"5min":826.27700000000004,"15min":826.27700000000004},"last":2.3100000000000001},{"interface":"front","average":{"1min":2.1360000000000001,"5min":5.8239999999999998,"15min":5.7990000000000004},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":0.96899999999999997},"max":{"1min":3.5819999999999999,"5min":304.57100000000003,"15min":304.57100000000003},"last":2.157}]},{"osd":4,"last update":"Thu Nov 12 12:21:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":2.516,"15min":4.7210000000000001},"min":{"1min":1.393,"5min":1.393,"15min":1.073},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":503.37},"last":2.7970000000000002},{"interface":"front","average":{"1min":50.110999999999997,"5min":15.205,"15min":9.9399999999999995},"min":{"1min":1.643,"5min":1.643,"15min":0.98299999999999998},"max":{"1min":518.65099999999995,"5min":518.65099999999995,"15min":518.65099999999995},"last":3.0009999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":2.6760000000000002,"15min":2.7290000000000001},"min":{"1min":1.8260000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":3.468,"5min":4.1840000000000002,"15min":4.2800000000000002},"last":2.7160000000000002},{"interface":"front","average":{"1min":31.562999999999999,"5min":8.5600000000000005,"15min":8.25},"min":{"1min":1.8560000000000001,"5min":1.6739999999999999,"15min":1.629},"max":{"1min":751.98500000000001,"5min":751.98500000000001,"15min":751.98500000000001},"last":3.0499999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":21.634,"5min":6.6269999999999998,"15min":4.0389999999999997},"min":{"1min":1.853,"5min":1.78,"15min":1.4690000000000001},"max":{"1min":512.71400000000006,"5min":512.71400000000006,"15min":512.71400000000006},"last":2.7629999999999999},{"interface":"front","average":{"1min":3.0129999999999999,"5min":2.7970000000000002,"15min":9.4619999999999997},"min":{"1min":1.474,"5min":1.474,"15min":1.2529999999999999},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":1001.212},"last":2.8420000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:21:29 2020","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":3.0800000000000001,"15min":3.0259999999999998},"min":{"1min":2.0510000000000002,"5min":2.0049999999999999,"15min":1.8600000000000001},"max":{"1min":4.2130000000000001,"5min":4.6219999999999999,"15min":4.827},"last":3.4710000000000001},{"interface":"front","average":{"1min":3.036,"5min":3.1120000000000001,"15min":6.1719999999999997},"min":{"1min":2.198,"5min":2.198,"15min":1.7709999999999999},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":612.13900000000001},"last":3.363}]}]},{"osd":3,"up_from":13,"seq":55834575154,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":97589153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:56 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":7.327,"15min":4.3019999999999996},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.70699999999999996},"max":{"1min":2.2679999999999998,"5min":539.39700000000005,"15min":539.39700000000005},"last":2.1509999999999998},{"interface":"front","average":{"1min":2.1379999999999999,"5min":16.751000000000001,"15min":14.835000000000001},"min":{"1min":1.05,"5min":1.05,"15min":0.745},"max":{"1min":3.8039999999999998,"5min":897.51999999999998,"15min":897.51999999999998},"last":3.8039999999999998}]},{"osd":1,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":29.864000000000001,"5min":24.707999999999998,"15min":9.8190000000000008},"min":{"1min":1.3979999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":502.94499999999999,"5min":1000.314,"15min":1000.314},"last":1.7390000000000001},{"interface":"front","average":{"1min":54.143999999999998,"5min":13.034000000000001,"15min":6.0289999999999999},"min":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":0.78000000000000003},"max":{"1min":504.43200000000002,"5min":504.43200000000002,"15min":504.43200000000002},"last":3.7120000000000002}]},{"osd":2,"last update":"Thu Nov 12 12:21:26 2020","interfaces":[{"interface":"back","average":{"1min":1.8420000000000001,"5min":2.2200000000000002,"15min":3.968},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.92700000000000005},"max":{"1min":2.379,"5min":4.1310000000000002,"15min":445.346},"last":2.2890000000000001},{"interface":"front","average":{"1min":25.465,"5min":13.157999999999999,"15min":6.1230000000000002},"min":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":0.84899999999999998},"max":{"1min":367.471,"5min":367.471,"15min":367.471},"last":4.9409999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:21:21 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":11.834,"15min":11.029},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1},"max":{"1min":3.3420000000000001,"5min":931.26099999999997,"15min":931.26099999999997},"last":1.6879999999999999},{"interface":"front","average":{"1min":2.794,"5min":2.895,"15min":8.7699999999999996},"min":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.2669999999999999},"max":{"1min":4.0069999999999997,"5min":5.1470000000000002,"15min":866.529},"last":3.8839999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:21:10 2020","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":2.7629999999999999,"15min":8.218},"min":{"1min":1.625,"5min":1.625,"15min":1.625},"max":{"1min":3.4409999999999998,"5min":4.1900000000000004,"15min":504.80799999999999},"last":1.798},{"interface":"front","average":{"1min":2.573,"5min":2.4889999999999999,"15min":7.4219999999999997},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.2829999999999999},"max":{"1min":3.165,"5min":3.4670000000000001,"15min":941.37300000000005},"last":2.0459999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":3.4590000000000001,"5min":11.211,"15min":14.042999999999999},"min":{"1min":2.7400000000000002,"5min":2.2799999999999998,"15min":1.375},"max":{"1min":4.7039999999999997,"5min":804.34000000000003,"15min":941.26800000000003},"last":3.96},{"interface":"front","average":{"1min":3.7429999999999999,"5min":20.917000000000002,"15min":14.537000000000001},"min":{"1min":2.7690000000000001,"5min":2.5579999999999998,"15min":1.3919999999999999},"max":{"1min":4.9429999999999996,"5min":653.09799999999996,"15min":967.322},"last":4.0270000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:21:26 2020","interfaces":[{"interface":"back","average":{"1min":3.5190000000000001,"5min":20.445,"15min":9.2970000000000006},"min":{"1min":2.306,"5min":2.306,"15min":1.911},"max":{"1min":4.8570000000000002,"5min":543.17899999999997,"15min":543.17899999999997},"last":4.0960000000000001},{"interface":"front","average":{"1min":3.5609999999999999,"5min":5.2130000000000001,"15min":5.8209999999999997},"min":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":1.728},"max":{"1min":4.9219999999999997,"5min":143.191,"15min":529.88699999999994},"last":4.8550000000000004}]}]}]}} , 2020-11-12T12:22:01.427 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:22:45.426 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.6 , 2020-11-12 12:22:45.689 7fa9064bd700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:22:45.801 7fa9064bd700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:24:40.670 7f85eeff3700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:24:40.776 7f85eeff3700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T12:24:41.073 INFO:teuthology.orchestra.run.smithi044.stdout: Ignoring malparsed backtrace: 2020-11-12T12:24:41.759 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-12T12:24:41.821 INFO:tasks.ceph.mon.c:Stopped , 2020-11-12T12:24:41.822 DEBUG:tasks.ceph.mon.b:waiting for process to exit Ignoring malparsed backtrace: raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') , RuntimeError: Exiting scrub checking -- not all pgs scrubbed. , 2020-11-12T12:25:57.350 DEBUG:teuthology.run_tasks:Unwinding manager install Ignoring malparsed backtrace: cp: cannot stat ‘/usr/bin/ceph_test_rados.debug’: No such file or directory , 2020-11-12T12:26:22.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-11-12T12:26:22.256 ERROR:teuthology.run_tasks:Manager failed: internal.archive Ignoring malparsed backtrace: ceph version 14.2.11-111-g93c5d14 (93c5d149177634d9a3196c2990e4c0af398f8a4d) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7fe009429524] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x13e8) [0x559bae079378] Ignoring malparsed backtrace: 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout:{ , 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "a244e989-1818-4ba5-ad4f-fb2f6364d428", , 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout: "health": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_osds": 8, , 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_up_osds": 8, , 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_in_osds": 8, Ignoring malparsed backtrace: 2020-11-12T12:07:52.054 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.054 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.055 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_max_iterations": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_HOST": { , 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_HOST", , 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:52.140 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.140 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.141 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.209 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:07:52.209 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", , 2020-11-12T12:07:52.210 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "diskprediction_server": { , 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_server", , 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.237 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.237 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.238 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.293 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption1", , 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", , 2020-11-12T12:07:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "address", , 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "proxy": { , 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "proxy", , 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_sender": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_port": { , 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_port", , 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:52.401 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.401 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.402 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0.001", , 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "0.999", , 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.429 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", , 2020-11-12T12:07:52.429 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", , 2020-11-12T12:07:52.430 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.456 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.456 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "REST_REQUESTS_TIMEOUT": { , 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "REST_REQUESTS_TIMEOUT", , 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:52.483 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.483 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.484 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:52.497 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.498 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.498 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically mark OSD if it may fail before this long", , 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.579 INFO:teuthology.orchestra.run.smithi044.stdout: "username": { , 2020-11-12T12:07:52.580 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "username", , 2020-11-12T12:07:52.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: "prefix": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to persist completed events", , 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, , 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", , 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": {} Ignoring malparsed backtrace: 2020-11-12T12:07:52.634 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.634 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.648 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.649 INFO:teuthology.orchestra.run.smithi044.stdout: "testnewline": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", , 2020-11-12T12:07:52.664 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.664 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", , 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.691 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:07:52.691 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", , 2020-11-12T12:07:52.692 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, Ignoring malparsed backtrace: 2020-11-12T12:07:52.705 INFO:teuthology.orchestra.run.smithi044.stdout: "services": {} , 2020-11-12T12:07:52.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.706 INFO:teuthology.orchestra.run.smithi044.stdout: "progress_events": {} Ignoring malparsed backtrace: 2020-11-12 12:08:16.930 7f2f3f453700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:08:17.043 7f2f3f453700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T12:08:17.084 INFO:teuthology.orchestra.run.smithi044.stdout:1052266987607 Ignoring malparsed backtrace: 2020-11-12T12:08:26.986 INFO:teuthology.orchestra.run.smithi044.stdout: "a", , 2020-11-12T12:08:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: "b", , 2020-11-12T12:08:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: "c" Ignoring malparsed backtrace: 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: "state_name": "active+clean+scrubbing", , 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: "count": 1 , 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: } Ignoring malparsed backtrace: 2020-11-12T12:08:27.026 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.027 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.047 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.047 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.048 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.064 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.064 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:08:27.065 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "pgs,objects,bytes", Ignoring malparsed backtrace: 2020-11-12T12:08:27.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", , 2020-11-12T12:08:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, Ignoring malparsed backtrace: 2020-11-12T12:08:27.092 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", , 2020-11-12T12:08:27.093 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.093 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.106 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.106 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.107 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.122 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.123 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SECRET_KEY": { , 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SECRET_KEY", , 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:08:27.150 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.151 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.151 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.164 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.165 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise health warning if OSD may fail before this long", , 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "localhost", , 2020-11-12T12:08:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "influx", Ignoring malparsed backtrace: 2020-11-12T12:08:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default replica count for any created local pool", , 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "50", , 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stale_cache_strategy", , 2020-11-12T12:08:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.415 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.415 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.416 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.440 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/report", , 2020-11-12T12:08:27.440 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.441 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.458 INFO:teuthology.orchestra.run.smithi044.stdout: } , 2020-11-12T12:08:27.459 INFO:teuthology.orchestra.run.smithi044.stdout: ], , 2020-11-12T12:08:27.459 INFO:teuthology.orchestra.run.smithi044.stdout: "modules": [ Ignoring malparsed backtrace: 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "balancer", Ignoring malparsed backtrace: 2020-11-12T12:08:27.505 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.505 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_cephfs": { , 2020-11-12T12:08:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_cephfs", Ignoring malparsed backtrace: 2020-11-12T12:08:27.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", , 2020-11-12T12:08:27.550 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.593 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.594 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.607 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "sharedsecret", , 2020-11-12T12:08:27.608 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "retention_period": { , 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retention_period", , 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", Ignoring malparsed backtrace: 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: "diskprediction_user": { , 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_user", Ignoring malparsed backtrace: 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "true", , 2020-11-12T12:08:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "rack", Ignoring malparsed backtrace: 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption3": { , 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption3", , 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", Ignoring malparsed backtrace: 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssh", , 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, , 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:29.828 INFO:teuthology.orchestra.run.smithi044.stdout: , dumped all , 2020-11-12T12:08:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":975,"stamp":"2020-11-12 12:08:28.580429","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":9000640,"kb_used_data":611968,"kb_used_omap":1496,"kb_used_meta":8387111,"kb_avail":745974080,"statfs":{"total":773094113280,"available":763877457920,"internally_reserved":8589934592,"allocated":626655232,"data_stored":749813723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1532414,"internal_metadata":8588402178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003615"},"pg_stats":[{"pgid":"2.f","version":"605'975","reported_seq":"5179","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.048094","last_change":"2020-11-12 12:07:44.339133","last_active":"2020-11-12 12:08:13.048094","last_peered":"2020-11-12 12:08:13.048094","last_clean":"2020-11-12 12:08:13.048094","last_became_active":"2020-11-12 12:07:43.542344","last_became_peered":"2020-11-12 12:07:43.542344","last_unstale":"2020-11-12 12:08:13.048094","last_undegraded":"2020-11-12 12:08:13.048094","last_fullsized":"2020-11-12 12:08:13.048094","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":975,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":36964515,"num_objects":22,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":222,"num_read_kb":276029,"num_write":279,"num_write_kb":64344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":676764753,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"606'755","reported_seq":"3298","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053607","last_change":"2020-11-12 12:07:45.720783","last_active":"2020-11-12 12:08:13.053607","last_peered":"2020-11-12 12:08:13.053607","last_clean":"2020-11-12 12:08:13.053607","last_became_active":"2020-11-12 12:07:44.559898","last_became_peered":"2020-11-12 12:07:44.559898","last_unstale":"2020-11-12 12:08:13.053607","last_undegraded":"2020-11-12 12:08:13.053607","last_fullsized":"2020-11-12 12:08:13.053607","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":44542027,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":142,"num_read_kb":168636,"num_write":206,"num_write_kb":48990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":220359844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"126","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.561197","last_change":"2020-11-12 12:07:34.980292","last_active":"2020-11-12 12:08:12.561197","last_peered":"2020-11-12 12:08:12.561197","last_clean":"2020-11-12 12:08:12.561197","last_became_active":"2020-11-12 12:07:34.979587","last_became_peered":"2020-11-12 12:07:34.979587","last_unstale":"2020-11-12 12:08:12.561197","last_undegraded":"2020-11-12 12:08:12.561197","last_fullsized":"2020-11-12 12:08:12.561197","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:50.045143","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:01:01.411425","last_clean_scrub_stamp":"2020-11-12 12:06:50.045143","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"607'1034","reported_seq":"4531","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567601","last_change":"2020-11-12 12:07:45.706465","last_active":"2020-11-12 12:08:12.567601","last_peered":"2020-11-12 12:08:12.567601","last_clean":"2020-11-12 12:08:12.567601","last_became_active":"2020-11-12 12:07:45.566064","last_became_peered":"2020-11-12 12:07:45.566064","last_unstale":"2020-11-12 12:08:12.567601","last_undegraded":"2020-11-12 12:08:12.567601","last_fullsized":"2020-11-12 12:08:12.567601","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":1034,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63069801,"num_objects":33,"num_object_clones":27,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":227,"num_read_kb":245644,"num_write":327,"num_write_kb":79050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":626,"num_bytes_recovered":710613985,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376795","last_change":"2020-11-12 12:07:07.510609","last_active":"2020-11-12 12:08:13.376795","last_peered":"2020-11-12 12:08:13.376795","last_clean":"2020-11-12 12:08:13.376795","last_became_active":"2020-11-12 12:06:38.531854","last_became_peered":"2020-11-12 12:06:38.531854","last_unstale":"2020-11-12 12:08:13.376795","last_undegraded":"2020-11-12 12:08:13.376795","last_fullsized":"2020-11-12 12:08:13.376795","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:07.510477","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:07:07.510477","last_clean_scrub_stamp":"2020-11-12 12:07:07.510477","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"605'571","reported_seq":"3045","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376977","last_change":"2020-11-12 12:07:44.295346","last_active":"2020-11-12 12:08:13.376977","last_peered":"2020-11-12 12:08:13.376977","last_clean":"2020-11-12 12:08:13.376977","last_became_active":"2020-11-12 12:07:43.546299","last_became_peered":"2020-11-12 12:07:43.546299","last_unstale":"2020-11-12 12:08:13.376977","last_undegraded":"2020-11-12 12:08:13.376977","last_fullsized":"2020-11-12 12:08:13.376977","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":571,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41575305,"num_objects":15,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":110,"num_read_kb":112384,"num_write":178,"num_write_kb":39453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":214562650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"631","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047347","last_change":"2020-11-12 12:07:05.341895","last_active":"2020-11-12 12:08:13.047347","last_peered":"2020-11-12 12:08:13.047347","last_clean":"2020-11-12 12:08:13.047347","last_became_active":"2020-11-12 12:06:37.605758","last_became_peered":"2020-11-12 12:06:37.605758","last_unstale":"2020-11-12 12:08:13.047347","last_undegraded":"2020-11-12 12:08:13.047347","last_fullsized":"2020-11-12 12:08:13.047347","mapping_epoch":559,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":560,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:05.341782","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:05.341782","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"605'852","reported_seq":"3625","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053157","last_change":"2020-11-12 12:07:43.726533","last_active":"2020-11-12 12:08:13.053157","last_peered":"2020-11-12 12:08:13.053157","last_clean":"2020-11-12 12:08:13.053157","last_became_active":"2020-11-12 12:07:43.552867","last_became_peered":"2020-11-12 12:07:43.552867","last_unstale":"2020-11-12 12:08:13.053157","last_undegraded":"2020-11-12 12:08:13.053157","last_fullsized":"2020-11-12 12:08:13.053157","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":852,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40651861,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":176,"num_read_kb":237784,"num_write":229,"num_write_kb":51463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":336631858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"423","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566243","last_change":"2020-11-12 12:07:06.161566","last_active":"2020-11-12 12:08:12.566243","last_peered":"2020-11-12 12:08:12.566243","last_clean":"2020-11-12 12:08:12.566243","last_became_active":"2020-11-12 12:07:02.730087","last_became_peered":"2020-11-12 12:07:02.730087","last_unstale":"2020-11-12 12:08:12.566243","last_undegraded":"2020-11-12 12:08:12.566243","last_fullsized":"2020-11-12 12:08:12.566243","mapping_epoch":580,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:06.161501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:06.161501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"605'787","reported_seq":"3194","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376911","last_change":"2020-11-12 12:07:43.680183","last_active":"2020-11-12 12:08:13.376911","last_peered":"2020-11-12 12:08:13.376911","last_clean":"2020-11-12 12:08:13.376911","last_became_active":"2020-11-12 12:07:43.540815","last_became_peered":"2020-11-12 12:07:43.540815","last_unstale":"2020-11-12 12:08:13.376911","last_undegraded":"2020-11-12 12:08:13.376911","last_fullsized":"2020-11-12 12:08:13.376911","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":787,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43160093,"num_objects":20,"num_object_clones":17,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":133,"num_read_kb":120761,"num_write":220,"num_write_kb":54232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":209150928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"134","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.560847","last_change":"2020-11-12 12:07:44.529416","last_active":"2020-11-12 12:08:12.560847","last_peered":"2020-11-12 12:08:12.560847","last_clean":"2020-11-12 12:08:12.560847","last_became_active":"2020-11-12 12:07:40.996832","last_became_peered":"2020-11-12 12:07:40.996832","last_unstale":"2020-11-12 12:08:12.560847","last_undegraded":"2020-11-12 12:08:12.560847","last_fullsized":"2020-11-12 12:08:12.560847","mapping_epoch":601,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":602,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:44.529241","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:44.529241","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"607'461","reported_seq":"3496","reported_epoch":"619","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:08:13.376948","last_change":"2020-11-12 12:07:48.505159","last_active":"2020-11-12 12:08:13.376948","last_peered":"2020-11-12 12:08:13.376948","last_clean":"2020-11-12 12:08:13.376948","last_became_active":"2020-11-12 12:07:45.558646","last_became_peered":"2020-11-12 12:07:45.558646","last_unstale":"2020-11-12 12:08:13.376948","last_undegraded":"2020-11-12 12:08:13.376948","last_fullsized":"2020-11-12 12:08:13.376948","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":461,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22082484,"num_objects":10,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":79,"num_read_kb":73364,"num_write":120,"num_write_kb":28596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":226411123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376678","last_change":"2020-11-12 12:07:14.479425","last_active":"2020-11-12 12:08:13.376678","last_peered":"2020-11-12 12:08:13.376678","last_clean":"2020-11-12 12:08:13.376678","last_became_active":"2020-11-12 12:06:38.526587","last_became_peered":"2020-11-12 12:06:38.526587","last_unstale":"2020-11-12 12:08:13.376678","last_undegraded":"2020-11-12 12:08:13.376678","last_fullsized":"2020-11-12 12:08:13.376678","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:14.479334","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:14.479334","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"605'236","reported_seq":"2602","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376934","last_change":"2020-11-12 12:07:43.679033","last_active":"2020-11-12 12:08:13.376934","last_peered":"2020-11-12 12:08:13.376934","last_clean":"2020-11-12 12:08:13.376934","last_became_active":"2020-11-12 12:07:43.544179","last_became_peered":"2020-11-12 12:07:43.544179","last_unstale":"2020-11-12 12:08:13.376934","last_undegraded":"2020-11-12 12:08:13.376934","last_fullsized":"2020-11-12 12:08:13.376934","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":236,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8892018,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":52270,"num_write":58,"num_write_kb":14437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":101718835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"605'185","reported_seq":"2708","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566247","last_change":"2020-11-12 12:07:43.627236","last_active":"2020-11-12 12:08:12.566247","last_peered":"2020-11-12 12:08:12.566247","last_clean":"2020-11-12 12:08:12.566247","last_became_active":"2020-11-12 12:07:43.549723","last_became_peered":"2020-11-12 12:07:43.549723","last_unstale":"2020-11-12 12:08:12.566247","last_undegraded":"2020-11-12 12:08:12.566247","last_fullsized":"2020-11-12 12:08:12.566247","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5743030,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":84824,"num_write":57,"num_write_kb":16290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":83699520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"242","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047777","last_change":"2020-11-12 12:07:26.910728","last_active":"2020-11-12 12:08:13.047777","last_peered":"2020-11-12 12:08:13.047777","last_clean":"2020-11-12 12:08:13.047777","last_became_active":"2020-11-12 12:07:26.910195","last_became_peered":"2020-11-12 12:07:26.910195","last_unstale":"2020-11-12 12:08:13.047777","last_undegraded":"2020-11-12 12:08:13.047777","last_fullsized":"2020-11-12 12:08:13.047777","mapping_epoch":591,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":592,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:29.446679","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:06:29.446679","last_clean_scrub_stamp":"2020-11-12 12:06:29.446679","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"606'930","reported_seq":"3709","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376799","last_change":"2020-11-12 12:07:45.132173","last_active":"2020-11-12 12:08:13.376799","last_peered":"2020-11-12 12:08:13.376799","last_clean":"2020-11-12 12:08:13.376799","last_became_active":"2020-11-12 12:07:44.583667","last_became_peered":"2020-11-12 12:07:44.583667","last_unstale":"2020-11-12 12:08:13.376799","last_undegraded":"2020-11-12 12:08:13.376799","last_fullsized":"2020-11-12 12:08:13.376799","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":930,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33313503,"num_objects":17,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":256,"num_read_kb":367173,"num_write":237,"num_write_kb":57709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":350399398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"46","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053762","last_change":"2020-11-12 12:07:35.980717","last_active":"2020-11-12 12:08:13.053762","last_peered":"2020-11-12 12:08:13.053762","last_clean":"2020-11-12 12:08:13.053762","last_became_active":"2020-11-12 12:07:35.977675","last_became_peered":"2020-11-12 12:07:35.977675","last_unstale":"2020-11-12 12:08:13.053762","last_undegraded":"2020-11-12 12:08:13.053762","last_fullsized":"2020-11-12 12:08:13.053762","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:28.871630","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:06:28.871630","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"606'846","reported_seq":"4089","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.046782","last_change":"2020-11-12 12:07:44.693996","last_active":"2020-11-12 12:08:13.046782","last_peered":"2020-11-12 12:08:13.046782","last_clean":"2020-11-12 12:08:13.046782","last_became_active":"2020-11-12 12:07:44.564657","last_became_peered":"2020-11-12 12:07:44.564657","last_unstale":"2020-11-12 12:08:13.046782","last_undegraded":"2020-11-12 12:08:13.046782","last_fullsized":"2020-11-12 12:08:13.046782","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46543737,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":151,"num_read_kb":169538,"num_write":238,"num_write_kb":60205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":496256418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"605'674","reported_seq":"3005","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053321","last_change":"2020-11-12 12:07:43.712637","last_active":"2020-11-12 12:08:13.053321","last_peered":"2020-11-12 12:08:13.053321","last_clean":"2020-11-12 12:08:13.053321","last_became_active":"2020-11-12 12:07:43.548419","last_became_peered":"2020-11-12 12:07:43.548419","last_unstale":"2020-11-12 12:08:13.053321","last_undegraded":"2020-11-12 12:08:13.053321","last_fullsized":"2020-11-12 12:08:13.053321","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":674,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38169296,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":114,"num_read_kb":131891,"num_write":165,"num_write_kb":37225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":225335475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"607'796","reported_seq":"4267","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148284","last_change":"2020-11-12 12:07:46.152581","last_active":"2020-11-12 12:08:13.148284","last_peered":"2020-11-12 12:08:13.148284","last_clean":"2020-11-12 12:08:13.148284","last_became_active":"2020-11-12 12:07:46.028375","last_became_peered":"2020-11-12 12:07:46.028375","last_unstale":"2020-11-12 12:08:13.148284","last_undegraded":"2020-11-12 12:08:13.148284","last_fullsized":"2020-11-12 12:08:13.148284","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27857526,"num_objects":19,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":183,"num_read_kb":219470,"num_write":240,"num_write_kb":56199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":578,"num_bytes_recovered":558493168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"607'559","reported_seq":"3316","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376918","last_change":"2020-11-12 12:07:45.654658","last_active":"2020-11-12 12:08:13.376918","last_peered":"2020-11-12 12:08:13.376918","last_clean":"2020-11-12 12:08:13.376918","last_became_active":"2020-11-12 12:07:45.564480","last_became_peered":"2020-11-12 12:07:45.564480","last_unstale":"2020-11-12 12:08:13.376918","last_undegraded":"2020-11-12 12:08:13.376918","last_fullsized":"2020-11-12 12:08:13.376918","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":559,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25883952,"num_objects":13,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":118,"num_read_kb":136818,"num_write":164,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":322062895,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"2143","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148442","last_change":"2020-11-12 12:07:43.587052","last_active":"2020-11-12 12:08:13.148442","last_peered":"2020-11-12 12:08:13.148442","last_clean":"2020-11-12 12:08:13.148442","last_became_active":"2020-11-12 12:07:43.547557","last_became_peered":"2020-11-12 12:07:43.547557","last_unstale":"2020-11-12 12:08:13.148442","last_undegraded":"2020-11-12 12:08:13.148442","last_fullsized":"2020-11-12 12:08:13.148442","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"605'367","reported_seq":"3037","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567889","last_change":"2020-11-12 12:07:43.624765","last_active":"2020-11-12 12:08:12.567889","last_peered":"2020-11-12 12:08:12.567889","last_clean":"2020-11-12 12:08:12.567889","last_became_active":"2020-11-12 12:07:43.545290","last_became_peered":"2020-11-12 12:07:43.545290","last_unstale":"2020-11-12 12:08:12.567889","last_undegraded":"2020-11-12 12:08:12.567889","last_fullsized":"2020-11-12 12:08:12.567889","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17515677,"num_objects":8,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":106,"num_read_kb":144046,"num_write":108,"num_write_kb":25330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":222679804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565510144,"data_stored":709827531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":580,"seq":2491081031699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1110124,"kb_used_data":61540,"kb_used_omap":341,"kb_used_meta":1048234,"kb_avail":93261716,"statfs":{"total":96636764160,"available":95499997184,"internally_reserved":1073741824,"allocated":63016960,"data_stored":83410636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":349956,"internal_metadata":1073391868},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":7.3140000000000001,"5min":7.3140000000000001,"15min":7.3140000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":99.079999999999998,"5min":99.079999999999998,"15min":99.079999999999998},"last":2.25},{"interface":"front","average":{"1min":1.859,"5min":1.859,"15min":1.859},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":3.2839999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.198}]},{"osd":2,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":1.95,"15min":1.95},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":2.1339999999999999},{"interface":"front","average":{"1min":49.286000000000001,"5min":49.286000000000001,"15min":49.286000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":706.08500000000004,"5min":706.08500000000004,"15min":706.08500000000004},"last":2.2040000000000002}]},{"osd":3,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":8.4600000000000009,"5min":8.4600000000000009,"15min":8.4600000000000009},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":99.426000000000002,"5min":99.426000000000002,"15min":99.426000000000002},"last":2.851},{"interface":"front","average":{"1min":8.2059999999999995,"5min":8.2059999999999995,"15min":8.2059999999999995},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":98.793999999999997,"5min":98.793999999999997,"15min":98.793999999999997},"last":2.29}]},{"osd":4,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":2.101,"15min":2.101},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":3.3620000000000001},{"interface":"front","average":{"1min":8.1159999999999997,"5min":8.1159999999999997,"15min":8.1159999999999997},"min":{"1min":1.216,"5min":1.216,"15min":1.216},"max":{"1min":99.373000000000005,"5min":99.373000000000005,"15min":99.373000000000005},"last":2.7770000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":6,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":8.3239999999999998,"5min":8.3239999999999998,"15min":8.3239999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":99.757999999999996,"5min":99.757999999999996,"15min":99.757999999999996},"last":3.649},{"interface":"front","average":{"1min":8.1349999999999998,"5min":8.1349999999999998,"15min":8.1349999999999998},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":99.138999999999996,"5min":99.138999999999996,"15min":99.138999999999996},"last":2.6259999999999999}]}]},{"osd":6,"up_from":559,"seq":2400886718488,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118092,"kb_used_data":69508,"kb_used_omap":353,"kb_used_meta":1048222,"kb_avail":93253748,"statfs":{"total":96636764160,"available":95491837952,"internally_reserved":1073741824,"allocated":71176192,"data_stored":96297885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361858,"internal_metadata":1073379966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":19.876000000000001,"5min":19.876000000000001,"15min":19.876000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":348.53300000000002,"5min":348.53300000000002,"15min":348.53300000000002},"last":1.579},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.95}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8500000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.621},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":2.0350000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":1.877,"15min":1.877},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":2.8900000000000001},{"interface":"front","average":{"1min":1.982,"5min":1.982,"15min":1.982},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":2.6589999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":9.4610000000000003,"5min":9.4610000000000003,"15min":9.4610000000000003},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":85.281000000000006,"5min":85.281000000000006,"15min":85.281000000000006},"last":2.7679999999999998},{"interface":"front","average":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.909}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9300000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.448,"5min":2.448,"15min":2.448},"min":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":2.4900000000000002},{"interface":"front","average":{"1min":2.544,"5min":2.544,"15min":2.544},"min":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":3.1869999999999998}]}]},{"osd":5,"up_from":601,"seq":2581275344907,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1134676,"kb_used_data":86092,"kb_used_omap":333,"kb_used_meta":1048242,"kb_avail":93237164,"statfs":{"total":96636764160,"available":95474855936,"internally_reserved":1073741824,"allocated":88158208,"data_stored":123673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341564,"internal_metadata":1073400260},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.798}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.556}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":69.540999999999997}]}]},{"osd":4,"up_from":391,"seq":1679332212795,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1157624,"kb_used_data":109040,"kb_used_omap":102,"kb_used_meta":1048473,"kb_avail":93214216,"statfs":{"total":96636764160,"available":95451357184,"internally_reserved":1073741824,"allocated":111656960,"data_stored":107806845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104910,"internal_metadata":1073636914},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":10.739000000000001,"15min":5.0789999999999997},"min":{"1min":1.0109999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.5600000000000001,"5min":488.81999999999999,"15min":488.81999999999999},"last":1.9239999999999999},{"interface":"front","average":{"1min":78.942999999999998,"5min":17.462,"15min":7.1600000000000001},"min":{"1min":0.99399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":807.53499999999997,"5min":807.53499999999997,"15min":807.53499999999997},"last":2.1600000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:06:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":2.3820000000000001,"15min":2.3500000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.444,"5min":8.9039999999999999,"15min":8.9039999999999999},"last":1.982},{"interface":"front","average":{"1min":42.069000000000003,"5min":10.15,"15min":4.782},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":763.53800000000001,"5min":763.53800000000001,"15min":763.53800000000001},"last":2.085}]},{"osd":2,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.968,"5min":2.0760000000000001,"15min":2.0099999999999998},"min":{"1min":1.0129999999999999,"5min":0.752,"15min":0.752},"max":{"1min":3.1509999999999998,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.1600000000000001,"5min":14.77,"15min":25.498000000000001},"min":{"1min":1.5900000000000001,"5min":0.875,"15min":0.875},"max":{"1min":3.2549999999999999,"5min":514.11400000000003,"15min":514.11400000000003},"last":2.2309999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":29.265999999999998,"15min":48.031999999999996},"min":{"1min":1.1739999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.75,"5min":994.74000000000001,"15min":994.74000000000001},"last":2.4049999999999998},{"interface":"front","average":{"1min":2.2949999999999999,"5min":2.5470000000000002,"15min":2.3180000000000001},"min":{"1min":1.556,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.7400000000000002,"5min":39.203000000000003,"15min":39.203000000000003},"last":2.359}]},{"osd":5,"last update":"Thu Nov 12 12:06:50 2020","interfaces":[{"interface":"back","average":{"1min":2.266,"5min":31.542000000000002,"15min":44.463999999999999},"min":{"1min":1.1679999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5139999999999998,"5min":874.86199999999997,"15min":874.86199999999997},"last":2.2879999999999998},{"interface":"front","average":{"1min":2.3959999999999999,"5min":7.7599999999999998,"15min":4.1580000000000004},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.7750000000000004,"5min":566.75599999999997,"15min":566.75599999999997},"last":3.2709999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:07:39 2020","interfaces":[{"interface":"back","average":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":3.3239999999999998},{"interface":"front","average":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":3.4239999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:08:01 2020","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"max":{"1min":24.954000000000001,"5min":24.954000000000001,"15min":24.954000000000001},"last":3.3570000000000002},{"interface":"front","average":{"1min":38.518000000000001,"5min":38.518000000000001,"15min":38.518000000000001},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":699.61099999999999,"5min":699.61099999999999,"15min":699.61099999999999},"last":2.452}]}]},{"osd":0,"up_from":245,"seq":1052266987609,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1115620,"kb_used_data":67036,"kb_used_omap":106,"kb_used_meta":1048469,"kb_avail":93256220,"statfs":{"total":96636764160,"available":95494369280,"internally_reserved":1073741824,"allocated":68644864,"data_stored":89861077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108685,"internal_metadata":1073633139},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":41.598999999999997,"5min":9.7609999999999992,"15min":4.3330000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":672.25900000000001,"5min":672.25900000000001,"15min":672.25900000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":2.1259999999999999,"5min":2.3660000000000001,"15min":1.9890000000000001},"min":{"1min":0.70799999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.5830000000000002,"5min":53.067999999999998,"15min":53.067999999999998},"last":2.2559999999999998}]},{"osd":2,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.6459999999999999,"15min":6.4080000000000004},"min":{"1min":0.85599999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.6989999999999998,"5min":9.7680000000000007,"15min":452.94999999999999},"last":2.1589999999999998},{"interface":"front","average":{"1min":1.8360000000000001,"5min":8.6699999999999999,"15min":4.0919999999999996},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.7480000000000002,"5min":346.39299999999997,"15min":346.39299999999997},"last":1.593}]},{"osd":3,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":8.4309999999999992,"15min":4.3170000000000002},"min":{"1min":0.93700000000000006,"5min":0.875,"15min":0.875},"max":{"1min":3.8039999999999998,"5min":504.71600000000001,"15min":504.71600000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.992,"5min":1.962,"15min":2.1850000000000001},"min":{"1min":0.96499999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.9199999999999999,"5min":3.9910000000000001,"15min":4.9349999999999996},"last":2.694}]},{"osd":4,"last update":"Thu Nov 12 12:07:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.5699999999999998,"15min":2.653},"min":{"1min":1.5640000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.1230000000000002,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":2.52},{"interface":"front","average":{"1min":49.655000000000001,"5min":11.961,"15min":5.5970000000000004},"min":{"1min":1.365,"5min":1.155,"15min":1.155},"max":{"1min":688.81700000000001,"5min":688.81700000000001,"15min":688.81700000000001},"last":2.4630000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":2.3239999999999998,"5min":18.879999999999999,"15min":7.952},"min":{"1min":1.1140000000000001,"5min":0.995,"15min":0.995},"max":{"1min":3.6749999999999998,"5min":994.72000000000003,"15min":994.72000000000003},"last":2.5750000000000002},{"interface":"front","average":{"1min":2.4390000000000001,"5min":2.5939999999999999,"15min":2.7879999999999998},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":3.7999999999999998,"5min":6.2990000000000004,"15min":6.2990000000000004},"last":2.4199999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:07:38 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.919,"15min":1.919},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":2.4969999999999999},{"interface":"front","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":2.6099999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:08:05 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"min":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":2.8769999999999998},{"interface":"front","average":{"1min":2.794,"5min":2.794,"15min":2.794},"min":{"1min":1.899,"5min":1.899,"15min":1.899},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":2.899}]}]},{"osd":1,"up_from":596,"seq":2559800508428,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102500,"kb_used_data":53916,"kb_used_omap":259,"kb_used_meta":1048316,"kb_avail":93269340,"statfs":{"total":96636764160,"available":95507804160,"internally_reserved":1073741824,"allocated":55209984,"data_stored":58313765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265441,"internal_metadata":1073476383},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3530000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4489999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118312,"kb_used_data":69728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253528,"statfs":{"total":96636764160,"available":95491612672,"internally_reserved":1073741824,"allocated":71401472,"data_stored":92861124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:31 2020","interfaces":[{"interface":"back","average":{"1min":26.920000000000002,"5min":6.9329999999999998,"15min":3.4769999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":502.202,"5min":502.202,"15min":502.202},"last":2.6789999999999998},{"interface":"front","average":{"1min":26.835999999999999,"5min":17.888999999999999,"15min":7.0039999999999996},"min":{"1min":1.0369999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":502.17099999999999,"5min":991.13400000000001,"15min":991.13400000000001},"last":2.5390000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:07:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4329999999999998,"5min":16.178999999999998,"15min":16.425000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.745},"max":{"1min":7.3559999999999999,"5min":942.04200000000003,"15min":942.04200000000003},"last":1.536},{"interface":"front","average":{"1min":2.016,"5min":1.982,"15min":2.6589999999999998},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.8550000000000004,"5min":4.8550000000000004,"15min":24.553999999999998},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:08:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9019999999999999,"5min":7.8150000000000004,"15min":4.5190000000000001},"min":{"1min":0.91600000000000004,"5min":0.628,"15min":0.628},"max":{"1min":5.6379999999999999,"5min":542.86500000000001,"15min":542.86500000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":5.9299999999999997,"5min":20.946000000000002,"15min":12.846},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.68500000000000005},"max":{"1min":84.096999999999994,"5min":891.42700000000002,"15min":952.51499999999999},"last":2.2229999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:07:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.125,"15min":2.0569999999999999},"min":{"1min":1.3939999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":3.5960000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":2.6059999999999999},{"interface":"front","average":{"1min":2.1539999999999999,"5min":2.3159999999999998,"15min":2.4199999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":4.46,"5min":4.907,"15min":4.907},"last":2.1890000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:06:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":12.215999999999999,"15min":13.023},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":5.202,"5min":505.05900000000003,"15min":694.89999999999998},"last":2.2850000000000001},{"interface":"front","average":{"1min":2.5419999999999998,"5min":2.5870000000000002,"15min":3.2709999999999999},"min":{"1min":1.2130000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":4.1710000000000003,"5min":4.9569999999999999,"15min":25.744},"last":2.0310000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":2.339,"15min":2.339},"min":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"max":{"1min":4.673,"5min":4.673,"15min":4.673},"last":3.234},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":2.069}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"min":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":3.1909999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":2.4750000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":97589153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":12.253,"15min":5.5800000000000001},"min":{"1min":0.90800000000000003,"5min":0.64400000000000002,"15min":0.63900000000000001},"max":{"1min":3.6949999999999998,"5min":878.05899999999997,"15min":878.05899999999997},"last":2.0350000000000001},{"interface":"front","average":{"1min":2.1299999999999999,"5min":5.484,"15min":3.1499999999999999},"min":{"1min":1.0329999999999999,"5min":0.745,"15min":0.745},"max":{"1min":3.7719999999999998,"5min":366.03699999999998,"15min":366.03699999999998},"last":1.982}]},{"osd":1,"last update":"Thu Nov 12 12:06:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":9.7279999999999998,"15min":4.3680000000000003},"min":{"1min":0.96399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.472,"5min":718.05899999999997,"15min":718.05899999999997},"last":1.526},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.8620000000000001,"15min":2.1219999999999999},"min":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.68500000000000005},"max":{"1min":2.7839999999999998,"5min":4.2690000000000001,"15min":5.125},"last":2.2120000000000002}]},{"osd":2,"last update":"Thu Nov 12 12:07:54 2020","interfaces":[{"interface":"back","average":{"1min":2.3490000000000002,"5min":2.4500000000000002,"15min":3.2210000000000001},"min":{"1min":1.206,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.0379999999999998,"5min":12.622,"15min":203.68299999999999},"last":2.0939999999999999},{"interface":"front","average":{"1min":1.887,"5min":10.071999999999999,"15min":5.2080000000000002},"min":{"1min":0.91700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.863,"5min":513.51400000000001,"15min":513.51400000000001},"last":2.278}]},{"osd":4,"last update":"Thu Nov 12 12:07:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9219999999999999,"5min":13.967000000000001,"15min":25.974},"min":{"1min":1.1719999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.9350000000000001,"5min":661.80200000000002,"15min":661.80200000000002},"last":2.6309999999999998},{"interface":"front","average":{"1min":2.5,"5min":8.5939999999999994,"15min":14.772},"min":{"1min":1.2669999999999999,"5min":1.028,"15min":1.028},"max":{"1min":3.7669999999999999,"5min":341.209,"15min":341.209},"last":3.1070000000000002}]},{"osd":5,"last update":"Thu Nov 12 12:05:53 2020","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":2.4220000000000002,"15min":13.692},"min":{"1min":1.1699999999999999,"5min":1.044,"15min":1.044},"max":{"1min":3.7330000000000001,"5min":4.4539999999999997,"15min":626.23000000000002},"last":3.048},{"interface":"front","average":{"1min":2.2690000000000001,"5min":2.415,"15min":2.456},"min":{"1min":1.2330000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":3.8279999999999998,"5min":5.2599999999999998,"15min":5.9889999999999999},"last":2.077}]},{"osd":6,"last update":"Thu Nov 12 12:07:41 2020","interfaces":[{"interface":"back","average":{"1min":54.368000000000002,"5min":54.368000000000002,"15min":54.368000000000002},"min":{"1min":1.375,"5min":1.375,"15min":1.375},"max":{"1min":941.26800000000003,"5min":941.26800000000003,"15min":941.26800000000003},"last":3.008},{"interface":"front","average":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"min":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":3.024}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.673,"5min":2.673,"15min":2.673},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":2.8149999999999999},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"min":{"1min":1.728,"5min":1.728,"15min":1.728},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":2.8330000000000002}]}]}]}} Ignoring malparsed backtrace: 2020-11-12T12:08:40.601 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:40.602 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:40.602 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:10:02.981 7eff326d9700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:10:03.071 7eff326d9700 -1 WARNING: all dangerous and experimental features are enabled. , dumped all Ignoring malparsed backtrace: 2020-11-12T12:11:05.469 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:07:05.341782 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:05.469 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:05.470 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:11:18.897 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b , 2020-11-12 12:11:19.117 7f70b391a700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:11:19.197 7f70b391a700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:12:22.846 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:22.846 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-11-12T12:12:42.848 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json Ignoring malparsed backtrace: 2020-11-12 12:13:26.563 7f57dd282700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 1.7 on osd.1 to deep-scrub , 2020-11-12T12:13:26.862 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.4 Ignoring malparsed backtrace: 2020-11-12T12:14:01.024 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:01.025 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-12 12:07:44.529241 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=44, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:01.025 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:15:03.154 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:15:03.154 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:15:03.155 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:15:50.647 7f0048e4a700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:15:50.764 7f0048e4a700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.7s0 on osd.3 to deep-scrub Ignoring malparsed backtrace: 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:07:05.341782 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:17:43.327 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:43.328 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:43.328 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:18:14.146 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.0 , 2020-11-12 12:18:14.382 7fef50eef700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:18:14.479 7fef4b59e700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:19:21.510 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-12 12:06:50.045143 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:19:21.511 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:19:21.511 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-12 12:07:07.510477 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=7, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:20:23.654 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:23.655 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:23.655 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:20:38.083 7f5cd22b7700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.cs0 on osd.6 to deep-scrub , 2020-11-12T12:20:38.408 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.d Ignoring malparsed backtrace: 2020-11-12T12:22:01.408 INFO:teuthology.orchestra.run.smithi044.stdout: , 2020-11-12T12:22:01.424 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1381,"stamp":"2020-11-12 12:22:00.849563","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":9000640,"kb_used_data":611968,"kb_used_omap":1496,"kb_used_meta":8387111,"kb_avail":745974080,"statfs":{"total":773094113280,"available":763877457920,"internally_reserved":8589934592,"allocated":626655232,"data_stored":749813723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1532414,"internal_metadata":8588402178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004045"},"pg_stats":[{"pgid":"2.f","version":"605'975","reported_seq":"5179","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.048094","last_change":"2020-11-12 12:07:44.339133","last_active":"2020-11-12 12:08:13.048094","last_peered":"2020-11-12 12:08:13.048094","last_clean":"2020-11-12 12:08:13.048094","last_became_active":"2020-11-12 12:07:43.542344","last_became_peered":"2020-11-12 12:07:43.542344","last_unstale":"2020-11-12 12:08:13.048094","last_undegraded":"2020-11-12 12:08:13.048094","last_fullsized":"2020-11-12 12:08:13.048094","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":975,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":36964515,"num_objects":22,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":222,"num_read_kb":276029,"num_write":279,"num_write_kb":64344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":676764753,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"606'755","reported_seq":"3298","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053607","last_change":"2020-11-12 12:07:45.720783","last_active":"2020-11-12 12:08:13.053607","last_peered":"2020-11-12 12:08:13.053607","last_clean":"2020-11-12 12:08:13.053607","last_became_active":"2020-11-12 12:07:44.559898","last_became_peered":"2020-11-12 12:07:44.559898","last_unstale":"2020-11-12 12:08:13.053607","last_undegraded":"2020-11-12 12:08:13.053607","last_fullsized":"2020-11-12 12:08:13.053607","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":44542027,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":142,"num_read_kb":168636,"num_write":206,"num_write_kb":48990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":220359844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"126","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.561197","last_change":"2020-11-12 12:07:34.980292","last_active":"2020-11-12 12:08:12.561197","last_peered":"2020-11-12 12:08:12.561197","last_clean":"2020-11-12 12:08:12.561197","last_became_active":"2020-11-12 12:07:34.979587","last_became_peered":"2020-11-12 12:07:34.979587","last_unstale":"2020-11-12 12:08:12.561197","last_undegraded":"2020-11-12 12:08:12.561197","last_fullsized":"2020-11-12 12:08:12.561197","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:50.045143","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:01:01.411425","last_clean_scrub_stamp":"2020-11-12 12:06:50.045143","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"607'1034","reported_seq":"4531","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567601","last_change":"2020-11-12 12:07:45.706465","last_active":"2020-11-12 12:08:12.567601","last_peered":"2020-11-12 12:08:12.567601","last_clean":"2020-11-12 12:08:12.567601","last_became_active":"2020-11-12 12:07:45.566064","last_became_peered":"2020-11-12 12:07:45.566064","last_unstale":"2020-11-12 12:08:12.567601","last_undegraded":"2020-11-12 12:08:12.567601","last_fullsized":"2020-11-12 12:08:12.567601","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":1034,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63069801,"num_objects":33,"num_object_clones":27,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":227,"num_read_kb":245644,"num_write":327,"num_write_kb":79050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":626,"num_bytes_recovered":710613985,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376795","last_change":"2020-11-12 12:07:07.510609","last_active":"2020-11-12 12:08:13.376795","last_peered":"2020-11-12 12:08:13.376795","last_clean":"2020-11-12 12:08:13.376795","last_became_active":"2020-11-12 12:06:38.531854","last_became_peered":"2020-11-12 12:06:38.531854","last_unstale":"2020-11-12 12:08:13.376795","last_undegraded":"2020-11-12 12:08:13.376795","last_fullsized":"2020-11-12 12:08:13.376795","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:07.510477","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:07:07.510477","last_clean_scrub_stamp":"2020-11-12 12:07:07.510477","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"605'571","reported_seq":"3045","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376977","last_change":"2020-11-12 12:07:44.295346","last_active":"2020-11-12 12:08:13.376977","last_peered":"2020-11-12 12:08:13.376977","last_clean":"2020-11-12 12:08:13.376977","last_became_active":"2020-11-12 12:07:43.546299","last_became_peered":"2020-11-12 12:07:43.546299","last_unstale":"2020-11-12 12:08:13.376977","last_undegraded":"2020-11-12 12:08:13.376977","last_fullsized":"2020-11-12 12:08:13.376977","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":571,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41575305,"num_objects":15,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":110,"num_read_kb":112384,"num_write":178,"num_write_kb":39453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":214562650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"631","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047347","last_change":"2020-11-12 12:07:05.341895","last_active":"2020-11-12 12:08:13.047347","last_peered":"2020-11-12 12:08:13.047347","last_clean":"2020-11-12 12:08:13.047347","last_became_active":"2020-11-12 12:06:37.605758","last_became_peered":"2020-11-12 12:06:37.605758","last_unstale":"2020-11-12 12:08:13.047347","last_undegraded":"2020-11-12 12:08:13.047347","last_fullsized":"2020-11-12 12:08:13.047347","mapping_epoch":559,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":560,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:05.341782","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:05.341782","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"605'852","reported_seq":"3625","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053157","last_change":"2020-11-12 12:07:43.726533","last_active":"2020-11-12 12:08:13.053157","last_peered":"2020-11-12 12:08:13.053157","last_clean":"2020-11-12 12:08:13.053157","last_became_active":"2020-11-12 12:07:43.552867","last_became_peered":"2020-11-12 12:07:43.552867","last_unstale":"2020-11-12 12:08:13.053157","last_undegraded":"2020-11-12 12:08:13.053157","last_fullsized":"2020-11-12 12:08:13.053157","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":852,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40651861,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":176,"num_read_kb":237784,"num_write":229,"num_write_kb":51463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":336631858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"441","reported_epoch":"620","state":"active+clean","last_fresh":"2020-11-12 12:20:44.645575","last_change":"2020-11-12 12:20:44.645681","last_active":"2020-11-12 12:20:44.645575","last_peered":"2020-11-12 12:20:44.645575","last_clean":"2020-11-12 12:20:44.645575","last_became_active":"2020-11-12 12:07:02.730087","last_became_peered":"2020-11-12 12:07:02.730087","last_unstale":"2020-11-12 12:20:44.645575","last_undegraded":"2020-11-12 12:20:44.645575","last_fullsized":"2020-11-12 12:20:44.645575","mapping_epoch":580,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:20:44.645547","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:20:44.645547","last_clean_scrub_stamp":"2020-11-12 12:20:44.645547","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"605'787","reported_seq":"3194","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376911","last_change":"2020-11-12 12:07:43.680183","last_active":"2020-11-12 12:08:13.376911","last_peered":"2020-11-12 12:08:13.376911","last_clean":"2020-11-12 12:08:13.376911","last_became_active":"2020-11-12 12:07:43.540815","last_became_peered":"2020-11-12 12:07:43.540815","last_unstale":"2020-11-12 12:08:13.376911","last_undegraded":"2020-11-12 12:08:13.376911","last_fullsized":"2020-11-12 12:08:13.376911","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":787,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43160093,"num_objects":20,"num_object_clones":17,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":133,"num_read_kb":120761,"num_write":220,"num_write_kb":54232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":209150928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"134","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.560847","last_change":"2020-11-12 12:07:44.529416","last_active":"2020-11-12 12:08:12.560847","last_peered":"2020-11-12 12:08:12.560847","last_clean":"2020-11-12 12:08:12.560847","last_became_active":"2020-11-12 12:07:40.996832","last_became_peered":"2020-11-12 12:07:40.996832","last_unstale":"2020-11-12 12:08:12.560847","last_undegraded":"2020-11-12 12:08:12.560847","last_fullsized":"2020-11-12 12:08:12.560847","mapping_epoch":601,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":602,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:44.529241","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:44.529241","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"607'461","reported_seq":"3496","reported_epoch":"619","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:08:13.376948","last_change":"2020-11-12 12:07:48.505159","last_active":"2020-11-12 12:08:13.376948","last_peered":"2020-11-12 12:08:13.376948","last_clean":"2020-11-12 12:08:13.376948","last_became_active":"2020-11-12 12:07:45.558646","last_became_peered":"2020-11-12 12:07:45.558646","last_unstale":"2020-11-12 12:08:13.376948","last_undegraded":"2020-11-12 12:08:13.376948","last_fullsized":"2020-11-12 12:08:13.376948","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":461,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22082484,"num_objects":10,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":79,"num_read_kb":73364,"num_write":120,"num_write_kb":28596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":226411123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376678","last_change":"2020-11-12 12:07:14.479425","last_active":"2020-11-12 12:08:13.376678","last_peered":"2020-11-12 12:08:13.376678","last_clean":"2020-11-12 12:08:13.376678","last_became_active":"2020-11-12 12:06:38.526587","last_became_peered":"2020-11-12 12:06:38.526587","last_unstale":"2020-11-12 12:08:13.376678","last_undegraded":"2020-11-12 12:08:13.376678","last_fullsized":"2020-11-12 12:08:13.376678","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:14.479334","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:14.479334","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"605'236","reported_seq":"2602","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376934","last_change":"2020-11-12 12:07:43.679033","last_active":"2020-11-12 12:08:13.376934","last_peered":"2020-11-12 12:08:13.376934","last_clean":"2020-11-12 12:08:13.376934","last_became_active":"2020-11-12 12:07:43.544179","last_became_peered":"2020-11-12 12:07:43.544179","last_unstale":"2020-11-12 12:08:13.376934","last_undegraded":"2020-11-12 12:08:13.376934","last_fullsized":"2020-11-12 12:08:13.376934","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":236,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8892018,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":52270,"num_write":58,"num_write_kb":14437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":101718835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"605'185","reported_seq":"2708","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566247","last_change":"2020-11-12 12:07:43.627236","last_active":"2020-11-12 12:08:12.566247","last_peered":"2020-11-12 12:08:12.566247","last_clean":"2020-11-12 12:08:12.566247","last_became_active":"2020-11-12 12:07:43.549723","last_became_peered":"2020-11-12 12:07:43.549723","last_unstale":"2020-11-12 12:08:12.566247","last_undegraded":"2020-11-12 12:08:12.566247","last_fullsized":"2020-11-12 12:08:12.566247","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5743030,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":84824,"num_write":57,"num_write_kb":16290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":83699520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"242","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047777","last_change":"2020-11-12 12:07:26.910728","last_active":"2020-11-12 12:08:13.047777","last_peered":"2020-11-12 12:08:13.047777","last_clean":"2020-11-12 12:08:13.047777","last_became_active":"2020-11-12 12:07:26.910195","last_became_peered":"2020-11-12 12:07:26.910195","last_unstale":"2020-11-12 12:08:13.047777","last_undegraded":"2020-11-12 12:08:13.047777","last_fullsized":"2020-11-12 12:08:13.047777","mapping_epoch":591,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":592,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:29.446679","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:06:29.446679","last_clean_scrub_stamp":"2020-11-12 12:06:29.446679","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"606'930","reported_seq":"3709","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376799","last_change":"2020-11-12 12:07:45.132173","last_active":"2020-11-12 12:08:13.376799","last_peered":"2020-11-12 12:08:13.376799","last_clean":"2020-11-12 12:08:13.376799","last_became_active":"2020-11-12 12:07:44.583667","last_became_peered":"2020-11-12 12:07:44.583667","last_unstale":"2020-11-12 12:08:13.376799","last_undegraded":"2020-11-12 12:08:13.376799","last_fullsized":"2020-11-12 12:08:13.376799","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":930,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33313503,"num_objects":17,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":256,"num_read_kb":367173,"num_write":237,"num_write_kb":57709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":350399398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"46","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053762","last_change":"2020-11-12 12:07:35.980717","last_active":"2020-11-12 12:08:13.053762","last_peered":"2020-11-12 12:08:13.053762","last_clean":"2020-11-12 12:08:13.053762","last_became_active":"2020-11-12 12:07:35.977675","last_became_peered":"2020-11-12 12:07:35.977675","last_unstale":"2020-11-12 12:08:13.053762","last_undegraded":"2020-11-12 12:08:13.053762","last_fullsized":"2020-11-12 12:08:13.053762","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:28.871630","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:06:28.871630","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"606'846","reported_seq":"4089","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.046782","last_change":"2020-11-12 12:07:44.693996","last_active":"2020-11-12 12:08:13.046782","last_peered":"2020-11-12 12:08:13.046782","last_clean":"2020-11-12 12:08:13.046782","last_became_active":"2020-11-12 12:07:44.564657","last_became_peered":"2020-11-12 12:07:44.564657","last_unstale":"2020-11-12 12:08:13.046782","last_undegraded":"2020-11-12 12:08:13.046782","last_fullsized":"2020-11-12 12:08:13.046782","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46543737,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":151,"num_read_kb":169538,"num_write":238,"num_write_kb":60205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":496256418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"605'674","reported_seq":"3005","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053321","last_change":"2020-11-12 12:07:43.712637","last_active":"2020-11-12 12:08:13.053321","last_peered":"2020-11-12 12:08:13.053321","last_clean":"2020-11-12 12:08:13.053321","last_became_active":"2020-11-12 12:07:43.548419","last_became_peered":"2020-11-12 12:07:43.548419","last_unstale":"2020-11-12 12:08:13.053321","last_undegraded":"2020-11-12 12:08:13.053321","last_fullsized":"2020-11-12 12:08:13.053321","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":674,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38169296,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":114,"num_read_kb":131891,"num_write":165,"num_write_kb":37225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":225335475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"607'796","reported_seq":"4267","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148284","last_change":"2020-11-12 12:07:46.152581","last_active":"2020-11-12 12:08:13.148284","last_peered":"2020-11-12 12:08:13.148284","last_clean":"2020-11-12 12:08:13.148284","last_became_active":"2020-11-12 12:07:46.028375","last_became_peered":"2020-11-12 12:07:46.028375","last_unstale":"2020-11-12 12:08:13.148284","last_undegraded":"2020-11-12 12:08:13.148284","last_fullsized":"2020-11-12 12:08:13.148284","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27857526,"num_objects":19,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":183,"num_read_kb":219470,"num_write":240,"num_write_kb":56199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":578,"num_bytes_recovered":558493168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"607'559","reported_seq":"3316","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376918","last_change":"2020-11-12 12:07:45.654658","last_active":"2020-11-12 12:08:13.376918","last_peered":"2020-11-12 12:08:13.376918","last_clean":"2020-11-12 12:08:13.376918","last_became_active":"2020-11-12 12:07:45.564480","last_became_peered":"2020-11-12 12:07:45.564480","last_unstale":"2020-11-12 12:08:13.376918","last_undegraded":"2020-11-12 12:08:13.376918","last_fullsized":"2020-11-12 12:08:13.376918","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":559,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25883952,"num_objects":13,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":118,"num_read_kb":136818,"num_write":164,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":322062895,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"2143","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148442","last_change":"2020-11-12 12:07:43.587052","last_active":"2020-11-12 12:08:13.148442","last_peered":"2020-11-12 12:08:13.148442","last_clean":"2020-11-12 12:08:13.148442","last_became_active":"2020-11-12 12:07:43.547557","last_became_peered":"2020-11-12 12:07:43.547557","last_unstale":"2020-11-12 12:08:13.148442","last_undegraded":"2020-11-12 12:08:13.148442","last_fullsized":"2020-11-12 12:08:13.148442","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"605'367","reported_seq":"3037","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567889","last_change":"2020-11-12 12:07:43.624765","last_active":"2020-11-12 12:08:12.567889","last_peered":"2020-11-12 12:08:12.567889","last_clean":"2020-11-12 12:08:12.567889","last_became_active":"2020-11-12 12:07:43.545290","last_became_peered":"2020-11-12 12:07:43.545290","last_unstale":"2020-11-12 12:08:12.567889","last_undegraded":"2020-11-12 12:08:12.567889","last_fullsized":"2020-11-12 12:08:12.567889","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17515677,"num_objects":8,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":106,"num_read_kb":144046,"num_write":108,"num_write_kb":25330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":222679804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565510144,"data_stored":709827531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":580,"seq":2491081031861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1110124,"kb_used_data":61540,"kb_used_omap":341,"kb_used_meta":1048234,"kb_avail":93261716,"statfs":{"total":96636764160,"available":95499997184,"internally_reserved":1073741824,"allocated":63016960,"data_stored":83410636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":349956,"internal_metadata":1073391868},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.0960000000000001,"5min":3.028,"15min":5.2709999999999999},"min":{"1min":1.4390000000000001,"5min":1.2649999999999999,"15min":0.77200000000000002},"max":{"1min":2.8799999999999999,"5min":80.197000000000003,"15min":578.29399999999998},"last":1.6950000000000001},{"interface":"front","average":{"1min":2.3370000000000002,"5min":2.5019999999999998,"15min":7.5540000000000003},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":0.66800000000000004},"max":{"1min":3.4900000000000002,"5min":5.1509999999999998,"15min":794.80100000000004},"last":1.79}]},{"osd":1,"last update":"Thu Nov 12 12:21:04 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":15.01,"15min":6.7469999999999999},"min":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":0.64200000000000002},"max":{"1min":2.9689999999999999,"5min":963.428,"15min":963.428},"last":3.3359999999999999},{"interface":"front","average":{"1min":3.8479999999999999,"5min":8.9949999999999992,"15min":5.2290000000000001},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":0.69899999999999995},"max":{"1min":24.513999999999999,"5min":503.04300000000001,"15min":503.04300000000001},"last":2.0299999999999998}]},{"osd":2,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.839,"5min":2.952,"15min":5.7800000000000002},"min":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":0.77600000000000002},"max":{"1min":3.6829999999999998,"5min":5.2009999999999996,"15min":514.13499999999999},"last":2.5739999999999998},{"interface":"front","average":{"1min":3.004,"5min":3.0609999999999999,"15min":9.1950000000000003},"min":{"1min":2.4510000000000001,"5min":2.2909999999999999,"15min":0.75800000000000001},"max":{"1min":3.7160000000000002,"5min":5.2409999999999997,"15min":706.08500000000004},"last":2.6070000000000002}]},{"osd":3,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.714,"5min":2.7290000000000001,"15min":4.5330000000000004},"min":{"1min":1.782,"5min":1.6100000000000001,"15min":1.1930000000000001},"max":{"1min":3.238,"5min":4.7190000000000003,"15min":198.44300000000001},"last":3.3980000000000001},{"interface":"front","average":{"1min":2.8029999999999999,"5min":8.2970000000000006,"15min":9.8409999999999993},"min":{"1min":1.819,"5min":1.776,"15min":1.272},"max":{"1min":3.3149999999999999,"5min":270.86700000000002,"15min":995.274},"last":3.4489999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.8050000000000002,"5min":2.7730000000000001,"15min":2.669},"min":{"1min":1.55,"5min":1.55,"15min":0.83199999999999996},"max":{"1min":3.617,"5min":4.3520000000000003,"15min":4.9290000000000003},"last":2.0859999999999999},{"interface":"front","average":{"1min":2.9700000000000002,"5min":10.747999999999999,"15min":9.5129999999999999},"min":{"1min":1.964,"5min":1.871,"15min":1.216},"max":{"1min":3.7970000000000002,"5min":494.08800000000002,"15min":893.58399999999995},"last":2.649}]},{"osd":5,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6640000000000001,"5min":8.7230000000000008,"15min":5.6319999999999997},"min":{"1min":1.722,"5min":1.722,"15min":0.996},"max":{"1min":3.2280000000000002,"5min":781.50199999999995,"15min":781.50199999999995},"last":3.1970000000000001},{"interface":"front","average":{"1min":3.1309999999999998,"5min":3.1619999999999999,"15min":11.958},"min":{"1min":2.4740000000000002,"5min":2.2189999999999999,"15min":1.4490000000000001},"max":{"1min":3.9500000000000002,"5min":5.282,"15min":946.62800000000004},"last":2.867}]},{"osd":6,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":53.386000000000003,"5min":20.541,"15min":9.2829999999999995},"min":{"1min":1.7629999999999999,"5min":1.542,"15min":1.02},"max":{"1min":771.18399999999997,"5min":771.18399999999997,"15min":771.18399999999997},"last":1.75},{"interface":"front","average":{"1min":2.9300000000000002,"5min":2.9390000000000001,"15min":3.6320000000000001},"min":{"1min":2.3799999999999999,"5min":1.9079999999999999,"15min":1.2569999999999999},"max":{"1min":3.4060000000000001,"5min":4.75,"15min":99.138999999999996},"last":3.2690000000000001}]}]},{"osd":6,"up_from":559,"seq":2400886718650,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118092,"kb_used_data":69508,"kb_used_omap":353,"kb_used_meta":1048222,"kb_avail":93253748,"statfs":{"total":96636764160,"available":95491837952,"internally_reserved":1073741824,"allocated":71176192,"data_stored":96297885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361858,"internal_metadata":1073379966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":4.9470000000000001,"15min":10.51},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.74099999999999999},"max":{"1min":3.0569999999999999,"5min":322.50999999999999,"15min":779.93200000000002},"last":2.5569999999999999},{"interface":"front","average":{"1min":9.2080000000000002,"5min":16.710999999999999,"15min":8.6549999999999994},"min":{"1min":1.218,"5min":1.218,"15min":0.996},"max":{"1min":169.53100000000001,"5min":757.51700000000005,"15min":757.51700000000005},"last":1.7629999999999999}]},{"osd":1,"last update":"Thu Nov 12 12:21:15 2020","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":4.9569999999999999,"15min":9.5760000000000005},"min":{"1min":1.7070000000000001,"5min":1.6160000000000001,"15min":1.327},"max":{"1min":2.964,"5min":308.35899999999998,"15min":892.83299999999997},"last":2.177},{"interface":"front","average":{"1min":2.7250000000000001,"5min":2.6640000000000001,"15min":5.9859999999999998},"min":{"1min":1.6539999999999999,"5min":1.573,"15min":1.0800000000000001},"max":{"1min":3.2959999999999998,"5min":3.609,"15min":855.77499999999998},"last":2.327}]},{"osd":2,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":30.806999999999999,"5min":12.675000000000001,"15min":9.7360000000000007},"min":{"1min":1.45,"5min":1.1799999999999999,"15min":0.76600000000000001},"max":{"1min":503.40800000000002,"5min":503.40800000000002,"15min":954.77599999999995},"last":1.7},{"interface":"front","average":{"1min":23.172000000000001,"5min":8.7880000000000003,"15min":5.3780000000000001},"min":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":0.92800000000000005},"max":{"1min":502.86900000000003,"5min":502.86900000000003,"15min":502.86900000000003},"last":1.8260000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":11.449999999999999,"15min":7.1360000000000001},"min":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.139},"max":{"1min":3.403,"5min":502.762,"15min":502.762},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.7090000000000001,"5min":2.621,"15min":5.2380000000000004},"min":{"1min":1.6000000000000001,"5min":1.4930000000000001,"15min":0.873},"max":{"1min":3.4889999999999999,"5min":3.569,"15min":857.01900000000001},"last":1.9039999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.367,"5min":8.2059999999999995,"15min":13.836},"min":{"1min":1.609,"5min":1.609,"15min":0.86899999999999999},"max":{"1min":3.4510000000000001,"5min":483.43799999999999,"15min":981.596},"last":3.2759999999999998},{"interface":"front","average":{"1min":2.7919999999999998,"5min":2.6640000000000001,"15min":2.5619999999999998},"min":{"1min":2.02,"5min":1.476,"15min":0.80800000000000005},"max":{"1min":3.2269999999999999,"5min":3.5369999999999999,"15min":4.7519999999999998},"last":1.9630000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":30.065000000000001,"5min":8.4640000000000004,"15min":4.7699999999999996},"min":{"1min":2.2440000000000002,"5min":2.1150000000000002,"15min":1.2889999999999999},"max":{"1min":626.11800000000005,"5min":626.11800000000005,"15min":626.11800000000005},"last":2.6949999999999998},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.036,"15min":5.0570000000000004},"min":{"1min":2.3330000000000002,"5min":2.0979999999999999,"15min":1.4750000000000001},"max":{"1min":3.6930000000000001,"5min":4.1029999999999998,"15min":190.36000000000001},"last":2.633}]},{"osd":7,"last update":"Thu Nov 12 12:21:25 2020","interfaces":[{"interface":"back","average":{"1min":44.843000000000004,"5min":19.739000000000001,"15min":8.3789999999999996},"min":{"1min":2.028,"5min":1.8340000000000001,"15min":1.5069999999999999},"max":{"1min":886.11500000000001,"5min":886.11500000000001,"15min":886.11500000000001},"last":3.3290000000000002},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.75,"15min":4.4379999999999997},"min":{"1min":2.1880000000000002,"5min":1.8819999999999999,"15min":1.282},"max":{"1min":3.4910000000000001,"5min":3.7360000000000002,"15min":403.28500000000003},"last":3.198}]}]},{"osd":5,"up_from":601,"seq":2581275345072,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1134676,"kb_used_data":86092,"kb_used_omap":333,"kb_used_meta":1048242,"kb_avail":93237164,"statfs":{"total":96636764160,"available":95474855936,"internally_reserved":1073741824,"allocated":88158208,"data_stored":123673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341564,"internal_metadata":1073400260},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":71.390000000000001,"5min":18.588000000000001,"15min":10.76},"min":{"1min":1.2250000000000001,"5min":1.0269999999999999,"15min":0.92300000000000004},"max":{"1min":949.11800000000005,"5min":949.11800000000005,"15min":949.11800000000005},"last":1.306},{"interface":"front","average":{"1min":10.993,"5min":3.9060000000000001,"15min":4.9370000000000003},"min":{"1min":1.296,"5min":1.264,"15min":1.115},"max":{"1min":150.06700000000001,"5min":150.06700000000001,"15min":680.75099999999998},"last":4.3140000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.1930000000000001,"5min":2.238,"15min":4.7930000000000001},"min":{"1min":1.3120000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"max":{"1min":3.2189999999999999,"5min":3.633,"15min":768.50300000000004},"last":2.5699999999999998},{"interface":"front","average":{"1min":59.518000000000001,"5min":13.85,"15min":7.0039999999999996},"min":{"1min":1.357,"5min":1.258,"15min":1.258},"max":{"1min":864.66999999999996,"5min":864.66999999999996,"15min":864.66999999999996},"last":2.4430000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.4529999999999998,"5min":7.9770000000000003,"15min":6.8780000000000001},"min":{"1min":1.7190000000000001,"5min":1.5660000000000001,"15min":1.167},"max":{"1min":3.2789999999999999,"5min":483.91899999999998,"15min":502.81400000000002},"last":2.9449999999999998},{"interface":"front","average":{"1min":2.6299999999999999,"5min":4.915,"15min":4.9050000000000002},"min":{"1min":1.956,"5min":1.772,"15min":1.3129999999999999},"max":{"1min":3.2599999999999998,"5min":276.31599999999997,"15min":503.221},"last":4.4119999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":2.536,"15min":8.5790000000000006},"min":{"1min":1.8939999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"max":{"1min":3.3029999999999999,"5min":3.7879999999999998,"15min":852.14400000000001},"last":2.6480000000000001},{"interface":"front","average":{"1min":2.427,"5min":2.496,"15min":6.5019999999999998},"min":{"1min":1.7909999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.1259999999999999,"5min":3.4279999999999999,"15min":800.87099999999998},"last":4.4500000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.629,"15min":6.673},"min":{"1min":1.78,"5min":1.5840000000000001,"15min":1.5840000000000001},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":964.16600000000005},"last":2.5179999999999998},{"interface":"front","average":{"1min":2.5350000000000001,"5min":19.498000000000001,"15min":14.134},"min":{"1min":1.4690000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"max":{"1min":3.198,"5min":947.64800000000002,"15min":947.64800000000002},"last":4.3719999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6920000000000002,"5min":2.6480000000000001,"15min":3.4140000000000001},"min":{"1min":1.831,"5min":1.669,"15min":1.385},"max":{"1min":3.3420000000000001,"5min":3.7949999999999999,"15min":191.37799999999999},"last":2.8780000000000001},{"interface":"front","average":{"1min":2.8140000000000001,"5min":2.8410000000000002,"15min":6.3970000000000002},"min":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":1.758},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":618.96500000000003},"last":3.0830000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":6.1639999999999997,"15min":20.687999999999999},"min":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.508},"max":{"1min":3.79,"5min":403.16699999999997,"15min":973.43899999999996},"last":2.6459999999999999},{"interface":"front","average":{"1min":2.976,"5min":13.462,"15min":11.574999999999999},"min":{"1min":2.5539999999999998,"5min":2.1389999999999998,"15min":1.663},"max":{"1min":3.6459999999999999,"5min":902.87900000000002,"15min":902.87900000000002},"last":2.29}]}]},{"osd":4,"up_from":391,"seq":1679332212959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1157624,"kb_used_data":109040,"kb_used_omap":102,"kb_used_meta":1048473,"kb_avail":93214216,"statfs":{"total":96636764160,"available":95451357184,"internally_reserved":1073741824,"allocated":111656960,"data_stored":107806845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104910,"internal_metadata":1073636914},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.0659999999999998,"5min":12.178000000000001,"15min":5.5030000000000001},"min":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":0.52500000000000002},"max":{"1min":3.069,"5min":411.19299999999998,"15min":411.19299999999998},"last":2.597},{"interface":"front","average":{"1min":2.0569999999999999,"5min":22.204000000000001,"15min":15.141999999999999},"min":{"1min":1.4430000000000001,"5min":1.2929999999999999,"15min":0.94099999999999995},"max":{"1min":3.1349999999999998,"5min":1440.327,"15min":1440.327},"last":2.5190000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:21:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1629999999999998,"5min":2.2320000000000002,"15min":4.4870000000000001},"min":{"1min":1.397,"5min":1.264,"15min":1.1719999999999999},"max":{"1min":3.2679999999999998,"5min":3.847,"15min":652.88999999999999},"last":2.4660000000000002},{"interface":"front","average":{"1min":3.7290000000000001,"5min":2.4340000000000002,"15min":5.5830000000000002},"min":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.153},"max":{"1min":35.875999999999998,"5min":35.875999999999998,"15min":944.33299999999997},"last":2.8029999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":8.8260000000000005,"15min":4.6340000000000003},"min":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":0.752},"max":{"1min":3.5150000000000001,"5min":551.68899999999996,"15min":551.68899999999996},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.609,"5min":2.8610000000000002,"15min":2.71},"min":{"1min":1.671,"5min":1.671,"15min":0.875},"max":{"1min":3.5529999999999999,"5min":3.8300000000000001,"15min":3.883},"last":2.8420000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:21:28 2020","interfaces":[{"interface":"back","average":{"1min":36.609999999999999,"5min":9.3030000000000008,"15min":12.561999999999999},"min":{"1min":1.776,"5min":1.698,"15min":1.1739999999999999},"max":{"1min":653.18799999999999,"5min":653.18799999999999,"15min":859.346},"last":2.6640000000000001},{"interface":"front","average":{"1min":2.48,"5min":2.8820000000000001,"15min":6.1150000000000002},"min":{"1min":2.0800000000000001,"5min":1.653,"15min":0.83899999999999997},"max":{"1min":3.169,"5min":4.1280000000000001,"15min":503.52699999999999},"last":2.419}]},{"osd":5,"last update":"Thu Nov 12 12:21:14 2020","interfaces":[{"interface":"back","average":{"1min":2.7570000000000001,"5min":2.6240000000000001,"15min":4.1210000000000004},"min":{"1min":2.2069999999999999,"5min":1.716,"15min":1.589},"max":{"1min":3.238,"5min":4.056,"15min":576.83399999999995},"last":2.742},{"interface":"front","average":{"1min":20.073,"5min":12.494999999999999,"15min":8.0109999999999992},"min":{"1min":1.875,"5min":1.5960000000000001,"15min":1.5960000000000001},"max":{"1min":365.61500000000001,"5min":684.90800000000002,"15min":684.90800000000002},"last":2.5590000000000002}]},{"osd":6,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":2.7850000000000001,"5min":2.7389999999999999,"15min":5.1509999999999998},"min":{"1min":1.9630000000000001,"5min":1.9159999999999999,"15min":0.79700000000000004},"max":{"1min":3.3839999999999999,"5min":3.9860000000000002,"15min":596.68799999999999},"last":2.9009999999999998},{"interface":"front","average":{"1min":8.0250000000000004,"5min":3.8519999999999999,"15min":3.1869999999999998},"min":{"1min":2.0030000000000001,"5min":1.9630000000000001,"15min":1.097},"max":{"1min":115.961,"5min":115.961,"15min":115.961},"last":3.2879999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":12.087999999999999,"15min":12.523999999999999},"min":{"1min":2.0019999999999998,"5min":1.6830000000000001,"15min":1.3149999999999999},"max":{"1min":3.4620000000000002,"5min":503.88600000000002,"15min":962.88099999999997},"last":3.0550000000000002},{"interface":"front","average":{"1min":34.366,"5min":22.047000000000001,"15min":14.087999999999999},"min":{"1min":2.4569999999999999,"5min":1.996,"15min":1.3600000000000001},"max":{"1min":597.74800000000005,"5min":659.97199999999998,"15min":699.61099999999999},"last":3.0800000000000001}]}]},{"osd":0,"up_from":245,"seq":1052266987773,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1115620,"kb_used_data":67036,"kb_used_omap":106,"kb_used_meta":1048469,"kb_avail":93256220,"statfs":{"total":96636764160,"available":95494369280,"internally_reserved":1073741824,"allocated":68644864,"data_stored":89861077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108685,"internal_metadata":1073633139},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":17.526,"5min":5.4950000000000001,"15min":4.7249999999999996},"min":{"1min":1.173,"5min":1.173,"15min":0.94799999999999995},"max":{"1min":323.76999999999998,"5min":323.76999999999998,"15min":414.45699999999999},"last":3.1059999999999999},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.946,"15min":12.289999999999999},"min":{"1min":1.2290000000000001,"5min":1.2030000000000001,"15min":0.86899999999999999},"max":{"1min":2.4340000000000002,"5min":3.508,"15min":721.47000000000003},"last":2.2810000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:21:41 2020","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.7829999999999999,"15min":10.721},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.629},"max":{"1min":2.052,"5min":3.1579999999999999,"15min":941.245},"last":1.877},{"interface":"front","average":{"1min":1.8,"5min":2.3929999999999998,"15min":3.6320000000000001},"min":{"1min":1.071,"5min":1.071,"15min":0.80800000000000005},"max":{"1min":2.7000000000000002,"5min":4.4900000000000002,"15min":346.39299999999997},"last":2.0459999999999998}]},{"osd":3,"last update":"Thu Nov 12 12:21:41 2020","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":12.808,"15min":6.9340000000000002},"min":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":0.875},"max":{"1min":2.706,"5min":406.66899999999998,"15min":406.66899999999998},"last":1.9830000000000001},{"interface":"front","average":{"1min":2.073,"5min":5.8300000000000001,"15min":3.5049999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.66000000000000003},"max":{"1min":4.3879999999999999,"5min":205.96600000000001,"15min":205.96600000000001},"last":1.5669999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:21:22 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":6.3869999999999996,"15min":9.923},"min":{"1min":2.0569999999999999,"5min":1.7909999999999999,"15min":1.2749999999999999},"max":{"1min":4.1619999999999999,"5min":355.63999999999999,"15min":855.26300000000003},"last":3.222},{"interface":"front","average":{"1min":2.7970000000000002,"5min":25.908999999999999,"15min":19.613},"min":{"1min":1.345,"5min":1.345,"15min":1.155},"max":{"1min":4.1020000000000003,"5min":677.99099999999999,"15min":1379.0840000000001},"last":2.782}]},{"osd":5,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.8730000000000002,"5min":2.851,"15min":4.4779999999999998},"min":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.5349999999999999},"max":{"1min":4.3399999999999999,"5min":4.5330000000000004,"15min":270.59300000000002},"last":3.0419999999999998},{"interface":"front","average":{"1min":3.125,"5min":6.7850000000000001,"15min":12.808999999999999},"min":{"1min":1.9730000000000001,"5min":1.925,"15min":1.4630000000000001},"max":{"1min":4.2830000000000004,"5min":353.98200000000003,"15min":558.88199999999995},"last":2.7429999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":3.141,"15min":6.2329999999999997},"min":{"1min":2.1139999999999999,"5min":1.788,"15min":1.0820000000000001},"max":{"1min":4.4550000000000001,"5min":4.4550000000000001,"15min":962.05700000000002},"last":3.1499999999999999},{"interface":"front","average":{"1min":3.2389999999999999,"5min":4.532,"15min":5.8209999999999997},"min":{"1min":2.1549999999999998,"5min":2.1040000000000001,"15min":1.071},"max":{"1min":4.5549999999999997,"5min":128.83099999999999,"15min":408.70999999999998},"last":3.1829999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:21:30 2020","interfaces":[{"interface":"back","average":{"1min":49.468000000000004,"5min":19.488,"15min":8.6349999999999998},"min":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.7170000000000001},"max":{"1min":307.64299999999997,"5min":708.64599999999996,"15min":708.64599999999996},"last":2.8149999999999999},{"interface":"front","average":{"1min":3.0750000000000002,"5min":6.9489999999999998,"15min":9.9139999999999997},"min":{"1min":2.101,"5min":2.101,"15min":1.899},"max":{"1min":4.625,"5min":392.08100000000002,"15min":936.08799999999997},"last":2.8450000000000002}]}]},{"osd":1,"up_from":596,"seq":2559800508591,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102500,"kb_used_data":53916,"kb_used_omap":259,"kb_used_meta":1048316,"kb_avail":93269340,"statfs":{"total":96636764160,"available":95507804160,"internally_reserved":1073741824,"allocated":55209984,"data_stored":58313765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265441,"internal_metadata":1073476383},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:05 2020","interfaces":[{"interface":"back","average":{"1min":2.278,"5min":2.2959999999999998,"15min":2.1699999999999999},"min":{"1min":1.502,"5min":1.006,"15min":0.84499999999999997},"max":{"1min":3.5499999999999998,"5min":4.1299999999999999,"15min":4.1299999999999999},"last":2.79},{"interface":"front","average":{"1min":1.988,"5min":4.008,"15min":4.2859999999999996},"min":{"1min":1.01,"5min":0.97899999999999998,"15min":0.82699999999999996},"max":{"1min":3.3130000000000002,"5min":186.274,"15min":418.93299999999999},"last":2.2629999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.4460000000000002,"15min":4.7679999999999998},"min":{"1min":1.7210000000000001,"5min":1.048,"15min":0.73899999999999999},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":697.46699999999998},"last":1.919},{"interface":"front","average":{"1min":2.2970000000000002,"5min":12.449999999999999,"15min":5.7069999999999999},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.121},"max":{"1min":3.3780000000000001,"5min":952.149,"15min":952.149},"last":2.1850000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.9850000000000001,"15min":4.952},"min":{"1min":0.96799999999999997,"5min":0.95599999999999996,"15min":0.84199999999999997},"max":{"1min":2.7040000000000002,"5min":3.6989999999999998,"15min":745.18499999999995},"last":1.7809999999999999},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.7799999999999998,"15min":4.3979999999999997},"min":{"1min":1.55,"5min":1.1599999999999999,"15min":1.046},"max":{"1min":4.96,"5min":6.1619999999999999,"15min":556.56600000000003},"last":2.7360000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":7.3369999999999997,"15min":7.4809999999999999},"min":{"1min":2.0219999999999998,"5min":1.306,"15min":1.2370000000000001},"max":{"1min":5.0789999999999997,"5min":296.50599999999997,"15min":907.37900000000002},"last":1.9630000000000001},{"interface":"front","average":{"1min":2.6379999999999999,"5min":9.0129999999999999,"15min":10.769},"min":{"1min":1.405,"5min":1.242,"15min":1.0369999999999999},"max":{"1min":4.7220000000000004,"5min":713.56299999999999,"15min":962.79999999999995},"last":3.153}]},{"osd":5,"last update":"Thu Nov 12 12:21:10 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":2.9159999999999999,"15min":11.224},"min":{"1min":1.4810000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":4.7999999999999998,"5min":4.7999999999999998,"15min":882.23599999999999},"last":3.0649999999999999},{"interface":"front","average":{"1min":3.1160000000000001,"5min":3.0419999999999998,"15min":2.9129999999999998},"min":{"1min":2.1110000000000002,"5min":1.349,"15min":1.349},"max":{"1min":5.1420000000000003,"5min":5.1420000000000003,"15min":5.1420000000000003},"last":2.8300000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":16.097999999999999,"5min":11.843,"15min":15.132},"min":{"1min":1.7789999999999999,"5min":1.6519999999999999,"15min":1.2270000000000001},"max":{"1min":248.56800000000001,"5min":703.36000000000001,"15min":712.46100000000001},"last":2.6499999999999999},{"interface":"front","average":{"1min":3.1520000000000001,"5min":10.99,"15min":11.157999999999999},"min":{"1min":2.262,"5min":1.758,"15min":1.2989999999999999},"max":{"1min":4.8879999999999999,"5min":862.61199999999997,"15min":862.61199999999997},"last":3.1920000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:21:05 2020","interfaces":[{"interface":"back","average":{"1min":3.214,"5min":10.917,"15min":8.3499999999999996},"min":{"1min":2.1429999999999998,"5min":2.028,"15min":1.6140000000000001},"max":{"1min":5.226,"5min":889.41300000000001,"15min":889.41300000000001},"last":2.8650000000000002},{"interface":"front","average":{"1min":3.02,"5min":8.3350000000000009,"15min":8.1820000000000004},"min":{"1min":2.0139999999999998,"5min":1.7809999999999999,"15min":1.623},"max":{"1min":5.0279999999999996,"5min":590.93899999999996,"15min":910.41899999999998},"last":3.1160000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118312,"kb_used_data":69728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253528,"statfs":{"total":96636764160,"available":95491612672,"internally_reserved":1073741824,"allocated":71401472,"data_stored":92861124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:20:56 2020","interfaces":[{"interface":"back","average":{"1min":6.3799999999999999,"5min":2.9380000000000002,"15min":7.702},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.68300000000000005},"max":{"1min":101.264,"5min":101.264,"15min":910.56200000000001},"last":1.897},{"interface":"front","average":{"1min":2.3769999999999998,"5min":2.2490000000000001,"15min":5.0590000000000002},"min":{"1min":1.026,"5min":1.014,"15min":0.78100000000000003},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":502.17099999999999},"last":2.0219999999999998}]},{"osd":1,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":1.9490000000000001,"5min":6.6769999999999996,"15min":11.897},"min":{"1min":1.1759999999999999,"5min":0.88200000000000001,"15min":0.71899999999999997},"max":{"1min":3.1560000000000001,"5min":421.51299999999998,"15min":915.37400000000002},"last":2.2109999999999999},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.347,"15min":11.691000000000001},"min":{"1min":1.167,"5min":1.167,"15min":0.85599999999999998},"max":{"1min":3.3330000000000002,"5min":3.508,"15min":899.26800000000003},"last":2.6099999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:21:35 2020","interfaces":[{"interface":"back","average":{"1min":34.923999999999999,"5min":9.7409999999999997,"15min":9.2260000000000009},"min":{"1min":1.071,"5min":1.071,"15min":0.628},"max":{"1min":826.27700000000004,"5min":826.27700000000004,"15min":826.27700000000004},"last":2.3100000000000001},{"interface":"front","average":{"1min":2.1360000000000001,"5min":5.8239999999999998,"15min":5.7990000000000004},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":0.96899999999999997},"max":{"1min":3.5819999999999999,"5min":304.57100000000003,"15min":304.57100000000003},"last":2.157}]},{"osd":4,"last update":"Thu Nov 12 12:21:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":2.516,"15min":4.7210000000000001},"min":{"1min":1.393,"5min":1.393,"15min":1.073},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":503.37},"last":2.7970000000000002},{"interface":"front","average":{"1min":50.110999999999997,"5min":15.205,"15min":9.9399999999999995},"min":{"1min":1.643,"5min":1.643,"15min":0.98299999999999998},"max":{"1min":518.65099999999995,"5min":518.65099999999995,"15min":518.65099999999995},"last":3.0009999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":2.6760000000000002,"15min":2.7290000000000001},"min":{"1min":1.8260000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":3.468,"5min":4.1840000000000002,"15min":4.2800000000000002},"last":2.7160000000000002},{"interface":"front","average":{"1min":31.562999999999999,"5min":8.5600000000000005,"15min":8.25},"min":{"1min":1.8560000000000001,"5min":1.6739999999999999,"15min":1.629},"max":{"1min":751.98500000000001,"5min":751.98500000000001,"15min":751.98500000000001},"last":3.0499999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":21.634,"5min":6.6269999999999998,"15min":4.0389999999999997},"min":{"1min":1.853,"5min":1.78,"15min":1.4690000000000001},"max":{"1min":512.71400000000006,"5min":512.71400000000006,"15min":512.71400000000006},"last":2.7629999999999999},{"interface":"front","average":{"1min":3.0129999999999999,"5min":2.7970000000000002,"15min":9.4619999999999997},"min":{"1min":1.474,"5min":1.474,"15min":1.2529999999999999},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":1001.212},"last":2.8420000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:21:29 2020","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":3.0800000000000001,"15min":3.0259999999999998},"min":{"1min":2.0510000000000002,"5min":2.0049999999999999,"15min":1.8600000000000001},"max":{"1min":4.2130000000000001,"5min":4.6219999999999999,"15min":4.827},"last":3.4710000000000001},{"interface":"front","average":{"1min":3.036,"5min":3.1120000000000001,"15min":6.1719999999999997},"min":{"1min":2.198,"5min":2.198,"15min":1.7709999999999999},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":612.13900000000001},"last":3.363}]}]},{"osd":3,"up_from":13,"seq":55834575154,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":97589153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:56 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":7.327,"15min":4.3019999999999996},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.70699999999999996},"max":{"1min":2.2679999999999998,"5min":539.39700000000005,"15min":539.39700000000005},"last":2.1509999999999998},{"interface":"front","average":{"1min":2.1379999999999999,"5min":16.751000000000001,"15min":14.835000000000001},"min":{"1min":1.05,"5min":1.05,"15min":0.745},"max":{"1min":3.8039999999999998,"5min":897.51999999999998,"15min":897.51999999999998},"last":3.8039999999999998}]},{"osd":1,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":29.864000000000001,"5min":24.707999999999998,"15min":9.8190000000000008},"min":{"1min":1.3979999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":502.94499999999999,"5min":1000.314,"15min":1000.314},"last":1.7390000000000001},{"interface":"front","average":{"1min":54.143999999999998,"5min":13.034000000000001,"15min":6.0289999999999999},"min":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":0.78000000000000003},"max":{"1min":504.43200000000002,"5min":504.43200000000002,"15min":504.43200000000002},"last":3.7120000000000002}]},{"osd":2,"last update":"Thu Nov 12 12:21:26 2020","interfaces":[{"interface":"back","average":{"1min":1.8420000000000001,"5min":2.2200000000000002,"15min":3.968},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.92700000000000005},"max":{"1min":2.379,"5min":4.1310000000000002,"15min":445.346},"last":2.2890000000000001},{"interface":"front","average":{"1min":25.465,"5min":13.157999999999999,"15min":6.1230000000000002},"min":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":0.84899999999999998},"max":{"1min":367.471,"5min":367.471,"15min":367.471},"last":4.9409999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:21:21 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":11.834,"15min":11.029},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1},"max":{"1min":3.3420000000000001,"5min":931.26099999999997,"15min":931.26099999999997},"last":1.6879999999999999},{"interface":"front","average":{"1min":2.794,"5min":2.895,"15min":8.7699999999999996},"min":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.2669999999999999},"max":{"1min":4.0069999999999997,"5min":5.1470000000000002,"15min":866.529},"last":3.8839999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:21:10 2020","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":2.7629999999999999,"15min":8.218},"min":{"1min":1.625,"5min":1.625,"15min":1.625},"max":{"1min":3.4409999999999998,"5min":4.1900000000000004,"15min":504.80799999999999},"last":1.798},{"interface":"front","average":{"1min":2.573,"5min":2.4889999999999999,"15min":7.4219999999999997},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.2829999999999999},"max":{"1min":3.165,"5min":3.4670000000000001,"15min":941.37300000000005},"last":2.0459999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":3.4590000000000001,"5min":11.211,"15min":14.042999999999999},"min":{"1min":2.7400000000000002,"5min":2.2799999999999998,"15min":1.375},"max":{"1min":4.7039999999999997,"5min":804.34000000000003,"15min":941.26800000000003},"last":3.96},{"interface":"front","average":{"1min":3.7429999999999999,"5min":20.917000000000002,"15min":14.537000000000001},"min":{"1min":2.7690000000000001,"5min":2.5579999999999998,"15min":1.3919999999999999},"max":{"1min":4.9429999999999996,"5min":653.09799999999996,"15min":967.322},"last":4.0270000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:21:26 2020","interfaces":[{"interface":"back","average":{"1min":3.5190000000000001,"5min":20.445,"15min":9.2970000000000006},"min":{"1min":2.306,"5min":2.306,"15min":1.911},"max":{"1min":4.8570000000000002,"5min":543.17899999999997,"15min":543.17899999999997},"last":4.0960000000000001},{"interface":"front","average":{"1min":3.5609999999999999,"5min":5.2130000000000001,"15min":5.8209999999999997},"min":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":1.728},"max":{"1min":4.9219999999999997,"5min":143.191,"15min":529.88699999999994},"last":4.8550000000000004}]}]}]}} , 2020-11-12T12:22:01.427 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:22:45.426 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.6 , 2020-11-12 12:22:45.689 7fa9064bd700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:22:45.801 7fa9064bd700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:24:40.670 7f85eeff3700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:24:40.776 7f85eeff3700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T12:24:41.073 INFO:teuthology.orchestra.run.smithi044.stdout: Ignoring malparsed backtrace: 2020-11-12T12:24:41.759 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-12T12:24:41.821 INFO:tasks.ceph.mon.c:Stopped , 2020-11-12T12:24:41.822 DEBUG:tasks.ceph.mon.b:waiting for process to exit Ignoring malparsed backtrace: raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') , RuntimeError: Exiting scrub checking -- not all pgs scrubbed. , 2020-11-12T12:25:57.350 DEBUG:teuthology.run_tasks:Unwinding manager install Ignoring malparsed backtrace: cp: cannot stat ‘/usr/bin/ceph_test_rados.debug’: No such file or directory , 2020-11-12T12:26:22.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-11-12T12:26:22.256 ERROR:teuthology.run_tasks:Manager failed: internal.archive Ignoring malparsed backtrace: ceph version 14.2.11-111-g93c5d14 (93c5d149177634d9a3196c2990e4c0af398f8a4d) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7fe009429524] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x13e8) [0x559bae079378] Ignoring malparsed backtrace: 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout:{ , 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout: "fsid": "a244e989-1818-4ba5-ad4f-fb2f6364d428", , 2020-11-12T12:07:52.022 INFO:teuthology.orchestra.run.smithi044.stdout: "health": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_osds": 8, , 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_up_osds": 8, , 2020-11-12T12:07:52.039 INFO:teuthology.orchestra.run.smithi044.stdout: "num_in_osds": 8, Ignoring malparsed backtrace: 2020-11-12T12:07:52.054 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.054 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.055 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.069 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.085 INFO:teuthology.orchestra.run.smithi044.stdout: "crush_compat_max_iterations": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.099 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "ALERTMANAGER_API_HOST": { , 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ALERTMANAGER_API_HOST", , 2020-11-12T12:07:52.113 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.127 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:52.140 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.140 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.141 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.154 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.168 INFO:teuthology.orchestra.run.smithi044.stdout: "key_file": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.182 INFO:teuthology.orchestra.run.smithi044.stdout: "standby_error_status_code": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.209 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:07:52.209 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "600", , 2020-11-12T12:07:52.210 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "diskprediction_server": { , 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_server", , 2020-11-12T12:07:52.224 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.237 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.237 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.238 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.251 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:07:52.265 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.279 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.292 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.293 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "roption1", , 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.306 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.319 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", , 2020-11-12T12:07:52.320 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "address", , 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:07:52.333 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:52.346 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.347 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "proxy": { , 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "proxy", , 2020-11-12T12:07:52.360 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.374 INFO:teuthology.orchestra.run.smithi044.stdout: "zabbix_sender": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "smtp_port": { , 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "smtp_port", , 2020-11-12T12:07:52.388 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:52.401 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.401 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.402 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "0.001", , 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "0.999", , 2020-11-12T12:07:52.415 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.429 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "5", , 2020-11-12T12:07:52.429 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "1", , 2020-11-12T12:07:52.430 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.443 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.456 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.456 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.457 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "REST_REQUESTS_TIMEOUT": { , 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "REST_REQUESTS_TIMEOUT", , 2020-11-12T12:07:52.470 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:52.483 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.483 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:07:52.484 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:52.497 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.498 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.498 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:07:52.511 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "automatically mark OSD if it may fail before this long", , 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.525 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.538 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.552 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.566 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:52.579 INFO:teuthology.orchestra.run.smithi044.stdout: "username": { , 2020-11-12T12:07:52.580 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "username", , 2020-11-12T12:07:52.580 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.593 INFO:teuthology.orchestra.run.smithi044.stdout: "prefix": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "how frequently to persist completed events", , 2020-11-12T12:07:52.607 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, , 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", , 2020-11-12T12:07:52.620 INFO:teuthology.orchestra.run.smithi044.stdout: "module_options": {} Ignoring malparsed backtrace: 2020-11-12T12:07:52.634 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:07:52.634 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:07:52.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:52.648 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:07:52.648 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.649 INFO:teuthology.orchestra.run.smithi044.stdout: "testnewline": { Ignoring malparsed backtrace: 2020-11-12T12:07:52.663 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", , 2020-11-12T12:07:52.664 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:07:52.664 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", , 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:07:52.678 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:52.691 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:07:52.691 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "volumes", , 2020-11-12T12:07:52.692 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, Ignoring malparsed backtrace: 2020-11-12T12:07:52.705 INFO:teuthology.orchestra.run.smithi044.stdout: "services": {} , 2020-11-12T12:07:52.706 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:07:52.706 INFO:teuthology.orchestra.run.smithi044.stdout: "progress_events": {} Ignoring malparsed backtrace: 2020-11-12 12:08:16.930 7f2f3f453700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:08:17.043 7f2f3f453700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T12:08:17.084 INFO:teuthology.orchestra.run.smithi044.stdout:1052266987607 Ignoring malparsed backtrace: 2020-11-12T12:08:26.986 INFO:teuthology.orchestra.run.smithi044.stdout: "a", , 2020-11-12T12:08:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: "b", , 2020-11-12T12:08:26.988 INFO:teuthology.orchestra.run.smithi044.stdout: "c" Ignoring malparsed backtrace: 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: "state_name": "active+clean+scrubbing", , 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: "count": 1 , 2020-11-12T12:08:27.005 INFO:teuthology.orchestra.run.smithi044.stdout: } Ignoring malparsed backtrace: 2020-11-12T12:08:27.026 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.027 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.027 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.047 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.047 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.048 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.064 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.064 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:08:27.065 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "pgs,objects,bytes", Ignoring malparsed backtrace: 2020-11-12T12:08:27.078 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", , 2020-11-12T12:08:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.079 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, Ignoring malparsed backtrace: 2020-11-12T12:08:27.092 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "False", , 2020-11-12T12:08:27.093 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.093 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.106 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.106 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.107 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.122 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.123 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.123 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "RGW_API_SECRET_KEY": { , 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "RGW_API_SECRET_KEY", , 2020-11-12T12:08:27.136 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:08:27.150 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.151 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.151 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.164 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.164 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.165 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.179 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "raise health warning if OSD may fail before this long", , 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.196 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.223 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "localhost", , 2020-11-12T12:08:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.224 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:08:27.247 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "influx", Ignoring malparsed backtrace: 2020-11-12T12:08:27.268 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.269 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "default replica count for any created local pool", , 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.286 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "50", , 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.304 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "stale_cache_strategy", , 2020-11-12T12:08:27.327 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.328 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.349 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.370 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.392 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.415 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.415 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.416 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.440 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "https://telemetry.ceph.com/report", , 2020-11-12T12:08:27.440 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.441 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.458 INFO:teuthology.orchestra.run.smithi044.stdout: } , 2020-11-12T12:08:27.459 INFO:teuthology.orchestra.run.smithi044.stdout: ], , 2020-11-12T12:08:27.459 INFO:teuthology.orchestra.run.smithi044.stdout: "modules": [ Ignoring malparsed backtrace: 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.474 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: { , 2020-11-12T12:08:27.490 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "balancer", Ignoring malparsed backtrace: 2020-11-12T12:08:27.505 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.505 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.506 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.522 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.523 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.536 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "FEATURE_TOGGLE_cephfs": { , 2020-11-12T12:08:27.537 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "FEATURE_TOGGLE_cephfs", Ignoring malparsed backtrace: 2020-11-12T12:08:27.550 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "bool", , 2020-11-12T12:08:27.550 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.551 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "", , 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.564 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.580 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.593 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.594 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] , 2020-11-12T12:08:27.594 INFO:teuthology.orchestra.run.smithi044.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:08:27.607 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, , 2020-11-12T12:08:27.607 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "sharedsecret", , 2020-11-12T12:08:27.608 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "retention_period": { , 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "retention_period", , 2020-11-12T12:08:27.621 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "secs", Ignoring malparsed backtrace: 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.635 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: }, , 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: "diskprediction_user": { , 2020-11-12T12:08:27.649 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "diskprediction_user", Ignoring malparsed backtrace: 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "str", , 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.665 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:08:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "true", , 2020-11-12T12:08:27.678 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.679 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "level": "advanced", , 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "flags": 1, , 2020-11-12T12:08:27.692 INFO:teuthology.orchestra.run.smithi044.stdout: "default_value": "rack", Ignoring malparsed backtrace: 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "min": "", , 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.706 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.720 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "rwoption3": { , 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "rwoption3", , 2020-11-12T12:08:27.733 INFO:teuthology.orchestra.run.smithi044.stdout: "type": "float", Ignoring malparsed backtrace: 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "name": "ssh", , 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "can_run": true, , 2020-11-12T12:08:27.747 INFO:teuthology.orchestra.run.smithi044.stdout: "error_string": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "max": "", , 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.761 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", , 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "tags": [], , 2020-11-12T12:08:27.775 INFO:teuthology.orchestra.run.smithi044.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "enum_allowed": [], , 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "desc": "", , 2020-11-12T12:08:27.789 INFO:teuthology.orchestra.run.smithi044.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:08:29.828 INFO:teuthology.orchestra.run.smithi044.stdout: , dumped all , 2020-11-12T12:08:29.845 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":975,"stamp":"2020-11-12 12:08:28.580429","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":9000640,"kb_used_data":611968,"kb_used_omap":1496,"kb_used_meta":8387111,"kb_avail":745974080,"statfs":{"total":773094113280,"available":763877457920,"internally_reserved":8589934592,"allocated":626655232,"data_stored":749813723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1532414,"internal_metadata":8588402178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003615"},"pg_stats":[{"pgid":"2.f","version":"605'975","reported_seq":"5179","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.048094","last_change":"2020-11-12 12:07:44.339133","last_active":"2020-11-12 12:08:13.048094","last_peered":"2020-11-12 12:08:13.048094","last_clean":"2020-11-12 12:08:13.048094","last_became_active":"2020-11-12 12:07:43.542344","last_became_peered":"2020-11-12 12:07:43.542344","last_unstale":"2020-11-12 12:08:13.048094","last_undegraded":"2020-11-12 12:08:13.048094","last_fullsized":"2020-11-12 12:08:13.048094","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":975,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":36964515,"num_objects":22,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":222,"num_read_kb":276029,"num_write":279,"num_write_kb":64344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":676764753,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"606'755","reported_seq":"3298","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053607","last_change":"2020-11-12 12:07:45.720783","last_active":"2020-11-12 12:08:13.053607","last_peered":"2020-11-12 12:08:13.053607","last_clean":"2020-11-12 12:08:13.053607","last_became_active":"2020-11-12 12:07:44.559898","last_became_peered":"2020-11-12 12:07:44.559898","last_unstale":"2020-11-12 12:08:13.053607","last_undegraded":"2020-11-12 12:08:13.053607","last_fullsized":"2020-11-12 12:08:13.053607","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":44542027,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":142,"num_read_kb":168636,"num_write":206,"num_write_kb":48990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":220359844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"126","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.561197","last_change":"2020-11-12 12:07:34.980292","last_active":"2020-11-12 12:08:12.561197","last_peered":"2020-11-12 12:08:12.561197","last_clean":"2020-11-12 12:08:12.561197","last_became_active":"2020-11-12 12:07:34.979587","last_became_peered":"2020-11-12 12:07:34.979587","last_unstale":"2020-11-12 12:08:12.561197","last_undegraded":"2020-11-12 12:08:12.561197","last_fullsized":"2020-11-12 12:08:12.561197","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:50.045143","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:01:01.411425","last_clean_scrub_stamp":"2020-11-12 12:06:50.045143","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"607'1034","reported_seq":"4531","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567601","last_change":"2020-11-12 12:07:45.706465","last_active":"2020-11-12 12:08:12.567601","last_peered":"2020-11-12 12:08:12.567601","last_clean":"2020-11-12 12:08:12.567601","last_became_active":"2020-11-12 12:07:45.566064","last_became_peered":"2020-11-12 12:07:45.566064","last_unstale":"2020-11-12 12:08:12.567601","last_undegraded":"2020-11-12 12:08:12.567601","last_fullsized":"2020-11-12 12:08:12.567601","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":1034,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63069801,"num_objects":33,"num_object_clones":27,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":227,"num_read_kb":245644,"num_write":327,"num_write_kb":79050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":626,"num_bytes_recovered":710613985,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376795","last_change":"2020-11-12 12:07:07.510609","last_active":"2020-11-12 12:08:13.376795","last_peered":"2020-11-12 12:08:13.376795","last_clean":"2020-11-12 12:08:13.376795","last_became_active":"2020-11-12 12:06:38.531854","last_became_peered":"2020-11-12 12:06:38.531854","last_unstale":"2020-11-12 12:08:13.376795","last_undegraded":"2020-11-12 12:08:13.376795","last_fullsized":"2020-11-12 12:08:13.376795","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:07.510477","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:07:07.510477","last_clean_scrub_stamp":"2020-11-12 12:07:07.510477","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"605'571","reported_seq":"3045","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376977","last_change":"2020-11-12 12:07:44.295346","last_active":"2020-11-12 12:08:13.376977","last_peered":"2020-11-12 12:08:13.376977","last_clean":"2020-11-12 12:08:13.376977","last_became_active":"2020-11-12 12:07:43.546299","last_became_peered":"2020-11-12 12:07:43.546299","last_unstale":"2020-11-12 12:08:13.376977","last_undegraded":"2020-11-12 12:08:13.376977","last_fullsized":"2020-11-12 12:08:13.376977","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":571,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41575305,"num_objects":15,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":110,"num_read_kb":112384,"num_write":178,"num_write_kb":39453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":214562650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"631","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047347","last_change":"2020-11-12 12:07:05.341895","last_active":"2020-11-12 12:08:13.047347","last_peered":"2020-11-12 12:08:13.047347","last_clean":"2020-11-12 12:08:13.047347","last_became_active":"2020-11-12 12:06:37.605758","last_became_peered":"2020-11-12 12:06:37.605758","last_unstale":"2020-11-12 12:08:13.047347","last_undegraded":"2020-11-12 12:08:13.047347","last_fullsized":"2020-11-12 12:08:13.047347","mapping_epoch":559,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":560,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:05.341782","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:05.341782","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"605'852","reported_seq":"3625","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053157","last_change":"2020-11-12 12:07:43.726533","last_active":"2020-11-12 12:08:13.053157","last_peered":"2020-11-12 12:08:13.053157","last_clean":"2020-11-12 12:08:13.053157","last_became_active":"2020-11-12 12:07:43.552867","last_became_peered":"2020-11-12 12:07:43.552867","last_unstale":"2020-11-12 12:08:13.053157","last_undegraded":"2020-11-12 12:08:13.053157","last_fullsized":"2020-11-12 12:08:13.053157","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":852,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40651861,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":176,"num_read_kb":237784,"num_write":229,"num_write_kb":51463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":336631858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"423","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566243","last_change":"2020-11-12 12:07:06.161566","last_active":"2020-11-12 12:08:12.566243","last_peered":"2020-11-12 12:08:12.566243","last_clean":"2020-11-12 12:08:12.566243","last_became_active":"2020-11-12 12:07:02.730087","last_became_peered":"2020-11-12 12:07:02.730087","last_unstale":"2020-11-12 12:08:12.566243","last_undegraded":"2020-11-12 12:08:12.566243","last_fullsized":"2020-11-12 12:08:12.566243","mapping_epoch":580,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:06.161501","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:06.161501","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"605'787","reported_seq":"3194","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376911","last_change":"2020-11-12 12:07:43.680183","last_active":"2020-11-12 12:08:13.376911","last_peered":"2020-11-12 12:08:13.376911","last_clean":"2020-11-12 12:08:13.376911","last_became_active":"2020-11-12 12:07:43.540815","last_became_peered":"2020-11-12 12:07:43.540815","last_unstale":"2020-11-12 12:08:13.376911","last_undegraded":"2020-11-12 12:08:13.376911","last_fullsized":"2020-11-12 12:08:13.376911","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":787,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43160093,"num_objects":20,"num_object_clones":17,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":133,"num_read_kb":120761,"num_write":220,"num_write_kb":54232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":209150928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"134","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.560847","last_change":"2020-11-12 12:07:44.529416","last_active":"2020-11-12 12:08:12.560847","last_peered":"2020-11-12 12:08:12.560847","last_clean":"2020-11-12 12:08:12.560847","last_became_active":"2020-11-12 12:07:40.996832","last_became_peered":"2020-11-12 12:07:40.996832","last_unstale":"2020-11-12 12:08:12.560847","last_undegraded":"2020-11-12 12:08:12.560847","last_fullsized":"2020-11-12 12:08:12.560847","mapping_epoch":601,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":602,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:44.529241","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:44.529241","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"607'461","reported_seq":"3496","reported_epoch":"619","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:08:13.376948","last_change":"2020-11-12 12:07:48.505159","last_active":"2020-11-12 12:08:13.376948","last_peered":"2020-11-12 12:08:13.376948","last_clean":"2020-11-12 12:08:13.376948","last_became_active":"2020-11-12 12:07:45.558646","last_became_peered":"2020-11-12 12:07:45.558646","last_unstale":"2020-11-12 12:08:13.376948","last_undegraded":"2020-11-12 12:08:13.376948","last_fullsized":"2020-11-12 12:08:13.376948","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":461,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22082484,"num_objects":10,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":79,"num_read_kb":73364,"num_write":120,"num_write_kb":28596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":226411123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376678","last_change":"2020-11-12 12:07:14.479425","last_active":"2020-11-12 12:08:13.376678","last_peered":"2020-11-12 12:08:13.376678","last_clean":"2020-11-12 12:08:13.376678","last_became_active":"2020-11-12 12:06:38.526587","last_became_peered":"2020-11-12 12:06:38.526587","last_unstale":"2020-11-12 12:08:13.376678","last_undegraded":"2020-11-12 12:08:13.376678","last_fullsized":"2020-11-12 12:08:13.376678","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:14.479334","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:14.479334","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"605'236","reported_seq":"2602","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376934","last_change":"2020-11-12 12:07:43.679033","last_active":"2020-11-12 12:08:13.376934","last_peered":"2020-11-12 12:08:13.376934","last_clean":"2020-11-12 12:08:13.376934","last_became_active":"2020-11-12 12:07:43.544179","last_became_peered":"2020-11-12 12:07:43.544179","last_unstale":"2020-11-12 12:08:13.376934","last_undegraded":"2020-11-12 12:08:13.376934","last_fullsized":"2020-11-12 12:08:13.376934","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":236,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8892018,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":52270,"num_write":58,"num_write_kb":14437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":101718835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"605'185","reported_seq":"2708","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566247","last_change":"2020-11-12 12:07:43.627236","last_active":"2020-11-12 12:08:12.566247","last_peered":"2020-11-12 12:08:12.566247","last_clean":"2020-11-12 12:08:12.566247","last_became_active":"2020-11-12 12:07:43.549723","last_became_peered":"2020-11-12 12:07:43.549723","last_unstale":"2020-11-12 12:08:12.566247","last_undegraded":"2020-11-12 12:08:12.566247","last_fullsized":"2020-11-12 12:08:12.566247","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5743030,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":84824,"num_write":57,"num_write_kb":16290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":83699520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"242","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047777","last_change":"2020-11-12 12:07:26.910728","last_active":"2020-11-12 12:08:13.047777","last_peered":"2020-11-12 12:08:13.047777","last_clean":"2020-11-12 12:08:13.047777","last_became_active":"2020-11-12 12:07:26.910195","last_became_peered":"2020-11-12 12:07:26.910195","last_unstale":"2020-11-12 12:08:13.047777","last_undegraded":"2020-11-12 12:08:13.047777","last_fullsized":"2020-11-12 12:08:13.047777","mapping_epoch":591,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":592,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:29.446679","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:06:29.446679","last_clean_scrub_stamp":"2020-11-12 12:06:29.446679","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"606'930","reported_seq":"3709","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376799","last_change":"2020-11-12 12:07:45.132173","last_active":"2020-11-12 12:08:13.376799","last_peered":"2020-11-12 12:08:13.376799","last_clean":"2020-11-12 12:08:13.376799","last_became_active":"2020-11-12 12:07:44.583667","last_became_peered":"2020-11-12 12:07:44.583667","last_unstale":"2020-11-12 12:08:13.376799","last_undegraded":"2020-11-12 12:08:13.376799","last_fullsized":"2020-11-12 12:08:13.376799","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":930,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33313503,"num_objects":17,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":256,"num_read_kb":367173,"num_write":237,"num_write_kb":57709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":350399398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"46","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053762","last_change":"2020-11-12 12:07:35.980717","last_active":"2020-11-12 12:08:13.053762","last_peered":"2020-11-12 12:08:13.053762","last_clean":"2020-11-12 12:08:13.053762","last_became_active":"2020-11-12 12:07:35.977675","last_became_peered":"2020-11-12 12:07:35.977675","last_unstale":"2020-11-12 12:08:13.053762","last_undegraded":"2020-11-12 12:08:13.053762","last_fullsized":"2020-11-12 12:08:13.053762","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:28.871630","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:06:28.871630","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"606'846","reported_seq":"4089","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.046782","last_change":"2020-11-12 12:07:44.693996","last_active":"2020-11-12 12:08:13.046782","last_peered":"2020-11-12 12:08:13.046782","last_clean":"2020-11-12 12:08:13.046782","last_became_active":"2020-11-12 12:07:44.564657","last_became_peered":"2020-11-12 12:07:44.564657","last_unstale":"2020-11-12 12:08:13.046782","last_undegraded":"2020-11-12 12:08:13.046782","last_fullsized":"2020-11-12 12:08:13.046782","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46543737,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":151,"num_read_kb":169538,"num_write":238,"num_write_kb":60205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":496256418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"605'674","reported_seq":"3005","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053321","last_change":"2020-11-12 12:07:43.712637","last_active":"2020-11-12 12:08:13.053321","last_peered":"2020-11-12 12:08:13.053321","last_clean":"2020-11-12 12:08:13.053321","last_became_active":"2020-11-12 12:07:43.548419","last_became_peered":"2020-11-12 12:07:43.548419","last_unstale":"2020-11-12 12:08:13.053321","last_undegraded":"2020-11-12 12:08:13.053321","last_fullsized":"2020-11-12 12:08:13.053321","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":674,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38169296,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":114,"num_read_kb":131891,"num_write":165,"num_write_kb":37225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":225335475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"607'796","reported_seq":"4267","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148284","last_change":"2020-11-12 12:07:46.152581","last_active":"2020-11-12 12:08:13.148284","last_peered":"2020-11-12 12:08:13.148284","last_clean":"2020-11-12 12:08:13.148284","last_became_active":"2020-11-12 12:07:46.028375","last_became_peered":"2020-11-12 12:07:46.028375","last_unstale":"2020-11-12 12:08:13.148284","last_undegraded":"2020-11-12 12:08:13.148284","last_fullsized":"2020-11-12 12:08:13.148284","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27857526,"num_objects":19,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":183,"num_read_kb":219470,"num_write":240,"num_write_kb":56199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":578,"num_bytes_recovered":558493168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"607'559","reported_seq":"3316","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376918","last_change":"2020-11-12 12:07:45.654658","last_active":"2020-11-12 12:08:13.376918","last_peered":"2020-11-12 12:08:13.376918","last_clean":"2020-11-12 12:08:13.376918","last_became_active":"2020-11-12 12:07:45.564480","last_became_peered":"2020-11-12 12:07:45.564480","last_unstale":"2020-11-12 12:08:13.376918","last_undegraded":"2020-11-12 12:08:13.376918","last_fullsized":"2020-11-12 12:08:13.376918","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":559,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25883952,"num_objects":13,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":118,"num_read_kb":136818,"num_write":164,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":322062895,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"2143","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148442","last_change":"2020-11-12 12:07:43.587052","last_active":"2020-11-12 12:08:13.148442","last_peered":"2020-11-12 12:08:13.148442","last_clean":"2020-11-12 12:08:13.148442","last_became_active":"2020-11-12 12:07:43.547557","last_became_peered":"2020-11-12 12:07:43.547557","last_unstale":"2020-11-12 12:08:13.148442","last_undegraded":"2020-11-12 12:08:13.148442","last_fullsized":"2020-11-12 12:08:13.148442","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"605'367","reported_seq":"3037","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567889","last_change":"2020-11-12 12:07:43.624765","last_active":"2020-11-12 12:08:12.567889","last_peered":"2020-11-12 12:08:12.567889","last_clean":"2020-11-12 12:08:12.567889","last_became_active":"2020-11-12 12:07:43.545290","last_became_peered":"2020-11-12 12:07:43.545290","last_unstale":"2020-11-12 12:08:12.567889","last_undegraded":"2020-11-12 12:08:12.567889","last_fullsized":"2020-11-12 12:08:12.567889","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17515677,"num_objects":8,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":106,"num_read_kb":144046,"num_write":108,"num_write_kb":25330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":222679804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565510144,"data_stored":709827531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":580,"seq":2491081031699,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1110124,"kb_used_data":61540,"kb_used_omap":341,"kb_used_meta":1048234,"kb_avail":93261716,"statfs":{"total":96636764160,"available":95499997184,"internally_reserved":1073741824,"allocated":63016960,"data_stored":83410636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":349956,"internal_metadata":1073391868},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":7.3140000000000001,"5min":7.3140000000000001,"15min":7.3140000000000001},"min":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"max":{"1min":99.079999999999998,"5min":99.079999999999998,"15min":99.079999999999998},"last":2.25},{"interface":"front","average":{"1min":1.859,"5min":1.859,"15min":1.859},"min":{"1min":0.66800000000000004,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":2.843,"5min":2.843,"15min":2.843},"last":3.2839999999999998}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.198}]},{"osd":2,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":1.95,"5min":1.95,"15min":1.95},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.77600000000000002},"max":{"1min":2.7730000000000001,"5min":2.7730000000000001,"15min":2.7730000000000001},"last":2.1339999999999999},{"interface":"front","average":{"1min":49.286000000000001,"5min":49.286000000000001,"15min":49.286000000000001},"min":{"1min":0.75800000000000001,"5min":0.75800000000000001,"15min":0.75800000000000001},"max":{"1min":706.08500000000004,"5min":706.08500000000004,"15min":706.08500000000004},"last":2.2040000000000002}]},{"osd":3,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":8.4600000000000009,"5min":8.4600000000000009,"15min":8.4600000000000009},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":99.426000000000002,"5min":99.426000000000002,"15min":99.426000000000002},"last":2.851},{"interface":"front","average":{"1min":8.2059999999999995,"5min":8.2059999999999995,"15min":8.2059999999999995},"min":{"1min":1.272,"5min":1.272,"15min":1.272},"max":{"1min":98.793999999999997,"5min":98.793999999999997,"15min":98.793999999999997},"last":2.29}]},{"osd":4,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":2.101,"5min":2.101,"15min":2.101},"min":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"max":{"1min":2.9119999999999999,"5min":2.9119999999999999,"15min":2.9119999999999999},"last":3.3620000000000001},{"interface":"front","average":{"1min":8.1159999999999997,"5min":8.1159999999999997,"15min":8.1159999999999997},"min":{"1min":1.216,"5min":1.216,"15min":1.216},"max":{"1min":99.373000000000005,"5min":99.373000000000005,"15min":99.373000000000005},"last":2.7770000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.948}]},{"osd":6,"last update":"Thu Nov 12 12:08:03 2020","interfaces":[{"interface":"back","average":{"1min":8.3239999999999998,"5min":8.3239999999999998,"15min":8.3239999999999998},"min":{"1min":1.02,"5min":1.02,"15min":1.02},"max":{"1min":99.757999999999996,"5min":99.757999999999996,"15min":99.757999999999996},"last":3.649},{"interface":"front","average":{"1min":8.1349999999999998,"5min":8.1349999999999998,"15min":8.1349999999999998},"min":{"1min":1.2569999999999999,"5min":1.2569999999999999,"15min":1.2569999999999999},"max":{"1min":99.138999999999996,"5min":99.138999999999996,"15min":99.138999999999996},"last":2.6259999999999999}]}]},{"osd":6,"up_from":559,"seq":2400886718488,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118092,"kb_used_data":69508,"kb_used_omap":353,"kb_used_meta":1048222,"kb_avail":93253748,"statfs":{"total":96636764160,"available":95491837952,"internally_reserved":1073741824,"allocated":71176192,"data_stored":96297885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361858,"internal_metadata":1073379966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":19.876000000000001,"5min":19.876000000000001,"15min":19.876000000000001},"min":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"max":{"1min":348.53300000000002,"5min":348.53300000000002,"15min":348.53300000000002},"last":1.579},{"interface":"front","average":{"1min":1.478,"5min":1.478,"15min":1.478},"min":{"1min":0.996,"5min":0.996,"15min":0.996},"max":{"1min":2.6230000000000002,"5min":2.6230000000000002,"15min":2.6230000000000002},"last":1.95}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.8500000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":1.772,"5min":1.772,"15min":1.772},"min":{"1min":0.94999999999999996,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":2.9689999999999999,"5min":2.9689999999999999,"15min":2.9689999999999999},"last":1.621},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.8100000000000001,"15min":1.8100000000000001},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":2.984,"5min":2.984,"15min":2.984},"last":2.0350000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":1.877,"5min":1.877,"15min":1.877},"min":{"1min":1.139,"5min":1.139,"15min":1.139},"max":{"1min":3.9329999999999998,"5min":3.9329999999999998,"15min":3.9329999999999998},"last":2.8900000000000001},{"interface":"front","average":{"1min":1.982,"5min":1.982,"15min":1.982},"min":{"1min":0.873,"5min":0.873,"15min":0.873},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":2.6589999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":9.4610000000000003,"5min":9.4610000000000003,"15min":9.4610000000000003},"min":{"1min":0.86899999999999999,"5min":0.86899999999999999,"15min":0.86899999999999999},"max":{"1min":85.281000000000006,"5min":85.281000000000006,"15min":85.281000000000006},"last":2.7679999999999998},{"interface":"front","average":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":2.0059999999999998},"min":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":2.79,"5min":2.79,"15min":2.79},"last":1.909}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.9300000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.448,"5min":2.448,"15min":2.448},"min":{"1min":1.5069999999999999,"5min":1.5069999999999999,"15min":1.5069999999999999},"max":{"1min":3.5030000000000001,"5min":3.5030000000000001,"15min":3.5030000000000001},"last":2.4900000000000002},{"interface":"front","average":{"1min":2.544,"5min":2.544,"15min":2.544},"min":{"1min":1.4530000000000001,"5min":1.4530000000000001,"15min":1.4530000000000001},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":3.1869999999999998}]}]},{"osd":5,"up_from":601,"seq":2581275344907,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1134676,"kb_used_data":86092,"kb_used_omap":333,"kb_used_meta":1048242,"kb_avail":93237164,"statfs":{"total":96636764160,"available":95474855936,"internally_reserved":1073741824,"allocated":88158208,"data_stored":123673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341564,"internal_metadata":1073400260},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7509999999999999}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.9419999999999999}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.746}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.798}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.556}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":69.540999999999997}]}]},{"osd":4,"up_from":391,"seq":1679332212795,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1157624,"kb_used_data":109040,"kb_used_omap":102,"kb_used_meta":1048473,"kb_avail":93214216,"statfs":{"total":96636764160,"available":95451357184,"internally_reserved":1073741824,"allocated":111656960,"data_stored":107806845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104910,"internal_metadata":1073636914},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.8360000000000001,"5min":10.739000000000001,"15min":5.0789999999999997},"min":{"1min":1.0109999999999999,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":3.5600000000000001,"5min":488.81999999999999,"15min":488.81999999999999},"last":1.9239999999999999},{"interface":"front","average":{"1min":78.942999999999998,"5min":17.462,"15min":7.1600000000000001},"min":{"1min":0.99399999999999999,"5min":0.91600000000000004,"15min":0.91600000000000004},"max":{"1min":807.53499999999997,"5min":807.53499999999997,"15min":807.53499999999997},"last":2.1600000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:06:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2959999999999998,"5min":2.3820000000000001,"15min":2.3500000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":6.444,"5min":8.9039999999999999,"15min":8.9039999999999999},"last":1.982},{"interface":"front","average":{"1min":42.069000000000003,"5min":10.15,"15min":4.782},"min":{"1min":0.98499999999999999,"5min":0.98499999999999999,"15min":0.98499999999999999},"max":{"1min":763.53800000000001,"5min":763.53800000000001,"15min":763.53800000000001},"last":2.085}]},{"osd":2,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.968,"5min":2.0760000000000001,"15min":2.0099999999999998},"min":{"1min":1.0129999999999999,"5min":0.752,"15min":0.752},"max":{"1min":3.1509999999999998,"5min":8.2639999999999993,"15min":8.2639999999999993},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.1600000000000001,"5min":14.77,"15min":25.498000000000001},"min":{"1min":1.5900000000000001,"5min":0.875,"15min":0.875},"max":{"1min":3.2549999999999999,"5min":514.11400000000003,"15min":514.11400000000003},"last":2.2309999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:07:52 2020","interfaces":[{"interface":"back","average":{"1min":1.9890000000000001,"5min":29.265999999999998,"15min":48.031999999999996},"min":{"1min":1.1739999999999999,"5min":1.0589999999999999,"15min":1.0589999999999999},"max":{"1min":2.75,"5min":994.74000000000001,"15min":994.74000000000001},"last":2.4049999999999998},{"interface":"front","average":{"1min":2.2949999999999999,"5min":2.5470000000000002,"15min":2.3180000000000001},"min":{"1min":1.556,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":4.7400000000000002,"5min":39.203000000000003,"15min":39.203000000000003},"last":2.359}]},{"osd":5,"last update":"Thu Nov 12 12:06:50 2020","interfaces":[{"interface":"back","average":{"1min":2.266,"5min":31.542000000000002,"15min":44.463999999999999},"min":{"1min":1.1679999999999999,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5139999999999998,"5min":874.86199999999997,"15min":874.86199999999997},"last":2.2879999999999998},{"interface":"front","average":{"1min":2.3959999999999999,"5min":7.7599999999999998,"15min":4.1580000000000004},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":4.7750000000000004,"5min":566.75599999999997,"15min":566.75599999999997},"last":3.2709999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:07:39 2020","interfaces":[{"interface":"back","average":{"1min":2.7930000000000001,"5min":2.7930000000000001,"15min":2.7930000000000001},"min":{"1min":0.79700000000000004,"5min":0.79700000000000004,"15min":0.79700000000000004},"max":{"1min":14.555999999999999,"5min":14.555999999999999,"15min":14.555999999999999},"last":3.3239999999999998},{"interface":"front","average":{"1min":2.3300000000000001,"5min":2.3300000000000001,"15min":2.3300000000000001},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":3.4239999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:08:01 2020","interfaces":[{"interface":"back","average":{"1min":3.4350000000000001,"5min":3.4350000000000001,"15min":3.4350000000000001},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"max":{"1min":24.954000000000001,"5min":24.954000000000001,"15min":24.954000000000001},"last":3.3570000000000002},{"interface":"front","average":{"1min":38.518000000000001,"5min":38.518000000000001,"15min":38.518000000000001},"min":{"1min":1.702,"5min":1.702,"15min":1.702},"max":{"1min":699.61099999999999,"5min":699.61099999999999,"15min":699.61099999999999},"last":2.452}]}]},{"osd":0,"up_from":245,"seq":1052266987609,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1115620,"kb_used_data":67036,"kb_used_omap":106,"kb_used_meta":1048469,"kb_avail":93256220,"statfs":{"total":96636764160,"available":95494369280,"internally_reserved":1073741824,"allocated":68644864,"data_stored":89861077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108685,"internal_metadata":1073633139},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":41.598999999999997,"5min":9.7609999999999992,"15min":4.3330000000000002},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":672.25900000000001,"5min":672.25900000000001,"15min":672.25900000000001},"last":1.7849999999999999},{"interface":"front","average":{"1min":2.1259999999999999,"5min":2.3660000000000001,"15min":1.9890000000000001},"min":{"1min":0.70799999999999996,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":5.5830000000000002,"5min":53.067999999999998,"15min":53.067999999999998},"last":2.2559999999999998}]},{"osd":2,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":1.7769999999999999,"5min":1.6459999999999999,"15min":6.4080000000000004},"min":{"1min":0.85599999999999998,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":2.6989999999999998,"5min":9.7680000000000007,"15min":452.94999999999999},"last":2.1589999999999998},{"interface":"front","average":{"1min":1.8360000000000001,"5min":8.6699999999999999,"15min":4.0919999999999996},"min":{"1min":0.88300000000000001,"5min":0.80800000000000005,"15min":0.80800000000000005},"max":{"1min":3.7480000000000002,"5min":346.39299999999997,"15min":346.39299999999997},"last":1.593}]},{"osd":3,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":8.4309999999999992,"15min":4.3170000000000002},"min":{"1min":0.93700000000000006,"5min":0.875,"15min":0.875},"max":{"1min":3.8039999999999998,"5min":504.71600000000001,"15min":504.71600000000001},"last":2.0960000000000001},{"interface":"front","average":{"1min":1.992,"5min":1.962,"15min":2.1850000000000001},"min":{"1min":0.96499999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":2.9199999999999999,"5min":3.9910000000000001,"15min":4.9349999999999996},"last":2.694}]},{"osd":4,"last update":"Thu Nov 12 12:07:51 2020","interfaces":[{"interface":"back","average":{"1min":2.2360000000000002,"5min":2.5699999999999998,"15min":2.653},"min":{"1min":1.5640000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":3.1230000000000002,"5min":6.7359999999999998,"15min":6.7359999999999998},"last":2.52},{"interface":"front","average":{"1min":49.655000000000001,"5min":11.961,"15min":5.5970000000000004},"min":{"1min":1.365,"5min":1.155,"15min":1.155},"max":{"1min":688.81700000000001,"5min":688.81700000000001,"15min":688.81700000000001},"last":2.4630000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":2.3239999999999998,"5min":18.879999999999999,"15min":7.952},"min":{"1min":1.1140000000000001,"5min":0.995,"15min":0.995},"max":{"1min":3.6749999999999998,"5min":994.72000000000003,"15min":994.72000000000003},"last":2.5750000000000002},{"interface":"front","average":{"1min":2.4390000000000001,"5min":2.5939999999999999,"15min":2.7879999999999998},"min":{"1min":1.143,"5min":1.143,"15min":1.143},"max":{"1min":3.7999999999999998,"5min":6.2990000000000004,"15min":6.2990000000000004},"last":2.4199999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:07:38 2020","interfaces":[{"interface":"back","average":{"1min":1.919,"5min":1.919,"15min":1.919},"min":{"1min":1.0820000000000001,"5min":1.0820000000000001,"15min":1.0820000000000001},"max":{"1min":2.625,"5min":2.625,"15min":2.625},"last":2.4969999999999999},{"interface":"front","average":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.0270000000000001},"min":{"1min":1.1879999999999999,"5min":1.1879999999999999,"15min":1.1879999999999999},"max":{"1min":3.1880000000000002,"5min":3.1880000000000002,"15min":3.1880000000000002},"last":2.6099999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:08:05 2020","interfaces":[{"interface":"back","average":{"1min":2.7040000000000002,"5min":2.7040000000000002,"15min":2.7040000000000002},"min":{"1min":1.7170000000000001,"5min":1.7170000000000001,"15min":1.7170000000000001},"max":{"1min":3.9359999999999999,"5min":3.9359999999999999,"15min":3.9359999999999999},"last":2.8769999999999998},{"interface":"front","average":{"1min":2.794,"5min":2.794,"15min":2.794},"min":{"1min":1.899,"5min":1.899,"15min":1.899},"max":{"1min":3.9689999999999999,"5min":3.9689999999999999,"15min":3.9689999999999999},"last":2.899}]}]},{"osd":1,"up_from":596,"seq":2559800508428,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102500,"kb_used_data":53916,"kb_used_omap":259,"kb_used_meta":1048316,"kb_avail":93269340,"statfs":{"total":96636764160,"available":95507804160,"internally_reserved":1073741824,"allocated":55209984,"data_stored":58313765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265441,"internal_metadata":1073476383},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.96799999999999997}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1640000000000001}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.1080000000000001}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.3280000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.3530000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.7749999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":2.4489999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574993,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118312,"kb_used_data":69728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253528,"statfs":{"total":96636764160,"available":95491612672,"internally_reserved":1073741824,"allocated":71401472,"data_stored":92861124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:07:31 2020","interfaces":[{"interface":"back","average":{"1min":26.920000000000002,"5min":6.9329999999999998,"15min":3.4769999999999999},"min":{"1min":0.68300000000000005,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":502.202,"5min":502.202,"15min":502.202},"last":2.6789999999999998},{"interface":"front","average":{"1min":26.835999999999999,"5min":17.888999999999999,"15min":7.0039999999999996},"min":{"1min":1.0369999999999999,"5min":0.66300000000000003,"15min":0.66300000000000003},"max":{"1min":502.17099999999999,"5min":991.13400000000001,"15min":991.13400000000001},"last":2.5390000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:07:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4329999999999998,"5min":16.178999999999998,"15min":16.425000000000001},"min":{"1min":0.746,"5min":0.746,"15min":0.745},"max":{"1min":7.3559999999999999,"5min":942.04200000000003,"15min":942.04200000000003},"last":1.536},{"interface":"front","average":{"1min":2.016,"5min":1.982,"15min":2.6589999999999998},"min":{"1min":0.75900000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":4.8550000000000004,"5min":4.8550000000000004,"15min":24.553999999999998},"last":1.0549999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:08:09 2020","interfaces":[{"interface":"back","average":{"1min":1.9019999999999999,"5min":7.8150000000000004,"15min":4.5190000000000001},"min":{"1min":0.91600000000000004,"5min":0.628,"15min":0.628},"max":{"1min":5.6379999999999999,"5min":542.86500000000001,"15min":542.86500000000001},"last":1.2410000000000001},{"interface":"front","average":{"1min":5.9299999999999997,"5min":20.946000000000002,"15min":12.846},"min":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.68500000000000005},"max":{"1min":84.096999999999994,"5min":891.42700000000002,"15min":952.51499999999999},"last":2.2229999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:07:47 2020","interfaces":[{"interface":"back","average":{"1min":2.0899999999999999,"5min":2.125,"15min":2.0569999999999999},"min":{"1min":1.3939999999999999,"5min":0.96099999999999997,"15min":0.96099999999999997},"max":{"1min":3.5960000000000001,"5min":5.3769999999999998,"15min":5.3769999999999998},"last":2.6059999999999999},{"interface":"front","average":{"1min":2.1539999999999999,"5min":2.3159999999999998,"15min":2.4199999999999999},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":4.46,"5min":4.907,"15min":4.907},"last":2.1890000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:06:06 2020","interfaces":[{"interface":"back","average":{"1min":2.4830000000000001,"5min":12.215999999999999,"15min":13.023},"min":{"1min":1.1970000000000001,"5min":1.1970000000000001,"15min":1.1970000000000001},"max":{"1min":5.202,"5min":505.05900000000003,"15min":694.89999999999998},"last":2.2850000000000001},{"interface":"front","average":{"1min":2.5419999999999998,"5min":2.5870000000000002,"15min":3.2709999999999999},"min":{"1min":1.2130000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"max":{"1min":4.1710000000000003,"5min":4.9569999999999999,"15min":25.744},"last":2.0310000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:07:37 2020","interfaces":[{"interface":"back","average":{"1min":2.339,"5min":2.339,"15min":2.339},"min":{"1min":1.4690000000000001,"5min":1.4690000000000001,"15min":1.4690000000000001},"max":{"1min":4.673,"5min":4.673,"15min":4.673},"last":3.234},{"interface":"front","average":{"1min":2.0329999999999999,"5min":2.0329999999999999,"15min":2.0329999999999999},"min":{"1min":1.2529999999999999,"5min":1.2529999999999999,"15min":1.2529999999999999},"max":{"1min":3.7850000000000001,"5min":3.7850000000000001,"15min":3.7850000000000001},"last":2.069}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.6520000000000001,"5min":2.6520000000000001,"15min":2.6520000000000001},"min":{"1min":1.8600000000000001,"5min":1.8600000000000001,"15min":1.8600000000000001},"max":{"1min":4.6589999999999998,"5min":4.6589999999999998,"15min":4.6589999999999998},"last":3.1909999999999998},{"interface":"front","average":{"1min":2.71,"5min":2.71,"15min":2.71},"min":{"1min":1.7709999999999999,"5min":1.7709999999999999,"15min":1.7709999999999999},"max":{"1min":4.5439999999999996,"5min":4.5439999999999996,"15min":4.5439999999999996},"last":2.4750000000000001}]}]},{"osd":3,"up_from":13,"seq":55834574992,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":97589153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:08:25 2020","interfaces":[{"interface":"back","average":{"1min":2.0379999999999998,"5min":12.253,"15min":5.5800000000000001},"min":{"1min":0.90800000000000003,"5min":0.64400000000000002,"15min":0.63900000000000001},"max":{"1min":3.6949999999999998,"5min":878.05899999999997,"15min":878.05899999999997},"last":2.0350000000000001},{"interface":"front","average":{"1min":2.1299999999999999,"5min":5.484,"15min":3.1499999999999999},"min":{"1min":1.0329999999999999,"5min":0.745,"15min":0.745},"max":{"1min":3.7719999999999998,"5min":366.03699999999998,"15min":366.03699999999998},"last":1.982}]},{"osd":1,"last update":"Thu Nov 12 12:06:54 2020","interfaces":[{"interface":"back","average":{"1min":2.0329999999999999,"5min":9.7279999999999998,"15min":4.3680000000000003},"min":{"1min":0.96399999999999997,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":3.472,"5min":718.05899999999997,"15min":718.05899999999997},"last":1.526},{"interface":"front","average":{"1min":1.6399999999999999,"5min":1.8620000000000001,"15min":2.1219999999999999},"min":{"1min":0.77100000000000002,"5min":0.72999999999999998,"15min":0.68500000000000005},"max":{"1min":2.7839999999999998,"5min":4.2690000000000001,"15min":5.125},"last":2.2120000000000002}]},{"osd":2,"last update":"Thu Nov 12 12:07:54 2020","interfaces":[{"interface":"back","average":{"1min":2.3490000000000002,"5min":2.4500000000000002,"15min":3.2210000000000001},"min":{"1min":1.206,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":3.0379999999999998,"5min":12.622,"15min":203.68299999999999},"last":2.0939999999999999},{"interface":"front","average":{"1min":1.887,"5min":10.071999999999999,"15min":5.2080000000000002},"min":{"1min":0.91700000000000004,"5min":0.65600000000000003,"15min":0.65600000000000003},"max":{"1min":2.863,"5min":513.51400000000001,"15min":513.51400000000001},"last":2.278}]},{"osd":4,"last update":"Thu Nov 12 12:07:50 2020","interfaces":[{"interface":"back","average":{"1min":1.9219999999999999,"5min":13.967000000000001,"15min":25.974},"min":{"1min":1.1719999999999999,"5min":0.81499999999999995,"15min":0.81499999999999995},"max":{"1min":2.9350000000000001,"5min":661.80200000000002,"15min":661.80200000000002},"last":2.6309999999999998},{"interface":"front","average":{"1min":2.5,"5min":8.5939999999999994,"15min":14.772},"min":{"1min":1.2669999999999999,"5min":1.028,"15min":1.028},"max":{"1min":3.7669999999999999,"5min":341.209,"15min":341.209},"last":3.1070000000000002}]},{"osd":5,"last update":"Thu Nov 12 12:05:53 2020","interfaces":[{"interface":"back","average":{"1min":2.1720000000000002,"5min":2.4220000000000002,"15min":13.692},"min":{"1min":1.1699999999999999,"5min":1.044,"15min":1.044},"max":{"1min":3.7330000000000001,"5min":4.4539999999999997,"15min":626.23000000000002},"last":3.048},{"interface":"front","average":{"1min":2.2690000000000001,"5min":2.415,"15min":2.456},"min":{"1min":1.2330000000000001,"5min":0.97899999999999998,"15min":0.97899999999999998},"max":{"1min":3.8279999999999998,"5min":5.2599999999999998,"15min":5.9889999999999999},"last":2.077}]},{"osd":6,"last update":"Thu Nov 12 12:07:41 2020","interfaces":[{"interface":"back","average":{"1min":54.368000000000002,"5min":54.368000000000002,"15min":54.368000000000002},"min":{"1min":1.375,"5min":1.375,"15min":1.375},"max":{"1min":941.26800000000003,"5min":941.26800000000003,"15min":941.26800000000003},"last":3.008},{"interface":"front","average":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"min":{"1min":1.3919999999999999,"5min":1.3919999999999999,"15min":1.3919999999999999},"max":{"1min":3.8570000000000002,"5min":3.8570000000000002,"15min":3.8570000000000002},"last":3.024}]},{"osd":7,"last update":"Thu Nov 12 12:08:02 2020","interfaces":[{"interface":"back","average":{"1min":2.673,"5min":2.673,"15min":2.673},"min":{"1min":1.911,"5min":1.911,"15min":1.911},"max":{"1min":3.903,"5min":3.903,"15min":3.903},"last":2.8149999999999999},{"interface":"front","average":{"1min":2.5249999999999999,"5min":2.5249999999999999,"15min":2.5249999999999999},"min":{"1min":1.728,"5min":1.728,"15min":1.728},"max":{"1min":3.5640000000000001,"5min":3.5640000000000001,"15min":3.5640000000000001},"last":2.8330000000000002}]}]}]}} Ignoring malparsed backtrace: 2020-11-12T12:08:40.601 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:40.602 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:40.602 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:10:02.981 7eff326d9700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:10:03.071 7eff326d9700 -1 WARNING: all dangerous and experimental features are enabled. , dumped all Ignoring malparsed backtrace: 2020-11-12T12:11:05.469 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:07:05.341782 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:05.469 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:05.470 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:11:18.897 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b , 2020-11-12 12:11:19.117 7f70b391a700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:11:19.197 7f70b391a700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:12:22.846 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:22.846 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-11-12T12:12:42.848 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json Ignoring malparsed backtrace: 2020-11-12 12:13:26.563 7f57dd282700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 1.7 on osd.1 to deep-scrub , 2020-11-12T12:13:26.862 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.4 Ignoring malparsed backtrace: 2020-11-12T12:14:01.024 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:01.025 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-12 12:07:44.529241 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=44, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:01.025 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:15:03.154 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:15:03.154 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:15:03.155 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:15:50.647 7f0048e4a700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:15:50.764 7f0048e4a700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.7s0 on osd.3 to deep-scrub Ignoring malparsed backtrace: 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:07:05.341782 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:41.169 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:17:43.327 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:43.328 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:43.328 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:18:14.146 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.0 , 2020-11-12 12:18:14.382 7fef50eef700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:18:14.479 7fef4b59e700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:19:21.510 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-12 12:06:50.045143 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=50, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:19:21.511 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:19:21.511 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-12 12:07:07.510477 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=7, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:20:23.654 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:23.655 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:23.655 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:20:38.083 7f5cd22b7700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.cs0 on osd.6 to deep-scrub , 2020-11-12T12:20:38.408 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.d Ignoring malparsed backtrace: 2020-11-12T12:22:01.408 INFO:teuthology.orchestra.run.smithi044.stdout: , 2020-11-12T12:22:01.424 INFO:teuthology.orchestra.run.smithi044.stdout:{"pg_ready":true,"pg_map":{"version":1381,"stamp":"2020-11-12 12:22:00.849563","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":9000640,"kb_used_data":611968,"kb_used_omap":1496,"kb_used_meta":8387111,"kb_avail":745974080,"statfs":{"total":773094113280,"available":763877457920,"internally_reserved":8589934592,"allocated":626655232,"data_stored":749813723,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1532414,"internal_metadata":8588402178},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004045"},"pg_stats":[{"pgid":"2.f","version":"605'975","reported_seq":"5179","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.048094","last_change":"2020-11-12 12:07:44.339133","last_active":"2020-11-12 12:08:13.048094","last_peered":"2020-11-12 12:08:13.048094","last_clean":"2020-11-12 12:08:13.048094","last_became_active":"2020-11-12 12:07:43.542344","last_became_peered":"2020-11-12 12:07:43.542344","last_unstale":"2020-11-12 12:08:13.048094","last_undegraded":"2020-11-12 12:08:13.048094","last_fullsized":"2020-11-12 12:08:13.048094","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":975,"ondisk_log_size":975,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":36964515,"num_objects":22,"num_object_clones":16,"num_object_copies":132,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":4,"num_read":222,"num_read_kb":276029,"num_write":279,"num_write_kb":64344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":804,"num_bytes_recovered":676764753,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"606'755","reported_seq":"3298","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053607","last_change":"2020-11-12 12:07:45.720783","last_active":"2020-11-12 12:08:13.053607","last_peered":"2020-11-12 12:08:13.053607","last_clean":"2020-11-12 12:08:13.053607","last_became_active":"2020-11-12 12:07:44.559898","last_became_peered":"2020-11-12 12:07:44.559898","last_unstale":"2020-11-12 12:08:13.053607","last_undegraded":"2020-11-12 12:08:13.053607","last_fullsized":"2020-11-12 12:08:13.053607","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":755,"ondisk_log_size":755,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":44542027,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":142,"num_read_kb":168636,"num_write":206,"num_write_kb":48990,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":256,"num_bytes_recovered":220359844,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"126","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.561197","last_change":"2020-11-12 12:07:34.980292","last_active":"2020-11-12 12:08:12.561197","last_peered":"2020-11-12 12:08:12.561197","last_clean":"2020-11-12 12:08:12.561197","last_became_active":"2020-11-12 12:07:34.979587","last_became_peered":"2020-11-12 12:07:34.979587","last_unstale":"2020-11-12 12:08:12.561197","last_undegraded":"2020-11-12 12:08:12.561197","last_fullsized":"2020-11-12 12:08:12.561197","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:50.045143","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:01:01.411425","last_clean_scrub_stamp":"2020-11-12 12:06:50.045143","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"607'1034","reported_seq":"4531","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567601","last_change":"2020-11-12 12:07:45.706465","last_active":"2020-11-12 12:08:12.567601","last_peered":"2020-11-12 12:08:12.567601","last_clean":"2020-11-12 12:08:12.567601","last_became_active":"2020-11-12 12:07:45.566064","last_became_peered":"2020-11-12 12:07:45.566064","last_unstale":"2020-11-12 12:08:12.567601","last_undegraded":"2020-11-12 12:08:12.567601","last_fullsized":"2020-11-12 12:08:12.567601","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":1034,"ondisk_log_size":1034,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":63069801,"num_objects":33,"num_object_clones":27,"num_object_copies":198,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":227,"num_read_kb":245644,"num_write":327,"num_write_kb":79050,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":626,"num_bytes_recovered":710613985,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376795","last_change":"2020-11-12 12:07:07.510609","last_active":"2020-11-12 12:08:13.376795","last_peered":"2020-11-12 12:08:13.376795","last_clean":"2020-11-12 12:08:13.376795","last_became_active":"2020-11-12 12:06:38.531854","last_became_peered":"2020-11-12 12:06:38.531854","last_unstale":"2020-11-12 12:08:13.376795","last_undegraded":"2020-11-12 12:08:13.376795","last_fullsized":"2020-11-12 12:08:13.376795","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:07.510477","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:07:07.510477","last_clean_scrub_stamp":"2020-11-12 12:07:07.510477","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"605'571","reported_seq":"3045","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376977","last_change":"2020-11-12 12:07:44.295346","last_active":"2020-11-12 12:08:13.376977","last_peered":"2020-11-12 12:08:13.376977","last_clean":"2020-11-12 12:08:13.376977","last_became_active":"2020-11-12 12:07:43.546299","last_became_peered":"2020-11-12 12:07:43.546299","last_unstale":"2020-11-12 12:08:13.376977","last_undegraded":"2020-11-12 12:08:13.376977","last_fullsized":"2020-11-12 12:08:13.376977","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":571,"ondisk_log_size":571,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":41575305,"num_objects":15,"num_object_clones":12,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":110,"num_read_kb":112384,"num_write":178,"num_write_kb":39453,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":188,"num_bytes_recovered":214562650,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"631","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047347","last_change":"2020-11-12 12:07:05.341895","last_active":"2020-11-12 12:08:13.047347","last_peered":"2020-11-12 12:08:13.047347","last_clean":"2020-11-12 12:08:13.047347","last_became_active":"2020-11-12 12:06:37.605758","last_became_peered":"2020-11-12 12:06:37.605758","last_unstale":"2020-11-12 12:08:13.047347","last_undegraded":"2020-11-12 12:08:13.047347","last_fullsized":"2020-11-12 12:08:13.047347","mapping_epoch":559,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":560,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:05.341782","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:05.341782","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"605'852","reported_seq":"3625","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053157","last_change":"2020-11-12 12:07:43.726533","last_active":"2020-11-12 12:08:13.053157","last_peered":"2020-11-12 12:08:13.053157","last_clean":"2020-11-12 12:08:13.053157","last_became_active":"2020-11-12 12:07:43.552867","last_became_peered":"2020-11-12 12:07:43.552867","last_unstale":"2020-11-12 12:08:13.053157","last_undegraded":"2020-11-12 12:08:13.053157","last_fullsized":"2020-11-12 12:08:13.053157","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":852,"ondisk_log_size":852,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":40651861,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":3,"num_read":176,"num_read_kb":237784,"num_write":229,"num_write_kb":51463,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":336631858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"441","reported_epoch":"620","state":"active+clean","last_fresh":"2020-11-12 12:20:44.645575","last_change":"2020-11-12 12:20:44.645681","last_active":"2020-11-12 12:20:44.645575","last_peered":"2020-11-12 12:20:44.645575","last_clean":"2020-11-12 12:20:44.645575","last_became_active":"2020-11-12 12:07:02.730087","last_became_peered":"2020-11-12 12:07:02.730087","last_unstale":"2020-11-12 12:20:44.645575","last_undegraded":"2020-11-12 12:20:44.645575","last_fullsized":"2020-11-12 12:20:44.645575","mapping_epoch":580,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":581,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:20:44.645547","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:20:44.645547","last_clean_scrub_stamp":"2020-11-12 12:20:44.645547","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"605'787","reported_seq":"3194","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376911","last_change":"2020-11-12 12:07:43.680183","last_active":"2020-11-12 12:08:13.376911","last_peered":"2020-11-12 12:08:13.376911","last_clean":"2020-11-12 12:08:13.376911","last_became_active":"2020-11-12 12:07:43.540815","last_became_peered":"2020-11-12 12:07:43.540815","last_unstale":"2020-11-12 12:08:13.376911","last_undegraded":"2020-11-12 12:08:13.376911","last_fullsized":"2020-11-12 12:08:13.376911","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":787,"ondisk_log_size":787,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":43160093,"num_objects":20,"num_object_clones":17,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":1,"num_read":133,"num_read_kb":120761,"num_write":220,"num_write_kb":54232,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":167,"num_bytes_recovered":209150928,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"134","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.560847","last_change":"2020-11-12 12:07:44.529416","last_active":"2020-11-12 12:08:12.560847","last_peered":"2020-11-12 12:08:12.560847","last_clean":"2020-11-12 12:08:12.560847","last_became_active":"2020-11-12 12:07:40.996832","last_became_peered":"2020-11-12 12:07:40.996832","last_unstale":"2020-11-12 12:08:12.560847","last_undegraded":"2020-11-12 12:08:12.560847","last_fullsized":"2020-11-12 12:08:12.560847","mapping_epoch":601,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":602,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:44.529241","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:44.529241","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"607'461","reported_seq":"3496","reported_epoch":"619","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:08:13.376948","last_change":"2020-11-12 12:07:48.505159","last_active":"2020-11-12 12:08:13.376948","last_peered":"2020-11-12 12:08:13.376948","last_clean":"2020-11-12 12:08:13.376948","last_became_active":"2020-11-12 12:07:45.558646","last_became_peered":"2020-11-12 12:07:45.558646","last_unstale":"2020-11-12 12:08:13.376948","last_undegraded":"2020-11-12 12:08:13.376948","last_fullsized":"2020-11-12 12:08:13.376948","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":461,"ondisk_log_size":461,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":22082484,"num_objects":10,"num_object_clones":7,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":79,"num_read_kb":73364,"num_write":120,"num_write_kb":28596,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":285,"num_bytes_recovered":226411123,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"96","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376678","last_change":"2020-11-12 12:07:14.479425","last_active":"2020-11-12 12:08:13.376678","last_peered":"2020-11-12 12:08:13.376678","last_clean":"2020-11-12 12:08:13.376678","last_became_active":"2020-11-12 12:06:38.526587","last_became_peered":"2020-11-12 12:06:38.526587","last_unstale":"2020-11-12 12:08:13.376678","last_undegraded":"2020-11-12 12:08:13.376678","last_fullsized":"2020-11-12 12:08:13.376678","mapping_epoch":560,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":561,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:07:14.479334","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:07:14.479334","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"605'236","reported_seq":"2602","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376934","last_change":"2020-11-12 12:07:43.679033","last_active":"2020-11-12 12:08:13.376934","last_peered":"2020-11-12 12:08:13.376934","last_clean":"2020-11-12 12:08:13.376934","last_became_active":"2020-11-12 12:07:43.544179","last_became_peered":"2020-11-12 12:07:43.544179","last_unstale":"2020-11-12 12:08:13.376934","last_undegraded":"2020-11-12 12:08:13.376934","last_fullsized":"2020-11-12 12:08:13.376934","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":236,"ondisk_log_size":236,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8892018,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":52270,"num_write":58,"num_write_kb":14437,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":101718835,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1","version":"605'185","reported_seq":"2708","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.566247","last_change":"2020-11-12 12:07:43.627236","last_active":"2020-11-12 12:08:12.566247","last_peered":"2020-11-12 12:08:12.566247","last_clean":"2020-11-12 12:08:12.566247","last_became_active":"2020-11-12 12:07:43.549723","last_became_peered":"2020-11-12 12:07:43.549723","last_unstale":"2020-11-12 12:08:12.566247","last_undegraded":"2020-11-12 12:08:12.566247","last_fullsized":"2020-11-12 12:08:12.566247","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":185,"ondisk_log_size":185,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5743030,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":84824,"num_write":57,"num_write_kb":16290,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":142,"num_bytes_recovered":83699520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"242","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.047777","last_change":"2020-11-12 12:07:26.910728","last_active":"2020-11-12 12:08:13.047777","last_peered":"2020-11-12 12:08:13.047777","last_clean":"2020-11-12 12:08:13.047777","last_became_active":"2020-11-12 12:07:26.910195","last_became_peered":"2020-11-12 12:07:26.910195","last_unstale":"2020-11-12 12:08:13.047777","last_undegraded":"2020-11-12 12:08:13.047777","last_fullsized":"2020-11-12 12:08:13.047777","mapping_epoch":591,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":592,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:29.446679","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:06:29.446679","last_clean_scrub_stamp":"2020-11-12 12:06:29.446679","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"606'930","reported_seq":"3709","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376799","last_change":"2020-11-12 12:07:45.132173","last_active":"2020-11-12 12:08:13.376799","last_peered":"2020-11-12 12:08:13.376799","last_clean":"2020-11-12 12:08:13.376799","last_became_active":"2020-11-12 12:07:44.583667","last_became_peered":"2020-11-12 12:07:44.583667","last_unstale":"2020-11-12 12:08:13.376799","last_undegraded":"2020-11-12 12:08:13.376799","last_fullsized":"2020-11-12 12:08:13.376799","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":930,"ondisk_log_size":930,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":33313503,"num_objects":17,"num_object_clones":13,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":1,"num_read":256,"num_read_kb":367173,"num_write":237,"num_write_kb":57709,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":350399398,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"46","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053762","last_change":"2020-11-12 12:07:35.980717","last_active":"2020-11-12 12:08:13.053762","last_peered":"2020-11-12 12:08:13.053762","last_clean":"2020-11-12 12:08:13.053762","last_became_active":"2020-11-12 12:07:35.977675","last_became_peered":"2020-11-12 12:07:35.977675","last_unstale":"2020-11-12 12:08:13.053762","last_undegraded":"2020-11-12 12:08:13.053762","last_fullsized":"2020-11-12 12:08:13.053762","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:28.871630","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:47.143605","last_clean_scrub_stamp":"2020-11-12 12:06:28.871630","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"606'846","reported_seq":"4089","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.046782","last_change":"2020-11-12 12:07:44.693996","last_active":"2020-11-12 12:08:13.046782","last_peered":"2020-11-12 12:08:13.046782","last_clean":"2020-11-12 12:08:13.046782","last_became_active":"2020-11-12 12:07:44.564657","last_became_peered":"2020-11-12 12:07:44.564657","last_unstale":"2020-11-12 12:08:13.046782","last_undegraded":"2020-11-12 12:08:13.046782","last_fullsized":"2020-11-12 12:08:13.046782","mapping_epoch":605,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":606,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":846,"ondisk_log_size":846,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":46543737,"num_objects":21,"num_object_clones":17,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":1,"num_read":151,"num_read_kb":169538,"num_write":238,"num_write_kb":60205,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":491,"num_bytes_recovered":496256418,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.9","version":"605'674","reported_seq":"3005","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.053321","last_change":"2020-11-12 12:07:43.712637","last_active":"2020-11-12 12:08:13.053321","last_peered":"2020-11-12 12:08:13.053321","last_clean":"2020-11-12 12:08:13.053321","last_became_active":"2020-11-12 12:07:43.548419","last_became_peered":"2020-11-12 12:07:43.548419","last_unstale":"2020-11-12 12:08:13.053321","last_undegraded":"2020-11-12 12:08:13.053321","last_fullsized":"2020-11-12 12:08:13.053321","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":674,"ondisk_log_size":674,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":38169296,"num_objects":19,"num_object_clones":16,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":114,"num_read_kb":131891,"num_write":165,"num_write_kb":37225,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":225335475,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.a","version":"607'796","reported_seq":"4267","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148284","last_change":"2020-11-12 12:07:46.152581","last_active":"2020-11-12 12:08:13.148284","last_peered":"2020-11-12 12:08:13.148284","last_clean":"2020-11-12 12:08:13.148284","last_became_active":"2020-11-12 12:07:46.028375","last_became_peered":"2020-11-12 12:07:46.028375","last_unstale":"2020-11-12 12:08:13.148284","last_undegraded":"2020-11-12 12:08:13.148284","last_fullsized":"2020-11-12 12:08:13.148284","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":796,"ondisk_log_size":796,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":27857526,"num_objects":19,"num_object_clones":15,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":1,"num_read":183,"num_read_kb":219470,"num_write":240,"num_write_kb":56199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":578,"num_bytes_recovered":558493168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"607'559","reported_seq":"3316","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.376918","last_change":"2020-11-12 12:07:45.654658","last_active":"2020-11-12 12:08:13.376918","last_peered":"2020-11-12 12:08:13.376918","last_clean":"2020-11-12 12:08:13.376918","last_became_active":"2020-11-12 12:07:45.564480","last_became_peered":"2020-11-12 12:07:45.564480","last_unstale":"2020-11-12 12:08:13.376918","last_undegraded":"2020-11-12 12:08:13.376918","last_fullsized":"2020-11-12 12:08:13.376918","mapping_epoch":606,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":607,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":559,"ondisk_log_size":559,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25883952,"num_objects":13,"num_object_clones":10,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":118,"num_read_kb":136818,"num_write":164,"num_write_kb":40472,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":277,"num_bytes_recovered":322062895,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":"2143","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:13.148442","last_change":"2020-11-12 12:07:43.587052","last_active":"2020-11-12 12:08:13.148442","last_peered":"2020-11-12 12:08:13.148442","last_clean":"2020-11-12 12:08:13.148442","last_became_active":"2020-11-12 12:07:43.547557","last_became_peered":"2020-11-12 12:07:43.547557","last_unstale":"2020-11-12 12:08:13.148442","last_undegraded":"2020-11-12 12:08:13.148442","last_fullsized":"2020-11-12 12:08:13.148442","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.d","version":"605'367","reported_seq":"3037","reported_epoch":"619","state":"active+clean","last_fresh":"2020-11-12 12:08:12.567889","last_change":"2020-11-12 12:07:43.624765","last_active":"2020-11-12 12:08:12.567889","last_peered":"2020-11-12 12:08:12.567889","last_clean":"2020-11-12 12:08:12.567889","last_became_active":"2020-11-12 12:07:43.545290","last_became_peered":"2020-11-12 12:07:43.545290","last_unstale":"2020-11-12 12:08:12.567889","last_undegraded":"2020-11-12 12:08:12.567889","last_fullsized":"2020-11-12 12:08:12.567889","mapping_epoch":604,"log_start":"0'0","ondisk_log_start":"0'0","created":21,"last_epoch_clean":605,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:14.784998","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:57:14.784998","last_clean_scrub_stamp":"2020-11-12 11:57:14.784998","log_size":367,"ondisk_log_size":367,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":17515677,"num_objects":8,"num_object_clones":6,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":106,"num_read_kb":144046,"num_write":108,"num_write_kb":25330,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":221,"num_bytes_recovered":222679804,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":495964825,"num_objects":244,"num_object_clones":194,"num_object_copies":1464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":244,"num_whiteouts":16,"num_read":2124,"num_read_kb":2540632,"num_write":2826,"num_write_kb":673995,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4957,"num_bytes_recovered":4955140654,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":565510144,"data_stored":709827531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10028,"ondisk_log_size":10028,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":580,"seq":2491081031861,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1110124,"kb_used_data":61540,"kb_used_omap":341,"kb_used_meta":1048234,"kb_avail":93261716,"statfs":{"total":96636764160,"available":95499997184,"internally_reserved":1073741824,"allocated":63016960,"data_stored":83410636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":349956,"internal_metadata":1073391868},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.0960000000000001,"5min":3.028,"15min":5.2709999999999999},"min":{"1min":1.4390000000000001,"5min":1.2649999999999999,"15min":0.77200000000000002},"max":{"1min":2.8799999999999999,"5min":80.197000000000003,"15min":578.29399999999998},"last":1.6950000000000001},{"interface":"front","average":{"1min":2.3370000000000002,"5min":2.5019999999999998,"15min":7.5540000000000003},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":0.66800000000000004},"max":{"1min":3.4900000000000002,"5min":5.1509999999999998,"15min":794.80100000000004},"last":1.79}]},{"osd":1,"last update":"Thu Nov 12 12:21:04 2020","interfaces":[{"interface":"back","average":{"1min":2.109,"5min":15.01,"15min":6.7469999999999999},"min":{"1min":1.3959999999999999,"5min":1.3129999999999999,"15min":0.64200000000000002},"max":{"1min":2.9689999999999999,"5min":963.428,"15min":963.428},"last":3.3359999999999999},{"interface":"front","average":{"1min":3.8479999999999999,"5min":8.9949999999999992,"15min":5.2290000000000001},"min":{"1min":1.1830000000000001,"5min":1.1830000000000001,"15min":0.69899999999999995},"max":{"1min":24.513999999999999,"5min":503.04300000000001,"15min":503.04300000000001},"last":2.0299999999999998}]},{"osd":2,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.839,"5min":2.952,"15min":5.7800000000000002},"min":{"1min":1.9970000000000001,"5min":1.9970000000000001,"15min":0.77600000000000002},"max":{"1min":3.6829999999999998,"5min":5.2009999999999996,"15min":514.13499999999999},"last":2.5739999999999998},{"interface":"front","average":{"1min":3.004,"5min":3.0609999999999999,"15min":9.1950000000000003},"min":{"1min":2.4510000000000001,"5min":2.2909999999999999,"15min":0.75800000000000001},"max":{"1min":3.7160000000000002,"5min":5.2409999999999997,"15min":706.08500000000004},"last":2.6070000000000002}]},{"osd":3,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.714,"5min":2.7290000000000001,"15min":4.5330000000000004},"min":{"1min":1.782,"5min":1.6100000000000001,"15min":1.1930000000000001},"max":{"1min":3.238,"5min":4.7190000000000003,"15min":198.44300000000001},"last":3.3980000000000001},{"interface":"front","average":{"1min":2.8029999999999999,"5min":8.2970000000000006,"15min":9.8409999999999993},"min":{"1min":1.819,"5min":1.776,"15min":1.272},"max":{"1min":3.3149999999999999,"5min":270.86700000000002,"15min":995.274},"last":3.4489999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":2.8050000000000002,"5min":2.7730000000000001,"15min":2.669},"min":{"1min":1.55,"5min":1.55,"15min":0.83199999999999996},"max":{"1min":3.617,"5min":4.3520000000000003,"15min":4.9290000000000003},"last":2.0859999999999999},{"interface":"front","average":{"1min":2.9700000000000002,"5min":10.747999999999999,"15min":9.5129999999999999},"min":{"1min":1.964,"5min":1.871,"15min":1.216},"max":{"1min":3.7970000000000002,"5min":494.08800000000002,"15min":893.58399999999995},"last":2.649}]},{"osd":5,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6640000000000001,"5min":8.7230000000000008,"15min":5.6319999999999997},"min":{"1min":1.722,"5min":1.722,"15min":0.996},"max":{"1min":3.2280000000000002,"5min":781.50199999999995,"15min":781.50199999999995},"last":3.1970000000000001},{"interface":"front","average":{"1min":3.1309999999999998,"5min":3.1619999999999999,"15min":11.958},"min":{"1min":2.4740000000000002,"5min":2.2189999999999999,"15min":1.4490000000000001},"max":{"1min":3.9500000000000002,"5min":5.282,"15min":946.62800000000004},"last":2.867}]},{"osd":6,"last update":"Thu Nov 12 12:21:23 2020","interfaces":[{"interface":"back","average":{"1min":53.386000000000003,"5min":20.541,"15min":9.2829999999999995},"min":{"1min":1.7629999999999999,"5min":1.542,"15min":1.02},"max":{"1min":771.18399999999997,"5min":771.18399999999997,"15min":771.18399999999997},"last":1.75},{"interface":"front","average":{"1min":2.9300000000000002,"5min":2.9390000000000001,"15min":3.6320000000000001},"min":{"1min":2.3799999999999999,"5min":1.9079999999999999,"15min":1.2569999999999999},"max":{"1min":3.4060000000000001,"5min":4.75,"15min":99.138999999999996},"last":3.2690000000000001}]}]},{"osd":6,"up_from":559,"seq":2400886718650,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118092,"kb_used_data":69508,"kb_used_omap":353,"kb_used_meta":1048222,"kb_avail":93253748,"statfs":{"total":96636764160,"available":95491837952,"internally_reserved":1073741824,"allocated":71176192,"data_stored":96297885,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":361858,"internal_metadata":1073379966},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":1.954,"5min":4.9470000000000001,"15min":10.51},"min":{"1min":0.92500000000000004,"5min":0.92500000000000004,"15min":0.74099999999999999},"max":{"1min":3.0569999999999999,"5min":322.50999999999999,"15min":779.93200000000002},"last":2.5569999999999999},{"interface":"front","average":{"1min":9.2080000000000002,"5min":16.710999999999999,"15min":8.6549999999999994},"min":{"1min":1.218,"5min":1.218,"15min":0.996},"max":{"1min":169.53100000000001,"5min":757.51700000000005,"15min":757.51700000000005},"last":1.7629999999999999}]},{"osd":1,"last update":"Thu Nov 12 12:21:15 2020","interfaces":[{"interface":"back","average":{"1min":2.423,"5min":4.9569999999999999,"15min":9.5760000000000005},"min":{"1min":1.7070000000000001,"5min":1.6160000000000001,"15min":1.327},"max":{"1min":2.964,"5min":308.35899999999998,"15min":892.83299999999997},"last":2.177},{"interface":"front","average":{"1min":2.7250000000000001,"5min":2.6640000000000001,"15min":5.9859999999999998},"min":{"1min":1.6539999999999999,"5min":1.573,"15min":1.0800000000000001},"max":{"1min":3.2959999999999998,"5min":3.609,"15min":855.77499999999998},"last":2.327}]},{"osd":2,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":30.806999999999999,"5min":12.675000000000001,"15min":9.7360000000000007},"min":{"1min":1.45,"5min":1.1799999999999999,"15min":0.76600000000000001},"max":{"1min":503.40800000000002,"5min":503.40800000000002,"15min":954.77599999999995},"last":1.7},{"interface":"front","average":{"1min":23.172000000000001,"5min":8.7880000000000003,"15min":5.3780000000000001},"min":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":0.92800000000000005},"max":{"1min":502.86900000000003,"5min":502.86900000000003,"15min":502.86900000000003},"last":1.8260000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":11.449999999999999,"15min":7.1360000000000001},"min":{"1min":1.5680000000000001,"5min":1.5680000000000001,"15min":1.139},"max":{"1min":3.403,"5min":502.762,"15min":502.762},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.7090000000000001,"5min":2.621,"15min":5.2380000000000004},"min":{"1min":1.6000000000000001,"5min":1.4930000000000001,"15min":0.873},"max":{"1min":3.4889999999999999,"5min":3.569,"15min":857.01900000000001},"last":1.9039999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.367,"5min":8.2059999999999995,"15min":13.836},"min":{"1min":1.609,"5min":1.609,"15min":0.86899999999999999},"max":{"1min":3.4510000000000001,"5min":483.43799999999999,"15min":981.596},"last":3.2759999999999998},{"interface":"front","average":{"1min":2.7919999999999998,"5min":2.6640000000000001,"15min":2.5619999999999998},"min":{"1min":2.02,"5min":1.476,"15min":0.80800000000000005},"max":{"1min":3.2269999999999999,"5min":3.5369999999999999,"15min":4.7519999999999998},"last":1.9630000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":30.065000000000001,"5min":8.4640000000000004,"15min":4.7699999999999996},"min":{"1min":2.2440000000000002,"5min":2.1150000000000002,"15min":1.2889999999999999},"max":{"1min":626.11800000000005,"5min":626.11800000000005,"15min":626.11800000000005},"last":2.6949999999999998},{"interface":"front","average":{"1min":3.0739999999999998,"5min":3.036,"15min":5.0570000000000004},"min":{"1min":2.3330000000000002,"5min":2.0979999999999999,"15min":1.4750000000000001},"max":{"1min":3.6930000000000001,"5min":4.1029999999999998,"15min":190.36000000000001},"last":2.633}]},{"osd":7,"last update":"Thu Nov 12 12:21:25 2020","interfaces":[{"interface":"back","average":{"1min":44.843000000000004,"5min":19.739000000000001,"15min":8.3789999999999996},"min":{"1min":2.028,"5min":1.8340000000000001,"15min":1.5069999999999999},"max":{"1min":886.11500000000001,"5min":886.11500000000001,"15min":886.11500000000001},"last":3.3290000000000002},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.75,"15min":4.4379999999999997},"min":{"1min":2.1880000000000002,"5min":1.8819999999999999,"15min":1.282},"max":{"1min":3.4910000000000001,"5min":3.7360000000000002,"15min":403.28500000000003},"last":3.198}]}]},{"osd":5,"up_from":601,"seq":2581275345072,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1134676,"kb_used_data":86092,"kb_used_omap":333,"kb_used_meta":1048242,"kb_avail":93237164,"statfs":{"total":96636764160,"available":95474855936,"internally_reserved":1073741824,"allocated":88158208,"data_stored":123673238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":341564,"internal_metadata":1073400260},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":71.390000000000001,"5min":18.588000000000001,"15min":10.76},"min":{"1min":1.2250000000000001,"5min":1.0269999999999999,"15min":0.92300000000000004},"max":{"1min":949.11800000000005,"5min":949.11800000000005,"15min":949.11800000000005},"last":1.306},{"interface":"front","average":{"1min":10.993,"5min":3.9060000000000001,"15min":4.9370000000000003},"min":{"1min":1.296,"5min":1.264,"15min":1.115},"max":{"1min":150.06700000000001,"5min":150.06700000000001,"15min":680.75099999999998},"last":4.3140000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:21:12 2020","interfaces":[{"interface":"back","average":{"1min":2.1930000000000001,"5min":2.238,"15min":4.7930000000000001},"min":{"1min":1.3120000000000001,"5min":1.2789999999999999,"15min":1.2789999999999999},"max":{"1min":3.2189999999999999,"5min":3.633,"15min":768.50300000000004},"last":2.5699999999999998},{"interface":"front","average":{"1min":59.518000000000001,"5min":13.85,"15min":7.0039999999999996},"min":{"1min":1.357,"5min":1.258,"15min":1.258},"max":{"1min":864.66999999999996,"5min":864.66999999999996,"15min":864.66999999999996},"last":2.4430000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.4529999999999998,"5min":7.9770000000000003,"15min":6.8780000000000001},"min":{"1min":1.7190000000000001,"5min":1.5660000000000001,"15min":1.167},"max":{"1min":3.2789999999999999,"5min":483.91899999999998,"15min":502.81400000000002},"last":2.9449999999999998},{"interface":"front","average":{"1min":2.6299999999999999,"5min":4.915,"15min":4.9050000000000002},"min":{"1min":1.956,"5min":1.772,"15min":1.3129999999999999},"max":{"1min":3.2599999999999998,"5min":276.31599999999997,"15min":503.221},"last":4.4119999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":2.536,"15min":8.5790000000000006},"min":{"1min":1.8939999999999999,"5min":1.3089999999999999,"15min":1.3089999999999999},"max":{"1min":3.3029999999999999,"5min":3.7879999999999998,"15min":852.14400000000001},"last":2.6480000000000001},{"interface":"front","average":{"1min":2.427,"5min":2.496,"15min":6.5019999999999998},"min":{"1min":1.7909999999999999,"5min":1.5600000000000001,"15min":1.5600000000000001},"max":{"1min":3.1259999999999999,"5min":3.4279999999999999,"15min":800.87099999999998},"last":4.4500000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.532,"5min":2.629,"15min":6.673},"min":{"1min":1.78,"5min":1.5840000000000001,"15min":1.5840000000000001},"max":{"1min":3.8580000000000001,"5min":3.8580000000000001,"15min":964.16600000000005},"last":2.5179999999999998},{"interface":"front","average":{"1min":2.5350000000000001,"5min":19.498000000000001,"15min":14.134},"min":{"1min":1.4690000000000001,"5min":1.4510000000000001,"15min":1.4510000000000001},"max":{"1min":3.198,"5min":947.64800000000002,"15min":947.64800000000002},"last":4.3719999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.6920000000000002,"5min":2.6480000000000001,"15min":3.4140000000000001},"min":{"1min":1.831,"5min":1.669,"15min":1.385},"max":{"1min":3.3420000000000001,"5min":3.7949999999999999,"15min":191.37799999999999},"last":2.8780000000000001},{"interface":"front","average":{"1min":2.8140000000000001,"5min":2.8410000000000002,"15min":6.3970000000000002},"min":{"1min":2.0059999999999998,"5min":2.0059999999999998,"15min":1.758},"max":{"1min":4.2789999999999999,"5min":4.2789999999999999,"15min":618.96500000000003},"last":3.0830000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:21:16 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":6.1639999999999997,"15min":20.687999999999999},"min":{"1min":1.8759999999999999,"5min":1.8759999999999999,"15min":1.508},"max":{"1min":3.79,"5min":403.16699999999997,"15min":973.43899999999996},"last":2.6459999999999999},{"interface":"front","average":{"1min":2.976,"5min":13.462,"15min":11.574999999999999},"min":{"1min":2.5539999999999998,"5min":2.1389999999999998,"15min":1.663},"max":{"1min":3.6459999999999999,"5min":902.87900000000002,"15min":902.87900000000002},"last":2.29}]}]},{"osd":4,"up_from":391,"seq":1679332212959,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1157624,"kb_used_data":109040,"kb_used_omap":102,"kb_used_meta":1048473,"kb_avail":93214216,"statfs":{"total":96636764160,"available":95451357184,"internally_reserved":1073741824,"allocated":111656960,"data_stored":107806845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":104910,"internal_metadata":1073636914},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.0659999999999998,"5min":12.178000000000001,"15min":5.5030000000000001},"min":{"1min":1.3400000000000001,"5min":1.3400000000000001,"15min":0.52500000000000002},"max":{"1min":3.069,"5min":411.19299999999998,"15min":411.19299999999998},"last":2.597},{"interface":"front","average":{"1min":2.0569999999999999,"5min":22.204000000000001,"15min":15.141999999999999},"min":{"1min":1.4430000000000001,"5min":1.2929999999999999,"15min":0.94099999999999995},"max":{"1min":3.1349999999999998,"5min":1440.327,"15min":1440.327},"last":2.5190000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:21:55 2020","interfaces":[{"interface":"back","average":{"1min":2.1629999999999998,"5min":2.2320000000000002,"15min":4.4870000000000001},"min":{"1min":1.397,"5min":1.264,"15min":1.1719999999999999},"max":{"1min":3.2679999999999998,"5min":3.847,"15min":652.88999999999999},"last":2.4660000000000002},{"interface":"front","average":{"1min":3.7290000000000001,"5min":2.4340000000000002,"15min":5.5830000000000002},"min":{"1min":1.2370000000000001,"5min":1.2370000000000001,"15min":1.153},"max":{"1min":35.875999999999998,"5min":35.875999999999998,"15min":944.33299999999997},"last":2.8029999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.4049999999999998,"5min":8.8260000000000005,"15min":4.6340000000000003},"min":{"1min":1.4470000000000001,"5min":1.4470000000000001,"15min":0.752},"max":{"1min":3.5150000000000001,"5min":551.68899999999996,"15min":551.68899999999996},"last":2.7109999999999999},{"interface":"front","average":{"1min":2.609,"5min":2.8610000000000002,"15min":2.71},"min":{"1min":1.671,"5min":1.671,"15min":0.875},"max":{"1min":3.5529999999999999,"5min":3.8300000000000001,"15min":3.883},"last":2.8420000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:21:28 2020","interfaces":[{"interface":"back","average":{"1min":36.609999999999999,"5min":9.3030000000000008,"15min":12.561999999999999},"min":{"1min":1.776,"5min":1.698,"15min":1.1739999999999999},"max":{"1min":653.18799999999999,"5min":653.18799999999999,"15min":859.346},"last":2.6640000000000001},{"interface":"front","average":{"1min":2.48,"5min":2.8820000000000001,"15min":6.1150000000000002},"min":{"1min":2.0800000000000001,"5min":1.653,"15min":0.83899999999999997},"max":{"1min":3.169,"5min":4.1280000000000001,"15min":503.52699999999999},"last":2.419}]},{"osd":5,"last update":"Thu Nov 12 12:21:14 2020","interfaces":[{"interface":"back","average":{"1min":2.7570000000000001,"5min":2.6240000000000001,"15min":4.1210000000000004},"min":{"1min":2.2069999999999999,"5min":1.716,"15min":1.589},"max":{"1min":3.238,"5min":4.056,"15min":576.83399999999995},"last":2.742},{"interface":"front","average":{"1min":20.073,"5min":12.494999999999999,"15min":8.0109999999999992},"min":{"1min":1.875,"5min":1.5960000000000001,"15min":1.5960000000000001},"max":{"1min":365.61500000000001,"5min":684.90800000000002,"15min":684.90800000000002},"last":2.5590000000000002}]},{"osd":6,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":2.7850000000000001,"5min":2.7389999999999999,"15min":5.1509999999999998},"min":{"1min":1.9630000000000001,"5min":1.9159999999999999,"15min":0.79700000000000004},"max":{"1min":3.3839999999999999,"5min":3.9860000000000002,"15min":596.68799999999999},"last":2.9009999999999998},{"interface":"front","average":{"1min":8.0250000000000004,"5min":3.8519999999999999,"15min":3.1869999999999998},"min":{"1min":2.0030000000000001,"5min":1.9630000000000001,"15min":1.097},"max":{"1min":115.961,"5min":115.961,"15min":115.961},"last":3.2879999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:21:18 2020","interfaces":[{"interface":"back","average":{"1min":2.73,"5min":12.087999999999999,"15min":12.523999999999999},"min":{"1min":2.0019999999999998,"5min":1.6830000000000001,"15min":1.3149999999999999},"max":{"1min":3.4620000000000002,"5min":503.88600000000002,"15min":962.88099999999997},"last":3.0550000000000002},{"interface":"front","average":{"1min":34.366,"5min":22.047000000000001,"15min":14.087999999999999},"min":{"1min":2.4569999999999999,"5min":1.996,"15min":1.3600000000000001},"max":{"1min":597.74800000000005,"5min":659.97199999999998,"15min":699.61099999999999},"last":3.0800000000000001}]}]},{"osd":0,"up_from":245,"seq":1052266987773,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1115620,"kb_used_data":67036,"kb_used_omap":106,"kb_used_meta":1048469,"kb_avail":93256220,"statfs":{"total":96636764160,"available":95494369280,"internally_reserved":1073741824,"allocated":68644864,"data_stored":89861077,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":108685,"internal_metadata":1073633139},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":17.526,"5min":5.4950000000000001,"15min":4.7249999999999996},"min":{"1min":1.173,"5min":1.173,"15min":0.94799999999999995},"max":{"1min":323.76999999999998,"5min":323.76999999999998,"15min":414.45699999999999},"last":3.1059999999999999},{"interface":"front","average":{"1min":1.7569999999999999,"5min":1.946,"15min":12.289999999999999},"min":{"1min":1.2290000000000001,"5min":1.2030000000000001,"15min":0.86899999999999999},"max":{"1min":2.4340000000000002,"5min":3.508,"15min":721.47000000000003},"last":2.2810000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:21:41 2020","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.7829999999999999,"15min":10.721},"min":{"1min":0.92100000000000004,"5min":0.92100000000000004,"15min":0.629},"max":{"1min":2.052,"5min":3.1579999999999999,"15min":941.245},"last":1.877},{"interface":"front","average":{"1min":1.8,"5min":2.3929999999999998,"15min":3.6320000000000001},"min":{"1min":1.071,"5min":1.071,"15min":0.80800000000000005},"max":{"1min":2.7000000000000002,"5min":4.4900000000000002,"15min":346.39299999999997},"last":2.0459999999999998}]},{"osd":3,"last update":"Thu Nov 12 12:21:41 2020","interfaces":[{"interface":"back","average":{"1min":1.7989999999999999,"5min":12.808,"15min":6.9340000000000002},"min":{"1min":1.1060000000000001,"5min":1.1060000000000001,"15min":0.875},"max":{"1min":2.706,"5min":406.66899999999998,"15min":406.66899999999998},"last":1.9830000000000001},{"interface":"front","average":{"1min":2.073,"5min":5.8300000000000001,"15min":3.5049999999999999},"min":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":0.66000000000000003},"max":{"1min":4.3879999999999999,"5min":205.96600000000001,"15min":205.96600000000001},"last":1.5669999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:21:22 2020","interfaces":[{"interface":"back","average":{"1min":2.8109999999999999,"5min":6.3869999999999996,"15min":9.923},"min":{"1min":2.0569999999999999,"5min":1.7909999999999999,"15min":1.2749999999999999},"max":{"1min":4.1619999999999999,"5min":355.63999999999999,"15min":855.26300000000003},"last":3.222},{"interface":"front","average":{"1min":2.7970000000000002,"5min":25.908999999999999,"15min":19.613},"min":{"1min":1.345,"5min":1.345,"15min":1.155},"max":{"1min":4.1020000000000003,"5min":677.99099999999999,"15min":1379.0840000000001},"last":2.782}]},{"osd":5,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.8730000000000002,"5min":2.851,"15min":4.4779999999999998},"min":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":1.5349999999999999},"max":{"1min":4.3399999999999999,"5min":4.5330000000000004,"15min":270.59300000000002},"last":3.0419999999999998},{"interface":"front","average":{"1min":3.125,"5min":6.7850000000000001,"15min":12.808999999999999},"min":{"1min":1.9730000000000001,"5min":1.925,"15min":1.4630000000000001},"max":{"1min":4.2830000000000004,"5min":353.98200000000003,"15min":558.88199999999995},"last":2.7429999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":3.141,"15min":6.2329999999999997},"min":{"1min":2.1139999999999999,"5min":1.788,"15min":1.0820000000000001},"max":{"1min":4.4550000000000001,"5min":4.4550000000000001,"15min":962.05700000000002},"last":3.1499999999999999},{"interface":"front","average":{"1min":3.2389999999999999,"5min":4.532,"15min":5.8209999999999997},"min":{"1min":2.1549999999999998,"5min":2.1040000000000001,"15min":1.071},"max":{"1min":4.5549999999999997,"5min":128.83099999999999,"15min":408.70999999999998},"last":3.1829999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:21:30 2020","interfaces":[{"interface":"back","average":{"1min":49.468000000000004,"5min":19.488,"15min":8.6349999999999998},"min":{"1min":1.8540000000000001,"5min":1.8540000000000001,"15min":1.7170000000000001},"max":{"1min":307.64299999999997,"5min":708.64599999999996,"15min":708.64599999999996},"last":2.8149999999999999},{"interface":"front","average":{"1min":3.0750000000000002,"5min":6.9489999999999998,"15min":9.9139999999999997},"min":{"1min":2.101,"5min":2.101,"15min":1.899},"max":{"1min":4.625,"5min":392.08100000000002,"15min":936.08799999999997},"last":2.8450000000000002}]}]},{"osd":1,"up_from":596,"seq":2559800508591,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1102500,"kb_used_data":53916,"kb_used_omap":259,"kb_used_meta":1048316,"kb_avail":93269340,"statfs":{"total":96636764160,"available":95507804160,"internally_reserved":1073741824,"allocated":55209984,"data_stored":58313765,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":265441,"internal_metadata":1073476383},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:05 2020","interfaces":[{"interface":"back","average":{"1min":2.278,"5min":2.2959999999999998,"15min":2.1699999999999999},"min":{"1min":1.502,"5min":1.006,"15min":0.84499999999999997},"max":{"1min":3.5499999999999998,"5min":4.1299999999999999,"15min":4.1299999999999999},"last":2.79},{"interface":"front","average":{"1min":1.988,"5min":4.008,"15min":4.2859999999999996},"min":{"1min":1.01,"5min":0.97899999999999998,"15min":0.82699999999999996},"max":{"1min":3.3130000000000002,"5min":186.274,"15min":418.93299999999999},"last":2.2629999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.5579999999999998,"5min":2.4460000000000002,"15min":4.7679999999999998},"min":{"1min":1.7210000000000001,"5min":1.048,"15min":0.73899999999999999},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":697.46699999999998},"last":1.919},{"interface":"front","average":{"1min":2.2970000000000002,"5min":12.449999999999999,"15min":5.7069999999999999},"min":{"1min":1.2330000000000001,"5min":1.2330000000000001,"15min":1.121},"max":{"1min":3.3780000000000001,"5min":952.149,"15min":952.149},"last":2.1850000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":1.899,"5min":1.9850000000000001,"15min":4.952},"min":{"1min":0.96799999999999997,"5min":0.95599999999999996,"15min":0.84199999999999997},"max":{"1min":2.7040000000000002,"5min":3.6989999999999998,"15min":745.18499999999995},"last":1.7809999999999999},{"interface":"front","average":{"1min":2.8210000000000002,"5min":2.7799999999999998,"15min":4.3979999999999997},"min":{"1min":1.55,"5min":1.1599999999999999,"15min":1.046},"max":{"1min":4.96,"5min":6.1619999999999999,"15min":556.56600000000003},"last":2.7360000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":2.9260000000000002,"5min":7.3369999999999997,"15min":7.4809999999999999},"min":{"1min":2.0219999999999998,"5min":1.306,"15min":1.2370000000000001},"max":{"1min":5.0789999999999997,"5min":296.50599999999997,"15min":907.37900000000002},"last":1.9630000000000001},{"interface":"front","average":{"1min":2.6379999999999999,"5min":9.0129999999999999,"15min":10.769},"min":{"1min":1.405,"5min":1.242,"15min":1.0369999999999999},"max":{"1min":4.7220000000000004,"5min":713.56299999999999,"15min":962.79999999999995},"last":3.153}]},{"osd":5,"last update":"Thu Nov 12 12:21:10 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":2.9159999999999999,"15min":11.224},"min":{"1min":1.4810000000000001,"5min":1.2350000000000001,"15min":1.2350000000000001},"max":{"1min":4.7999999999999998,"5min":4.7999999999999998,"15min":882.23599999999999},"last":3.0649999999999999},{"interface":"front","average":{"1min":3.1160000000000001,"5min":3.0419999999999998,"15min":2.9129999999999998},"min":{"1min":2.1110000000000002,"5min":1.349,"15min":1.349},"max":{"1min":5.1420000000000003,"5min":5.1420000000000003,"15min":5.1420000000000003},"last":2.8300000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:20:59 2020","interfaces":[{"interface":"back","average":{"1min":16.097999999999999,"5min":11.843,"15min":15.132},"min":{"1min":1.7789999999999999,"5min":1.6519999999999999,"15min":1.2270000000000001},"max":{"1min":248.56800000000001,"5min":703.36000000000001,"15min":712.46100000000001},"last":2.6499999999999999},{"interface":"front","average":{"1min":3.1520000000000001,"5min":10.99,"15min":11.157999999999999},"min":{"1min":2.262,"5min":1.758,"15min":1.2989999999999999},"max":{"1min":4.8879999999999999,"5min":862.61199999999997,"15min":862.61199999999997},"last":3.1920000000000002}]},{"osd":7,"last update":"Thu Nov 12 12:21:05 2020","interfaces":[{"interface":"back","average":{"1min":3.214,"5min":10.917,"15min":8.3499999999999996},"min":{"1min":2.1429999999999998,"5min":2.028,"15min":1.6140000000000001},"max":{"1min":5.226,"5min":889.41300000000001,"15min":889.41300000000001},"last":2.8650000000000002},{"interface":"front","average":{"1min":3.02,"5min":8.3350000000000009,"15min":8.1820000000000004},"min":{"1min":2.0139999999999998,"5min":1.7809999999999999,"15min":1.623},"max":{"1min":5.0279999999999996,"5min":590.93899999999996,"15min":910.41899999999998},"last":3.1160000000000001}]}]},{"osd":2,"up_from":13,"seq":55834575158,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1118312,"kb_used_data":69728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93253528,"statfs":{"total":96636764160,"available":95491612672,"internally_reserved":1073741824,"allocated":71401472,"data_stored":92861124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:20:56 2020","interfaces":[{"interface":"back","average":{"1min":6.3799999999999999,"5min":2.9380000000000002,"15min":7.702},"min":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.68300000000000005},"max":{"1min":101.264,"5min":101.264,"15min":910.56200000000001},"last":1.897},{"interface":"front","average":{"1min":2.3769999999999998,"5min":2.2490000000000001,"15min":5.0590000000000002},"min":{"1min":1.026,"5min":1.014,"15min":0.78100000000000003},"max":{"1min":3.2549999999999999,"5min":3.2549999999999999,"15min":502.17099999999999},"last":2.0219999999999998}]},{"osd":1,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":1.9490000000000001,"5min":6.6769999999999996,"15min":11.897},"min":{"1min":1.1759999999999999,"5min":0.88200000000000001,"15min":0.71899999999999997},"max":{"1min":3.1560000000000001,"5min":421.51299999999998,"15min":915.37400000000002},"last":2.2109999999999999},{"interface":"front","average":{"1min":2.2410000000000001,"5min":2.347,"15min":11.691000000000001},"min":{"1min":1.167,"5min":1.167,"15min":0.85599999999999998},"max":{"1min":3.3330000000000002,"5min":3.508,"15min":899.26800000000003},"last":2.6099999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:21:35 2020","interfaces":[{"interface":"back","average":{"1min":34.923999999999999,"5min":9.7409999999999997,"15min":9.2260000000000009},"min":{"1min":1.071,"5min":1.071,"15min":0.628},"max":{"1min":826.27700000000004,"5min":826.27700000000004,"15min":826.27700000000004},"last":2.3100000000000001},{"interface":"front","average":{"1min":2.1360000000000001,"5min":5.8239999999999998,"15min":5.7990000000000004},"min":{"1min":1.1759999999999999,"5min":1.1759999999999999,"15min":0.96899999999999997},"max":{"1min":3.5819999999999999,"5min":304.57100000000003,"15min":304.57100000000003},"last":2.157}]},{"osd":4,"last update":"Thu Nov 12 12:21:11 2020","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":2.516,"15min":4.7210000000000001},"min":{"1min":1.393,"5min":1.393,"15min":1.073},"max":{"1min":4.0419999999999998,"5min":4.0419999999999998,"15min":503.37},"last":2.7970000000000002},{"interface":"front","average":{"1min":50.110999999999997,"5min":15.205,"15min":9.9399999999999995},"min":{"1min":1.643,"5min":1.643,"15min":0.98299999999999998},"max":{"1min":518.65099999999995,"5min":518.65099999999995,"15min":518.65099999999995},"last":3.0009999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":2.5899999999999999,"5min":2.6760000000000002,"15min":2.7290000000000001},"min":{"1min":1.8260000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"max":{"1min":3.468,"5min":4.1840000000000002,"15min":4.2800000000000002},"last":2.7160000000000002},{"interface":"front","average":{"1min":31.562999999999999,"5min":8.5600000000000005,"15min":8.25},"min":{"1min":1.8560000000000001,"5min":1.6739999999999999,"15min":1.629},"max":{"1min":751.98500000000001,"5min":751.98500000000001,"15min":751.98500000000001},"last":3.0499999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:21:06 2020","interfaces":[{"interface":"back","average":{"1min":21.634,"5min":6.6269999999999998,"15min":4.0389999999999997},"min":{"1min":1.853,"5min":1.78,"15min":1.4690000000000001},"max":{"1min":512.71400000000006,"5min":512.71400000000006,"15min":512.71400000000006},"last":2.7629999999999999},{"interface":"front","average":{"1min":3.0129999999999999,"5min":2.7970000000000002,"15min":9.4619999999999997},"min":{"1min":1.474,"5min":1.474,"15min":1.2529999999999999},"max":{"1min":4.1120000000000001,"5min":4.1120000000000001,"15min":1001.212},"last":2.8420000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:21:29 2020","interfaces":[{"interface":"back","average":{"1min":3.0470000000000002,"5min":3.0800000000000001,"15min":3.0259999999999998},"min":{"1min":2.0510000000000002,"5min":2.0049999999999999,"15min":1.8600000000000001},"max":{"1min":4.2130000000000001,"5min":4.6219999999999999,"15min":4.827},"last":3.4710000000000001},{"interface":"front","average":{"1min":3.036,"5min":3.1120000000000001,"15min":6.1719999999999997},"min":{"1min":2.198,"5min":2.198,"15min":1.7709999999999999},"max":{"1min":5.0309999999999997,"5min":5.0309999999999997,"15min":612.13900000000001},"last":3.363}]}]},{"osd":3,"up_from":13,"seq":55834575154,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1143692,"kb_used_data":95108,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93228148,"statfs":{"total":96636764160,"available":95465623552,"internally_reserved":1073741824,"allocated":97390592,"data_stored":97589153,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:21:56 2020","interfaces":[{"interface":"back","average":{"1min":1.46,"5min":7.327,"15min":4.3019999999999996},"min":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.70699999999999996},"max":{"1min":2.2679999999999998,"5min":539.39700000000005,"15min":539.39700000000005},"last":2.1509999999999998},{"interface":"front","average":{"1min":2.1379999999999999,"5min":16.751000000000001,"15min":14.835000000000001},"min":{"1min":1.05,"5min":1.05,"15min":0.745},"max":{"1min":3.8039999999999998,"5min":897.51999999999998,"15min":897.51999999999998},"last":3.8039999999999998}]},{"osd":1,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":29.864000000000001,"5min":24.707999999999998,"15min":9.8190000000000008},"min":{"1min":1.3979999999999999,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":502.94499999999999,"5min":1000.314,"15min":1000.314},"last":1.7390000000000001},{"interface":"front","average":{"1min":54.143999999999998,"5min":13.034000000000001,"15min":6.0289999999999999},"min":{"1min":1.4319999999999999,"5min":1.4319999999999999,"15min":0.78000000000000003},"max":{"1min":504.43200000000002,"5min":504.43200000000002,"15min":504.43200000000002},"last":3.7120000000000002}]},{"osd":2,"last update":"Thu Nov 12 12:21:26 2020","interfaces":[{"interface":"back","average":{"1min":1.8420000000000001,"5min":2.2200000000000002,"15min":3.968},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":0.92700000000000005},"max":{"1min":2.379,"5min":4.1310000000000002,"15min":445.346},"last":2.2890000000000001},{"interface":"front","average":{"1min":25.465,"5min":13.157999999999999,"15min":6.1230000000000002},"min":{"1min":1.6000000000000001,"5min":1.6000000000000001,"15min":0.84899999999999998},"max":{"1min":367.471,"5min":367.471,"15min":367.471},"last":4.9409999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:21:21 2020","interfaces":[{"interface":"back","average":{"1min":2.331,"5min":11.834,"15min":11.029},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1},"max":{"1min":3.3420000000000001,"5min":931.26099999999997,"15min":931.26099999999997},"last":1.6879999999999999},{"interface":"front","average":{"1min":2.794,"5min":2.895,"15min":8.7699999999999996},"min":{"1min":1.6299999999999999,"5min":1.6299999999999999,"15min":1.2669999999999999},"max":{"1min":4.0069999999999997,"5min":5.1470000000000002,"15min":866.529},"last":3.8839999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:21:10 2020","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":2.7629999999999999,"15min":8.218},"min":{"1min":1.625,"5min":1.625,"15min":1.625},"max":{"1min":3.4409999999999998,"5min":4.1900000000000004,"15min":504.80799999999999},"last":1.798},{"interface":"front","average":{"1min":2.573,"5min":2.4889999999999999,"15min":7.4219999999999997},"min":{"1min":1.4950000000000001,"5min":1.4950000000000001,"15min":1.2829999999999999},"max":{"1min":3.165,"5min":3.4670000000000001,"15min":941.37300000000005},"last":2.0459999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:21:00 2020","interfaces":[{"interface":"back","average":{"1min":3.4590000000000001,"5min":11.211,"15min":14.042999999999999},"min":{"1min":2.7400000000000002,"5min":2.2799999999999998,"15min":1.375},"max":{"1min":4.7039999999999997,"5min":804.34000000000003,"15min":941.26800000000003},"last":3.96},{"interface":"front","average":{"1min":3.7429999999999999,"5min":20.917000000000002,"15min":14.537000000000001},"min":{"1min":2.7690000000000001,"5min":2.5579999999999998,"15min":1.3919999999999999},"max":{"1min":4.9429999999999996,"5min":653.09799999999996,"15min":967.322},"last":4.0270000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:21:26 2020","interfaces":[{"interface":"back","average":{"1min":3.5190000000000001,"5min":20.445,"15min":9.2970000000000006},"min":{"1min":2.306,"5min":2.306,"15min":1.911},"max":{"1min":4.8570000000000002,"5min":543.17899999999997,"15min":543.17899999999997},"last":4.0960000000000001},{"interface":"front","average":{"1min":3.5609999999999999,"5min":5.2130000000000001,"15min":5.8209999999999997},"min":{"1min":2.3410000000000002,"5min":2.3410000000000002,"15min":1.728},"max":{"1min":4.9219999999999997,"5min":143.191,"15min":529.88699999999994},"last":4.8550000000000004}]}]}]}} , 2020-11-12T12:22:01.427 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:22:45.426 INFO:teuthology.orchestra.run.smithi044:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.6 , 2020-11-12 12:22:45.689 7fa9064bd700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:22:45.801 7fa9064bd700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:06:29.446679 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:57:14.784998 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:23:18.230 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:06:28.871630 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=8, tm_sec=30, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:24:40.670 7f85eeff3700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:24:40.776 7f85eeff3700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T12:24:41.073 INFO:teuthology.orchestra.run.smithi044.stdout: Ignoring malparsed backtrace: 2020-11-12T12:24:41.759 INFO:teuthology.orchestra.run:waiting for 300 , 2020-11-12T12:24:41.821 INFO:tasks.ceph.mon.c:Stopped , 2020-11-12T12:24:41.822 DEBUG:tasks.ceph.mon.b:waiting for process to exit Ignoring malparsed backtrace: raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') , RuntimeError: Exiting scrub checking -- not all pgs scrubbed. , 2020-11-12T12:25:57.350 DEBUG:teuthology.run_tasks:Unwinding manager install Ignoring malparsed backtrace: cp: cannot stat ‘/usr/bin/ceph_test_rados.debug’: No such file or directory , 2020-11-12T12:26:22.255 DEBUG:teuthology.orchestra.run:got remote process result: 1 , 2020-11-12T12:26:22.256 ERROR:teuthology.run_tasks:Manager failed: internal.archive Ignoring malparsed backtrace: ceph version 14.2.11-111-g93c5d14 (93c5d149177634d9a3196c2990e4c0af398f8a4d) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7efdf91b3524] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x13e8) [0x55f297a4d378] Ignoring malparsed backtrace: 2020-11-12T12:06:46.351 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd primary-affinity 3 1 , 2020-11-12 12:06:46.511 7f8887450700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:06:46.600 7f8887450700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:07:02.495 INFO:tasks.ceph.ceph_manager.ceph:need seq 2070174236700 got 2070174236701 for osd.1 , 2020-11-12T12:07:02.496 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd last-stat-seq osd.2 , 2020-11-12 12:07:02.618 7f1cdaf55700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:07:07.592 INFO:teuthology.orchestra.run.smithi201.stdout: "addr": "172.21.15.58:6789/0", , 2020-11-12T12:07:07.592 INFO:teuthology.orchestra.run.smithi201.stdout: "public_addr": "172.21.15.58:6789/0" , 2020-11-12T12:07:07.593 INFO:teuthology.orchestra.run.smithi201.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:07.609 INFO:teuthology.orchestra.run.smithi201.stdout: "gid": 4110, , 2020-11-12T12:07:07.610 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "x", , 2020-11-12T12:07:07.610 INFO:teuthology.orchestra.run.smithi201.stdout: "available_modules": [ Ignoring malparsed backtrace: 2020-11-12T12:07:07.624 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "SMTP envelope sender", , 2020-11-12T12:07:07.624 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", , 2020-11-12T12:07:07.624 INFO:teuthology.orchestra.run.smithi201.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:07.638 INFO:teuthology.orchestra.run.smithi201.stdout: "error_string": "", , 2020-11-12T12:07:07.638 INFO:teuthology.orchestra.run.smithi201.stdout: "module_options": { , 2020-11-12T12:07:07.638 INFO:teuthology.orchestra.run.smithi201.stdout: "active": { Ignoring malparsed backtrace: 2020-11-12T12:07:07.658 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "end_weekday", , 2020-11-12T12:07:07.658 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "uint", , 2020-11-12T12:07:07.658 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:07.672 INFO:teuthology.orchestra.run.smithi201.stdout: } , 2020-11-12T12:07:07.672 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:07.672 INFO:teuthology.orchestra.run.smithi201.stdout: { Ignoring malparsed backtrace: 2020-11-12T12:07:07.686 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", , 2020-11-12T12:07:07.686 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, , 2020-11-12T12:07:07.686 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "True", Ignoring malparsed backtrace: 2020-11-12T12:07:07.700 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", , 2020-11-12T12:07:07.700 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "", , 2020-11-12T12:07:07.700 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:07.714 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "", , 2020-11-12T12:07:07.714 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", , 2020-11-12T12:07:07.715 INFO:teuthology.orchestra.run.smithi201.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:07.728 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:07.729 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:07.729 INFO:teuthology.orchestra.run.smithi201.stdout: "crt_file": { Ignoring malparsed backtrace: 2020-11-12T12:07:07.743 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "ssl", , 2020-11-12T12:07:07.743 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "bool", , 2020-11-12T12:07:07.743 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:07.757 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], , 2020-11-12T12:07:07.757 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "", , 2020-11-12T12:07:07.757 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:07.771 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 1, , 2020-11-12T12:07:07.771 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "15552000", , 2020-11-12T12:07:07.771 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:07.785 INFO:teuthology.orchestra.run.smithi201.stdout: "diskprediction_password": { , 2020-11-12T12:07:07.785 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "diskprediction_password", , 2020-11-12T12:07:07.785 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:07.799 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", , 2020-11-12T12:07:07.799 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, , 2020-11-12T12:07:07.800 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T12:07:07.814 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", , 2020-11-12T12:07:07.814 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "", , 2020-11-12T12:07:07.814 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:07.828 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "", , 2020-11-12T12:07:07.828 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", , 2020-11-12T12:07:07.828 INFO:teuthology.orchestra.run.smithi201.stdout: "tags": [], Ignoring malparsed backtrace: 2020-11-12T12:07:07.842 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "", , 2020-11-12T12:07:07.842 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], , 2020-11-12T12:07:07.842 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "CRUSH level for which to create a local pool", Ignoring malparsed backtrace: 2020-11-12T12:07:07.856 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", , 2020-11-12T12:07:07.856 INFO:teuthology.orchestra.run.smithi201.stdout: "tags": [], , 2020-11-12T12:07:07.856 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T12:07:07.870 INFO:teuthology.orchestra.run.smithi201.stdout: "server_addr": { , 2020-11-12T12:07:07.870 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "server_addr", , 2020-11-12T12:07:07.870 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:07.884 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, , 2020-11-12T12:07:07.884 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "", , 2020-11-12T12:07:07.884 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:07.898 INFO:teuthology.orchestra.run.smithi201.stdout: "inventory_cache_timeout_min": { , 2020-11-12T12:07:07.898 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "inventory_cache_timeout_min", , 2020-11-12T12:07:07.898 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:07.912 INFO:teuthology.orchestra.run.smithi201.stdout: "tags": [], , 2020-11-12T12:07:07.912 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:07.912 INFO:teuthology.orchestra.run.smithi201.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:07.926 INFO:teuthology.orchestra.run.smithi201.stdout: "last_opt_revision": { , 2020-11-12T12:07:07.926 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "last_opt_revision", , 2020-11-12T12:07:07.926 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "int", Ignoring malparsed backtrace: 2020-11-12T12:07:07.940 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:07.940 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:07.941 INFO:teuthology.orchestra.run.smithi201.stdout: "interval": { Ignoring malparsed backtrace: 2020-11-12T12:07:07.954 INFO:teuthology.orchestra.run.smithi201.stdout: "smtp_from_name": { , 2020-11-12T12:07:07.954 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "smtp_from_name", , 2020-11-12T12:07:07.955 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:07.968 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "ansible", , 2020-11-12T12:07:07.969 INFO:teuthology.orchestra.run.smithi201.stdout: "can_run": true, , 2020-11-12T12:07:07.969 INFO:teuthology.orchestra.run.smithi201.stdout: "error_string": "", Ignoring malparsed backtrace: 2020-11-12T12:07:07.982 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "0", , 2020-11-12T12:07:07.983 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "7", , 2020-11-12T12:07:07.983 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:08.001 INFO:teuthology.orchestra.run.smithi201.stdout: "crush-compat", , 2020-11-12T12:07:08.001 INFO:teuthology.orchestra.run.smithi201.stdout: "none", , 2020-11-12T12:07:08.001 INFO:teuthology.orchestra.run.smithi201.stdout: "upmap" Ignoring malparsed backtrace: 2020-11-12T12:07:08.015 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:08.015 INFO:teuthology.orchestra.run.smithi201.stdout: { , 2020-11-12T12:07:08.016 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "dashboard", Ignoring malparsed backtrace: 2020-11-12T12:07:08.029 INFO:teuthology.orchestra.run.smithi201.stdout: "tags": [], , 2020-11-12T12:07:08.029 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:08.030 INFO:teuthology.orchestra.run.smithi201.stdout: }, Ignoring malparsed backtrace: 2020-11-12T12:07:08.043 INFO:teuthology.orchestra.run.smithi201.stdout: "GRAFANA_UPDATE_DASHBOARDS": { , 2020-11-12T12:07:08.044 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "GRAFANA_UPDATE_DASHBOARDS", , 2020-11-12T12:07:08.044 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "bool", Ignoring malparsed backtrace: 2020-11-12T12:07:08.057 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", , 2020-11-12T12:07:08.058 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, , 2020-11-12T12:07:08.058 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "80", Ignoring malparsed backtrace: 2020-11-12T12:07:08.072 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", , 2020-11-12T12:07:08.072 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "", , 2020-11-12T12:07:08.072 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:08.086 INFO:teuthology.orchestra.run.smithi201.stdout: "error", , 2020-11-12T12:07:08.086 INFO:teuthology.orchestra.run.smithi201.stdout: "redirect" , 2020-11-12T12:07:08.086 INFO:teuthology.orchestra.run.smithi201.stdout: ], Ignoring malparsed backtrace: 2020-11-12T12:07:08.100 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", , 2020-11-12T12:07:08.100 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", , 2020-11-12T12:07:08.100 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T12:07:08.114 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:08.114 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:08.114 INFO:teuthology.orchestra.run.smithi201.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2020-11-12T12:07:08.128 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], , 2020-11-12T12:07:08.128 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "", , 2020-11-12T12:07:08.128 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:08.142 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, , 2020-11-12T12:07:08.142 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "86400", , 2020-11-12T12:07:08.142 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:08.156 INFO:teuthology.orchestra.run.smithi201.stdout: "port": { , 2020-11-12T12:07:08.156 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "port", , 2020-11-12T12:07:08.156 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", Ignoring malparsed backtrace: 2020-11-12T12:07:08.170 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:08.170 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:08.170 INFO:teuthology.orchestra.run.smithi201.stdout: "min_size": { Ignoring malparsed backtrace: 2020-11-12T12:07:08.184 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "sleep_interval", , 2020-11-12T12:07:08.184 INFO:teuthology.orchestra.run.smithi201.stdout: "type": "str", , 2020-11-12T12:07:08.184 INFO:teuthology.orchestra.run.smithi201.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T12:07:08.198 INFO:teuthology.orchestra.run.smithi201.stdout: "flags": 0, , 2020-11-12T12:07:08.198 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "", , 2020-11-12T12:07:08.199 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T12:07:08.212 INFO:teuthology.orchestra.run.smithi201.stdout: { , 2020-11-12T12:07:08.212 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "selftest", , 2020-11-12T12:07:08.212 INFO:teuthology.orchestra.run.smithi201.stdout: "can_run": true, Ignoring malparsed backtrace: 2020-11-12T12:07:08.226 INFO:teuthology.orchestra.run.smithi201.stdout: "see_also": [] , 2020-11-12T12:07:08.226 INFO:teuthology.orchestra.run.smithi201.stdout: }, , 2020-11-12T12:07:08.227 INFO:teuthology.orchestra.run.smithi201.stdout: "rwoption6": { Ignoring malparsed backtrace: 2020-11-12T12:07:08.240 INFO:teuthology.orchestra.run.smithi201.stdout: { , 2020-11-12T12:07:08.240 INFO:teuthology.orchestra.run.smithi201.stdout: "name": "telegraf", , 2020-11-12T12:07:08.240 INFO:teuthology.orchestra.run.smithi201.stdout: "can_run": true, Ignoring malparsed backtrace: 2020-11-12T12:07:08.254 INFO:teuthology.orchestra.run.smithi201.stdout: "default_value": "None", , 2020-11-12T12:07:08.254 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", , 2020-11-12T12:07:08.255 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T12:07:08.268 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], , 2020-11-12T12:07:08.268 INFO:teuthology.orchestra.run.smithi201.stdout: "desc": "", , 2020-11-12T12:07:08.268 INFO:teuthology.orchestra.run.smithi201.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T12:07:08.282 INFO:teuthology.orchestra.run.smithi201.stdout: "min": "", , 2020-11-12T12:07:08.282 INFO:teuthology.orchestra.run.smithi201.stdout: "max": "", , 2020-11-12T12:07:08.283 INFO:teuthology.orchestra.run.smithi201.stdout: "enum_allowed": [], Ignoring malparsed backtrace: 2020-11-12T12:07:15.025 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 3 , 2020-11-12 12:07:15.153 7f5e4a075700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:07:15.217 7f5e4a075700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:07:40.706 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. , 2020-11-12T12:08:00.713 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json , 2020-11-12 12:08:00.891 7f1c29807700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:09:03.442 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:09:03.443 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-12 12:02:25.312017 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=2, tm_sec=25, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:09:03.443 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:09:15.298 7f6689ae8700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.9s0 on osd.1 to deep-scrub , 2020-11-12T12:09:15.692 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.a Ignoring malparsed backtrace: 2020-11-12T12:10:20.091 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:10:20.091 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:00:19.403580 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:10:20.092 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:11:22.091 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:22.091 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:11:22.091 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.f Ignoring malparsed backtrace: 2020-11-12 12:11:55.591 7fbf2e4b4700 -1 WARNING: all dangerous and experimental features are enabled. , dumped all , 2020-11-12T12:11:55.930 INFO:teuthology.orchestra.run.smithi201.stdout: Ignoring malparsed backtrace: 2020-11-12T12:12:57.955 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-12 12:00:41.670756 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=0, tm_sec=41, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:57.955 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:57.956 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:00:53.527167 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=0, tm_sec=53, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: instructing pg 1.6 on osd.6 to deep-scrub , 2020-11-12T12:13:42.004 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.5 , 2020-11-12 12:13:42.115 7f7c725ec700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:14:15.641 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:03:58.903264 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=3, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:15.642 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:14:15.642 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:15:37.659 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json , 2020-11-12 12:15:37.878 7f87f65a6700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:15:37.958 7f87f65a6700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:16:05.422 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.0 , 2020-11-12 12:16:05.615 7fda1d983700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:16:05.731 7fda1d983700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:16:55.373 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:55.374 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-11-12 12:06:04.089323 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=6, tm_sec=4, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:16:55.374 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:17:57.342 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 12:00:19.403580 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=0, tm_sec=19, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:57.343 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:17:57.343 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 12:03:58.903264 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=3, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:18:27.291 7fc739982700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:18:27.366 7fc739982700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 1.2 on osd.7 to deep-scrub Ignoring malparsed backtrace: 2020-11-12T12:19:34.606 INFO:teuthology.orchestra.run.smithi201.stdout: , dumped all , 2020-11-12T12:19:34.622 INFO:teuthology.orchestra.run.smithi201.stdout:{"pg_ready":true,"pg_map":{"version":1297,"stamp":"2020-11-12 12:19:33.403347","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":337652132,"num_objects":157,"num_object_clones":108,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":14,"num_read":2750,"num_read_kb":3305717,"num_write":3475,"num_write_kb":832023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6177,"num_bytes_recovered":4618053809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11701,"ondisk_log_size":11701,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8846588,"kb_used_data":457916,"kb_used_omap":126,"kb_used_meta":8388481,"kb_avail":746128132,"statfs":{"total":773094113280,"available":764035207168,"internally_reserved":8589934592,"allocated":468905984,"data_stored":485696666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":129277,"internal_metadata":8589805315},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003924"},"pg_stats":[{"pgid":"2.f","version":"588'877","reported_seq":"4031","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.598146","last_change":"2020-11-12 12:06:42.317098","last_active":"2020-11-12 12:06:54.598146","last_peered":"2020-11-12 12:06:54.598146","last_clean":"2020-11-12 12:06:54.598146","last_became_active":"2020-11-12 12:06:42.313593","last_became_peered":"2020-11-12 12:06:42.313593","last_unstale":"2020-11-12 12:06:54.598146","last_undegraded":"2020-11-12 12:06:54.598146","last_fullsized":"2020-11-12 12:06:54.598146","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":877,"ondisk_log_size":877,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25319096,"num_objects":10,"num_object_clones":6,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":1,"num_read":164,"num_read_kb":187758,"num_write":246,"num_write_kb":60229,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":461,"num_bytes_recovered":382989491,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,1],"acting":[4,0,6,7,5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.e","version":"589'1055","reported_seq":"3964","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536966","last_change":"2020-11-12 12:06:44.252690","last_active":"2020-11-12 12:06:54.536966","last_peered":"2020-11-12 12:06:54.536966","last_clean":"2020-11-12 12:06:54.536966","last_became_active":"2020-11-12 12:06:44.249009","last_became_peered":"2020-11-12 12:06:44.249009","last_unstale":"2020-11-12 12:06:54.536966","last_undegraded":"2020-11-12 12:06:54.536966","last_fullsized":"2020-11-12 12:06:54.536966","mapping_epoch":597,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":598,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":1055,"ondisk_log_size":1055,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25444385,"num_objects":13,"num_object_clones":9,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":1,"num_read":206,"num_read_kb":224114,"num_write":286,"num_write_kb":67108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":341,"num_bytes_recovered":302548714,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,5,7,6],"acting":[2,3,0,5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"373","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.597793","last_change":"2020-11-12 12:05:11.022716","last_active":"2020-11-12 12:06:54.597793","last_peered":"2020-11-12 12:06:54.597793","last_clean":"2020-11-12 12:06:54.597793","last_became_active":"2020-11-12 12:05:11.021735","last_became_peered":"2020-11-12 12:05:11.021735","last_unstale":"2020-11-12 12:06:54.597793","last_undegraded":"2020-11-12 12:06:54.597793","last_fullsized":"2020-11-12 12:06:54.597793","mapping_epoch":506,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":507,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:02:25.312017","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 12:02:25.312017","last_clean_scrub_stamp":"2020-11-12 12:02:25.312017","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.4","version":"588'438","reported_seq":"3100","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536308","last_change":"2020-11-12 12:06:43.262961","last_active":"2020-11-12 12:06:54.536308","last_peered":"2020-11-12 12:06:54.536308","last_clean":"2020-11-12 12:06:54.536308","last_became_active":"2020-11-12 12:06:43.261089","last_became_peered":"2020-11-12 12:06:43.261089","last_unstale":"2020-11-12 12:06:54.536308","last_undegraded":"2020-11-12 12:06:54.536308","last_fullsized":"2020-11-12 12:06:54.536308","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":438,"ondisk_log_size":438,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16308407,"num_objects":7,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":116,"num_read_kb":160158,"num_write":127,"num_write_kb":30056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":173,"num_bytes_recovered":147668777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7,5,2,3],"acting":[1,0,7,5,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"386","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.598312","last_change":"2020-11-12 12:06:08.296348","last_active":"2020-11-12 12:06:54.598312","last_peered":"2020-11-12 12:06:54.598312","last_clean":"2020-11-12 12:06:54.598312","last_became_active":"2020-11-12 12:06:08.295270","last_became_peered":"2020-11-12 12:06:08.295270","last_unstale":"2020-11-12 12:06:54.598312","last_undegraded":"2020-11-12 12:06:54.598312","last_fullsized":"2020-11-12 12:06:54.598312","mapping_epoch":563,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":564,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:00:41.670756","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:34.139984","last_clean_scrub_stamp":"2020-11-12 12:00:41.670756","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"589'617","reported_seq":"3816","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.396301","last_change":"2020-11-12 12:06:42.310820","last_active":"2020-11-12 12:06:54.396301","last_peered":"2020-11-12 12:06:54.396301","last_clean":"2020-11-12 12:06:54.396301","last_became_active":"2020-11-12 12:06:42.307981","last_became_peered":"2020-11-12 12:06:42.307981","last_unstale":"2020-11-12 12:06:54.396301","last_undegraded":"2020-11-12 12:06:54.396301","last_fullsized":"2020-11-12 12:06:54.396301","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":617,"ondisk_log_size":617,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":10958824,"num_objects":5,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":162,"num_read_kb":202089,"num_write":174,"num_write_kb":39128,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":368,"num_bytes_recovered":205387249,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,3,4,1,2],"acting":[7,0,3,4,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"21","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.597857","last_change":"2020-11-12 12:06:40.300910","last_active":"2020-11-12 12:06:54.597857","last_peered":"2020-11-12 12:06:54.597857","last_clean":"2020-11-12 12:06:54.597857","last_became_active":"2020-11-12 12:06:40.298419","last_became_peered":"2020-11-12 12:06:40.298419","last_unstale":"2020-11-12 12:06:54.597857","last_undegraded":"2020-11-12 12:06:54.597857","last_fullsized":"2020-11-12 12:06:54.597857","mapping_epoch":593,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":594,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:00:53.527167","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:59:32.704623","last_clean_scrub_stamp":"2020-11-12 12:00:53.527167","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.6","version":"588'1111","reported_seq":"4565","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536441","last_change":"2020-11-12 12:06:43.266890","last_active":"2020-11-12 12:06:54.536441","last_peered":"2020-11-12 12:06:54.536441","last_clean":"2020-11-12 12:06:54.536441","last_became_active":"2020-11-12 12:06:43.255461","last_became_peered":"2020-11-12 12:06:43.255461","last_unstale":"2020-11-12 12:06:54.536441","last_undegraded":"2020-11-12 12:06:54.536441","last_fullsized":"2020-11-12 12:06:54.536441","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":1111,"ondisk_log_size":1111,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":34887450,"num_objects":14,"num_object_clones":9,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":1,"num_read":246,"num_read_kb":266348,"num_write":321,"num_write_kb":72199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":506,"num_bytes_recovered":376771825,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4,3,5,0],"acting":[1,6,4,3,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"203","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.336246","last_change":"2020-11-12 12:06:04.089465","last_active":"2020-11-12 12:06:54.336246","last_peered":"2020-11-12 12:06:54.336246","last_clean":"2020-11-12 12:06:54.336246","last_became_active":"2020-11-12 12:06:02.685600","last_became_peered":"2020-11-12 12:06:02.685600","last_unstale":"2020-11-12 12:06:54.336246","last_undegraded":"2020-11-12 12:06:54.336246","last_fullsized":"2020-11-12 12:06:54.336246","mapping_epoch":557,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":558,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:04.089323","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:34.139984","last_clean_scrub_stamp":"2020-11-12 12:06:04.089323","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.7","version":"588'406","reported_seq":"3270","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.598361","last_change":"2020-11-12 12:06:42.315560","last_active":"2020-11-12 12:06:54.598361","last_peered":"2020-11-12 12:06:54.598361","last_clean":"2020-11-12 12:06:54.598361","last_became_active":"2020-11-12 12:06:42.312733","last_became_peered":"2020-11-12 12:06:42.312733","last_unstale":"2020-11-12 12:06:54.598361","last_undegraded":"2020-11-12 12:06:54.598361","last_fullsized":"2020-11-12 12:06:54.598361","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":406,"ondisk_log_size":406,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":14398173,"num_objects":9,"num_object_clones":7,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":128,"num_read_kb":152190,"num_write":153,"num_write_kb":38712,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":238,"num_bytes_recovered":231959248,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2,3,1,4],"acting":[6,7,2,3,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"468","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.395585","last_change":"2020-11-12 12:06:08.388135","last_active":"2020-11-12 12:06:54.395585","last_peered":"2020-11-12 12:06:54.395585","last_clean":"2020-11-12 12:06:54.395585","last_became_active":"2020-11-12 12:06:08.387467","last_became_peered":"2020-11-12 12:06:08.387467","last_unstale":"2020-11-12 12:06:54.395585","last_undegraded":"2020-11-12 12:06:54.395585","last_fullsized":"2020-11-12 12:06:54.395585","mapping_epoch":563,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":564,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:06:02.161150","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:34.139984","last_clean_scrub_stamp":"2020-11-12 12:06:02.161150","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"588'513","reported_seq":"3314","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.397016","last_change":"2020-11-12 12:06:43.336936","last_active":"2020-11-12 12:06:54.397016","last_peered":"2020-11-12 12:06:54.397016","last_clean":"2020-11-12 12:06:54.397016","last_became_active":"2020-11-12 12:06:43.333805","last_became_peered":"2020-11-12 12:06:43.333805","last_unstale":"2020-11-12 12:06:54.397016","last_undegraded":"2020-11-12 12:06:54.397016","last_fullsized":"2020-11-12 12:06:54.397016","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":513,"ondisk_log_size":513,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":13565450,"num_objects":5,"num_object_clones":3,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":101,"num_read_kb":110115,"num_write":144,"num_write_kb":33309,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":176192434,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0,2,7,1,3],"acting":[5,0,2,7,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"63","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.397015","last_change":"2020-11-12 12:06:08.430548","last_active":"2020-11-12 12:06:54.397015","last_peered":"2020-11-12 12:06:54.397015","last_clean":"2020-11-12 12:06:54.397015","last_became_active":"2020-11-12 12:06:08.430025","last_became_peered":"2020-11-12 12:06:08.430025","last_unstale":"2020-11-12 12:06:54.397015","last_undegraded":"2020-11-12 12:06:54.397015","last_fullsized":"2020-11-12 12:06:54.397015","mapping_epoch":563,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":564,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:44.013970","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:34.139984","last_clean_scrub_stamp":"2020-11-12 11:57:44.013970","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"589'1799","reported_seq":"7068","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.397220","last_change":"2020-11-12 12:06:43.340148","last_active":"2020-11-12 12:06:54.397220","last_peered":"2020-11-12 12:06:54.397220","last_clean":"2020-11-12 12:06:54.397220","last_became_active":"2020-11-12 12:06:43.333705","last_became_peered":"2020-11-12 12:06:43.333705","last_unstale":"2020-11-12 12:06:54.397220","last_undegraded":"2020-11-12 12:06:54.397220","last_fullsized":"2020-11-12 12:06:54.397220","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":1799,"ondisk_log_size":1799,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":39547031,"num_objects":21,"num_object_clones":14,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":2,"num_read":376,"num_read_kb":437155,"num_write":487,"num_write_kb":111297,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1201,"num_bytes_recovered":800977327,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,2,3,6,0],"acting":[5,1,2,3,6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"589'515","reported_seq":"3256","reported_epoch":"603","state":"active+clean+scrubbing","last_fresh":"2020-11-12 12:06:54.536776","last_change":"2020-11-12 12:06:42.563016","last_active":"2020-11-12 12:06:54.536776","last_peered":"2020-11-12 12:06:54.536776","last_clean":"2020-11-12 12:06:54.536776","last_became_active":"2020-11-12 12:06:42.240262","last_became_peered":"2020-11-12 12:06:42.240262","last_unstale":"2020-11-12 12:06:54.536776","last_undegraded":"2020-11-12 12:06:54.536776","last_fullsized":"2020-11-12 12:06:54.536776","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":515,"ondisk_log_size":515,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12491429,"num_objects":7,"num_object_clones":5,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":99,"num_read_kb":99083,"num_write":167,"num_write_kb":39748,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":223,"num_bytes_recovered":169316556,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,4,1,6],"acting":[2,3,0,4,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"468","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.395982","last_change":"2020-11-12 12:06:08.381604","last_active":"2020-11-12 12:06:54.395982","last_peered":"2020-11-12 12:06:54.395982","last_clean":"2020-11-12 12:06:54.395982","last_became_active":"2020-11-12 12:06:08.380943","last_became_peered":"2020-11-12 12:06:08.380943","last_unstale":"2020-11-12 12:06:54.395982","last_undegraded":"2020-11-12 12:06:54.395982","last_fullsized":"2020-11-12 12:06:54.395982","mapping_epoch":563,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":564,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:00:19.403580","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:34.139984","last_clean_scrub_stamp":"2020-11-12 12:00:19.403580","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.0","version":"588'553","reported_seq":"3361","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.395661","last_change":"2020-11-12 12:06:43.317666","last_active":"2020-11-12 12:06:54.395661","last_peered":"2020-11-12 12:06:54.395661","last_clean":"2020-11-12 12:06:54.395661","last_became_active":"2020-11-12 12:06:43.314246","last_became_peered":"2020-11-12 12:06:43.314246","last_unstale":"2020-11-12 12:06:54.395661","last_undegraded":"2020-11-12 12:06:54.395661","last_fullsized":"2020-11-12 12:06:54.395661","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":553,"ondisk_log_size":553,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":19010676,"num_objects":11,"num_object_clones":9,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":126,"num_read_kb":125070,"num_write":167,"num_write_kb":42792,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":193623042,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,2,0,3,5],"acting":[7,1,2,0,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"30","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536335","last_change":"2020-11-12 12:06:26.345106","last_active":"2020-11-12 12:06:54.536335","last_peered":"2020-11-12 12:06:54.536335","last_clean":"2020-11-12 12:06:54.536335","last_became_active":"2020-11-12 12:06:26.344166","last_became_peered":"2020-11-12 12:06:26.344166","last_unstale":"2020-11-12 12:06:54.536335","last_undegraded":"2020-11-12 12:06:54.536335","last_fullsized":"2020-11-12 12:06:54.536335","mapping_epoch":581,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":582,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 12:03:58.903264","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:34.139984","last_clean_scrub_stamp":"2020-11-12 12:03:58.903264","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.8","version":"587'512","reported_seq":"3722","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.395961","last_change":"2020-11-12 12:06:42.313486","last_active":"2020-11-12 12:06:54.395961","last_peered":"2020-11-12 12:06:54.395961","last_clean":"2020-11-12 12:06:54.395961","last_became_active":"2020-11-12 12:06:42.310829","last_became_peered":"2020-11-12 12:06:42.310829","last_unstale":"2020-11-12 12:06:54.395961","last_undegraded":"2020-11-12 12:06:54.395961","last_fullsized":"2020-11-12 12:06:54.395961","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":512,"ondisk_log_size":512,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":9059435,"num_objects":4,"num_object_clones":2,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":1,"num_read":108,"num_read_kb":125332,"num_write":132,"num_write_kb":30365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":393,"num_bytes_recovered":222882874,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2,0,1,4,5],"acting":[7,2,0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.9","version":"588'1069","reported_seq":"4433","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536168","last_change":"2020-11-12 12:06:42.251119","last_active":"2020-11-12 12:06:54.536168","last_peered":"2020-11-12 12:06:54.536168","last_clean":"2020-11-12 12:06:54.536168","last_became_active":"2020-11-12 12:06:42.248787","last_became_peered":"2020-11-12 12:06:42.248787","last_unstale":"2020-11-12 12:06:54.536168","last_undegraded":"2020-11-12 12:06:54.536168","last_fullsized":"2020-11-12 12:06:54.536168","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":1069,"ondisk_log_size":1069,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":25268931,"num_objects":12,"num_object_clones":8,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":2,"num_read":282,"num_read_kb":399903,"num_write":290,"num_write_kb":65108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":483,"num_bytes_recovered":376114240,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,7,3,2,6],"acting":[1,5,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.a","version":"571'252","reported_seq":"2839","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536150","last_change":"2020-11-12 12:06:43.265603","last_active":"2020-11-12 12:06:54.536150","last_peered":"2020-11-12 12:06:54.536150","last_clean":"2020-11-12 12:06:54.536150","last_became_active":"2020-11-12 12:06:43.262640","last_became_peered":"2020-11-12 12:06:43.262640","last_unstale":"2020-11-12 12:06:54.536150","last_undegraded":"2020-11-12 12:06:54.536150","last_fullsized":"2020-11-12 12:06:54.536150","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":252,"ondisk_log_size":252,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3227109,"num_objects":2,"num_object_clones":1,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":1,"num_read":48,"num_read_kb":48574,"num_write":83,"num_write_kb":21693,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":149,"num_bytes_recovered":101532902,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,7,6,5,2],"acting":[1,3,7,6,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.b","version":"589'1135","reported_seq":"5447","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.396065","last_change":"2020-11-12 12:06:43.320539","last_active":"2020-11-12 12:06:54.396065","last_peered":"2020-11-12 12:06:54.396065","last_clean":"2020-11-12 12:06:54.396065","last_became_active":"2020-11-12 12:06:43.315313","last_became_peered":"2020-11-12 12:06:43.315313","last_unstale":"2020-11-12 12:06:54.396065","last_undegraded":"2020-11-12 12:06:54.396065","last_fullsized":"2020-11-12 12:06:54.396065","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":1135,"ondisk_log_size":1135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":54796512,"num_objects":23,"num_object_clones":17,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":1,"num_read":333,"num_read_kb":408654,"num_write":448,"num_write_kb":115438,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":790,"num_bytes_recovered":588614018,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6,5,3,2],"acting":[7,4,6,5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"588'285","reported_seq":"2772","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.537063","last_change":"2020-11-12 12:06:43.266128","last_active":"2020-11-12 12:06:54.537063","last_peered":"2020-11-12 12:06:54.537063","last_clean":"2020-11-12 12:06:54.537063","last_became_active":"2020-11-12 12:06:43.263850","last_became_peered":"2020-11-12 12:06:43.263850","last_unstale":"2020-11-12 12:06:54.537063","last_undegraded":"2020-11-12 12:06:54.537063","last_fullsized":"2020-11-12 12:06:54.537063","mapping_epoch":596,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":597,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":285,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11907036,"num_objects":5,"num_object_clones":4,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":51,"num_read_kb":51798,"num_write":98,"num_write_kb":26368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":111617927,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5,0,1,3,7],"acting":[2,5,0,1,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.d","version":"589'564","reported_seq":"3569","reported_epoch":"603","state":"active+clean","last_fresh":"2020-11-12 12:06:54.536232","last_change":"2020-11-12 12:06:42.250553","last_active":"2020-11-12 12:06:54.536232","last_peered":"2020-11-12 12:06:54.536232","last_clean":"2020-11-12 12:06:54.536232","last_became_active":"2020-11-12 12:06:42.248753","last_became_peered":"2020-11-12 12:06:42.248753","last_unstale":"2020-11-12 12:06:54.536232","last_undegraded":"2020-11-12 12:06:54.536232","last_fullsized":"2020-11-12 12:06:54.536232","mapping_epoch":595,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":596,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:58.640486","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:56:58.640486","last_clean_scrub_stamp":"2020-11-12 11:56:58.640486","log_size":564,"ondisk_log_size":564,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":21462188,"num_objects":9,"num_object_clones":6,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":1,"num_read":204,"num_read_kb":307376,"num_write":152,"num_write_kb":38473,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":257,"num_bytes_recovered":229857185,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4,3,2,6,7],"acting":[1,4,3,2,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":337652132,"num_objects":157,"num_object_clones":108,"num_object_copies":942,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":157,"num_whiteouts":14,"num_read":2750,"num_read_kb":3305717,"num_write":3475,"num_write_kb":832023,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6177,"num_bytes_recovered":4618053809,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":409858048,"data_stored":453328818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11701,"ondisk_log_size":11701,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575128,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1099936,"kb_used_data":51352,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93271904,"statfs":{"total":96636764160,"available":95510429696,"internally_reserved":1073741824,"allocated":52584448,"data_stored":61811637,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":1.925,"5min":1.669,"15min":1.587},"min":{"1min":1.147,"5min":0.76800000000000002,"15min":0.56699999999999995},"max":{"1min":3.4369999999999998,"5min":3.4369999999999998,"15min":9.0350000000000001},"last":1.6479999999999999},{"interface":"front","average":{"1min":1.9279999999999999,"5min":2.0630000000000002,"15min":2.0190000000000001},"min":{"1min":1.206,"5min":0.88700000000000001,"15min":0.622},"max":{"1min":2.931,"5min":3.8889999999999998,"15min":5.7160000000000002},"last":2.0880000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":1.77,"5min":1.7989999999999999,"15min":1.8140000000000001},"min":{"1min":1.2290000000000001,"5min":1.1180000000000001,"15min":0.76700000000000002},"max":{"1min":2.778,"5min":3.4830000000000001,"15min":16.140000000000001},"last":2.4500000000000002},{"interface":"front","average":{"1min":1.8440000000000001,"5min":1.8049999999999999,"15min":1.8400000000000001},"min":{"1min":1.212,"5min":1.1020000000000001,"15min":0.76500000000000001},"max":{"1min":2.8399999999999999,"5min":3.3260000000000001,"15min":4.29},"last":1.5600000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":2.6379999999999999,"5min":2.4540000000000002,"15min":2.3460000000000001},"min":{"1min":1.8839999999999999,"5min":1.375,"15min":0.89600000000000002},"max":{"1min":4.0279999999999996,"5min":4.0279999999999996,"15min":4.4859999999999998},"last":2.371},{"interface":"front","average":{"1min":2.1429999999999998,"5min":2.121,"15min":2.2010000000000001},"min":{"1min":1.4650000000000001,"5min":1.163,"15min":0.86099999999999999},"max":{"1min":3.1600000000000001,"5min":3.3929999999999998,"15min":16.795999999999999},"last":2.02}]},{"osd":3,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":2.242,"5min":2.2349999999999999,"15min":2.5129999999999999},"min":{"1min":1.4930000000000001,"5min":1.333,"15min":0.83299999999999996},"max":{"1min":3.2200000000000002,"5min":3.5550000000000002,"15min":74.453000000000003},"last":2.7170000000000001},{"interface":"front","average":{"1min":2.3109999999999999,"5min":2.4180000000000001,"15min":2.6949999999999998},"min":{"1min":1.7370000000000001,"5min":1.3959999999999999,"15min":1.1559999999999999},"max":{"1min":3.8420000000000001,"5min":3.8420000000000001,"15min":73.983999999999995},"last":1.8899999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":2.9329999999999998,"5min":2.8100000000000001,"15min":2.6890000000000001},"min":{"1min":2.069,"5min":1.782,"15min":0.83099999999999996},"max":{"1min":3.9790000000000001,"5min":3.9790000000000001,"15min":15.321},"last":1.9730000000000001},{"interface":"front","average":{"1min":2.9550000000000001,"5min":2.8780000000000001,"15min":2.8100000000000001},"min":{"1min":2.0270000000000001,"5min":1.9139999999999999,"15min":1.0209999999999999},"max":{"1min":4.0640000000000001,"5min":4.0979999999999999,"15min":8.6709999999999994},"last":2.8100000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":3.0019999999999998,"5min":2.8159999999999998,"15min":2.718},"min":{"1min":2.0299999999999998,"5min":1.958,"15min":1.02},"max":{"1min":4.9240000000000004,"5min":4.9240000000000004,"15min":4.9240000000000004},"last":2.9350000000000001},{"interface":"front","average":{"1min":2.4809999999999999,"5min":2.5139999999999998,"15min":2.5670000000000002},"min":{"1min":1.7769999999999999,"5min":1.6200000000000001,"15min":0.88400000000000001},"max":{"1min":3.621,"5min":4.0209999999999999,"15min":18.762},"last":2.7639999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:19:08 2020","interfaces":[{"interface":"back","average":{"1min":2.8620000000000001,"5min":2.9279999999999999,"15min":2.8650000000000002},"min":{"1min":2.1480000000000001,"5min":1.782,"15min":1.27},"max":{"1min":4.2969999999999997,"5min":5.1070000000000002,"15min":19.003},"last":2.3050000000000002},{"interface":"front","average":{"1min":3.1299999999999999,"5min":3.2200000000000002,"15min":3.0710000000000002},"min":{"1min":2.2679999999999998,"5min":2.2679999999999998,"15min":1.157},"max":{"1min":4.4939999999999998,"5min":5.3319999999999999,"15min":15.912000000000001},"last":2.5099999999999998}]}]},{"osd":6,"up_from":13,"seq":55834575128,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1099312,"kb_used_data":50728,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93272528,"statfs":{"total":96636764160,"available":95511068672,"internally_reserved":1073741824,"allocated":51945472,"data_stored":60414959,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:07 2020","interfaces":[{"interface":"back","average":{"1min":1.5249999999999999,"5min":1.631,"15min":1.607},"min":{"1min":1.101,"5min":0.88,"15min":0.48299999999999998},"max":{"1min":2.3479999999999999,"5min":2.8010000000000002,"15min":4.3070000000000004},"last":1.893},{"interface":"front","average":{"1min":1.8100000000000001,"5min":1.6659999999999999,"15min":1.6180000000000001},"min":{"1min":1.278,"5min":1.0880000000000001,"15min":0.45300000000000001},"max":{"1min":2.6190000000000002,"5min":3.2269999999999999,"15min":4.0359999999999996},"last":2.1779999999999999}]},{"osd":1,"last update":"Thu Nov 12 12:19:07 2020","interfaces":[{"interface":"back","average":{"1min":1.7390000000000001,"5min":1.8460000000000001,"15min":1.78},"min":{"1min":1.2,"5min":1.0920000000000001,"15min":0.55100000000000005},"max":{"1min":2.8180000000000001,"5min":2.988,"15min":5.3929999999999998},"last":2.3460000000000001},{"interface":"front","average":{"1min":2.5720000000000001,"5min":2.427,"15min":2.3109999999999999},"min":{"1min":1.6180000000000001,"5min":1.2110000000000001,"15min":0.66100000000000003},"max":{"1min":3.7759999999999998,"5min":4.1130000000000004,"15min":5.0720000000000001},"last":3.1699999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:19:07 2020","interfaces":[{"interface":"back","average":{"1min":2.0470000000000002,"5min":2.0609999999999999,"15min":2.0139999999999998},"min":{"1min":1.254,"5min":1.254,"15min":0.68300000000000005},"max":{"1min":3.1619999999999999,"5min":3.5920000000000001,"15min":3.5920000000000001},"last":1.4730000000000001},{"interface":"front","average":{"1min":2.5870000000000002,"5min":2.5529999999999999,"15min":2.4540000000000002},"min":{"1min":1.6739999999999999,"5min":1.2390000000000001,"15min":0.91600000000000004},"max":{"1min":3.7050000000000001,"5min":4.0229999999999997,"15min":4.3209999999999997},"last":2.2559999999999998}]},{"osd":3,"last update":"Thu Nov 12 12:19:07 2020","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":1.976,"15min":2.0150000000000001},"min":{"1min":1.3640000000000001,"5min":1.2829999999999999,"15min":0.70299999999999996},"max":{"1min":2.7309999999999999,"5min":3.1019999999999999,"15min":9.6280000000000001},"last":1.6339999999999999},{"interface":"front","average":{"1min":2.4249999999999998,"5min":2.371,"15min":2.3100000000000001},"min":{"1min":1.4159999999999999,"5min":1.4159999999999999,"15min":0.82199999999999995},"max":{"1min":3.548,"5min":3.548,"15min":4.3209999999999997},"last":1.8220000000000001}]},{"osd":4,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.379,"5min":2.3180000000000001,"15min":2.4820000000000002},"min":{"1min":1.736,"5min":1.401,"15min":1.008},"max":{"1min":3.46,"5min":3.46,"15min":22.937000000000001},"last":2.7749999999999999},{"interface":"front","average":{"1min":2.8599999999999999,"5min":2.6520000000000001,"15min":2.5299999999999998},"min":{"1min":2.1880000000000002,"5min":1.7929999999999999,"15min":0.79600000000000004},"max":{"1min":3.9740000000000002,"5min":3.9740000000000002,"15min":4.8920000000000003},"last":2.403}]},{"osd":5,"last update":"Thu Nov 12 12:19:07 2020","interfaces":[{"interface":"back","average":{"1min":3.0339999999999998,"5min":2.9260000000000002,"15min":2.8250000000000002},"min":{"1min":2.3820000000000001,"5min":1.4850000000000001,"15min":1.111},"max":{"1min":3.9889999999999999,"5min":4.4660000000000002,"15min":4.6150000000000002},"last":3.5800000000000001},{"interface":"front","average":{"1min":3.169,"5min":3.0939999999999999,"15min":2.9390000000000001},"min":{"1min":2.4300000000000002,"5min":1.9790000000000001,"15min":1.093},"max":{"1min":4.1950000000000003,"5min":4.5030000000000001,"15min":12.632999999999999},"last":2.6640000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:19:07 2020","interfaces":[{"interface":"back","average":{"1min":2.665,"5min":2.6779999999999999,"15min":2.6230000000000002},"min":{"1min":1.742,"5min":1.742,"15min":0.79500000000000004},"max":{"1min":3.5169999999999999,"5min":3.9510000000000001,"15min":9.8179999999999996},"last":2.0499999999999998},{"interface":"front","average":{"1min":3.1579999999999999,"5min":3.1920000000000002,"15min":3.0790000000000002},"min":{"1min":2.109,"5min":2.109,"15min":1.2969999999999999},"max":{"1min":4.3879999999999999,"5min":4.8529999999999998,"15min":8.0719999999999992},"last":3.0019999999999998}]}]},{"osd":5,"up_from":13,"seq":55834575130,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1105080,"kb_used_data":56496,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93266760,"statfs":{"total":96636764160,"available":95505162240,"internally_reserved":1073741824,"allocated":57851904,"data_stored":63475832,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":1.823,"5min":1.756,"15min":1.7130000000000001},"min":{"1min":1.1719999999999999,"5min":0.88300000000000001,"15min":0.55700000000000005},"max":{"1min":2.96,"5min":3.306,"15min":4.335},"last":2.8679999999999999},{"interface":"front","average":{"1min":1.607,"5min":1.669,"15min":1.6830000000000001},"min":{"1min":1.278,"5min":1.004,"15min":0.73599999999999999},"max":{"1min":2.27,"5min":3.0190000000000001,"15min":7.4630000000000001},"last":1.46}]},{"osd":1,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":1.7529999999999999,"5min":1.659,"15min":1.7829999999999999},"min":{"1min":1.3899999999999999,"5min":1.125,"15min":0.65800000000000003},"max":{"1min":2.2210000000000001,"5min":2.6880000000000002,"15min":42.523000000000003},"last":1.554},{"interface":"front","average":{"1min":1.998,"5min":2.177,"15min":2.137},"min":{"1min":1.21,"5min":1.21,"15min":0.69999999999999996},"max":{"1min":2.6829999999999998,"5min":4.2000000000000002,"15min":4.3499999999999996},"last":2.5369999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:19:21 2020","interfaces":[{"interface":"back","average":{"1min":2.153,"5min":2.2999999999999998,"15min":2.2109999999999999},"min":{"1min":1.5449999999999999,"5min":1.129,"15min":0.71299999999999997},"max":{"1min":2.863,"5min":3.3700000000000001,"15min":3.859},"last":3.1110000000000002},{"interface":"front","average":{"1min":2.6120000000000001,"5min":2.6299999999999999,"15min":2.52},"min":{"1min":2.0230000000000001,"5min":1.548,"15min":1.0089999999999999},"max":{"1min":3.1539999999999999,"5min":3.6320000000000001,"15min":4.7000000000000002},"last":3.3039999999999998}]},{"osd":3,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.0619999999999998,"5min":2.0409999999999999,"15min":2.1680000000000001},"min":{"1min":1.6599999999999999,"5min":1.3919999999999999,"15min":0.74299999999999999},"max":{"1min":2.488,"5min":2.7749999999999999,"15min":35.472999999999999},"last":2.2639999999999998},{"interface":"front","average":{"1min":3.0190000000000001,"5min":3.1160000000000001,"15min":2.9649999999999999},"min":{"1min":2.258,"5min":2.258,"15min":1.234},"max":{"1min":3.4340000000000002,"5min":4.2759999999999998,"15min":4.6660000000000004},"last":3.5179999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":2.1989999999999998,"15min":2.657},"min":{"1min":1.4830000000000001,"5min":1.4830000000000001,"15min":1.0229999999999999},"max":{"1min":2.7469999999999999,"5min":3.4700000000000002,"15min":51.360999999999997},"last":1.9550000000000001},{"interface":"front","average":{"1min":2.9359999999999999,"5min":3.0150000000000001,"15min":2.6309999999999998},"min":{"1min":1.9850000000000001,"5min":1.925,"15min":0.75600000000000001},"max":{"1min":3.7160000000000002,"5min":4.726,"15min":7.976},"last":3.73}]},{"osd":6,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.7999999999999998,"5min":2.4510000000000001,"15min":2.5950000000000002},"min":{"1min":1.8300000000000001,"5min":1.577,"15min":0.93100000000000005},"max":{"1min":4.0289999999999999,"5min":4.0289999999999999,"15min":35.674999999999997},"last":1.9039999999999999},{"interface":"front","average":{"1min":3.25,"5min":3.3340000000000001,"15min":3.2160000000000002},"min":{"1min":2.226,"5min":2.226,"15min":1.1910000000000001},"max":{"1min":4.1429999999999998,"5min":5.1929999999999996,"15min":6.2359999999999998},"last":3.9470000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.484,"5min":2.6749999999999998,"15min":2.6709999999999998},"min":{"1min":1.8049999999999999,"5min":1.8049999999999999,"15min":1.0029999999999999},"max":{"1min":4.0199999999999996,"5min":4.0199999999999996,"15min":12.837},"last":2.3479999999999999},{"interface":"front","average":{"1min":3.077,"5min":2.8599999999999999,"15min":2.956},"min":{"1min":2.2360000000000002,"5min":1.847,"15min":1.0660000000000001},"max":{"1min":4.2469999999999999,"5min":4.2469999999999999,"15min":35.865000000000002},"last":2.653}]}]},{"osd":4,"up_from":13,"seq":55834575128,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1096168,"kb_used_data":47584,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93275672,"statfs":{"total":96636764160,"available":95514288128,"internally_reserved":1073741824,"allocated":48726016,"data_stored":44665555,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":1.7949999999999999,"5min":1.6859999999999999,"15min":1.716},"min":{"1min":1.1619999999999999,"5min":1.042,"15min":0.53300000000000003},"max":{"1min":2.9500000000000002,"5min":3.214,"15min":6.1529999999999996},"last":1.73},{"interface":"front","average":{"1min":1.6160000000000001,"5min":1.593,"15min":1.653},"min":{"1min":1.2470000000000001,"5min":0.97399999999999998,"15min":0.46899999999999997},"max":{"1min":2.754,"5min":2.754,"15min":8.5530000000000008},"last":3.2490000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":1.8200000000000001,"5min":1.6639999999999999,"15min":1.6719999999999999},"min":{"1min":1.2909999999999999,"5min":1.0169999999999999,"15min":0.72999999999999998},"max":{"1min":2.6499999999999999,"5min":2.883,"15min":11.569000000000001},"last":1.427},{"interface":"front","average":{"1min":2.0449999999999999,"5min":2.246,"15min":2.2970000000000002},"min":{"1min":1.3300000000000001,"5min":1.272,"15min":0.747},"max":{"1min":3.157,"5min":3.952,"15min":6.0759999999999996},"last":1.875}]},{"osd":2,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":1.9950000000000001,"5min":2.141,"15min":1.9930000000000001},"min":{"1min":1.353,"5min":1.353,"15min":0.67600000000000005},"max":{"1min":2.9529999999999998,"5min":3.7010000000000001,"15min":3.7010000000000001},"last":2.0030000000000001},{"interface":"front","average":{"1min":2.3420000000000001,"5min":2.5169999999999999,"15min":2.3780000000000001},"min":{"1min":1.8100000000000001,"5min":1.6950000000000001,"15min":0.86499999999999999},"max":{"1min":2.9550000000000001,"5min":3.9009999999999998,"15min":4.6239999999999997},"last":2.403}]},{"osd":3,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":2.0179999999999998,"5min":2.0950000000000002,"15min":2.0449999999999999},"min":{"1min":1.6599999999999999,"5min":1.298,"15min":0.83399999999999996},"max":{"1min":2.5099999999999998,"5min":3.2919999999999998,"15min":8.4499999999999993},"last":1.9550000000000001},{"interface":"front","average":{"1min":2.359,"5min":2.3450000000000002,"15min":2.3900000000000001},"min":{"1min":1.8799999999999999,"5min":1.2110000000000001,"15min":0.57299999999999995},"max":{"1min":3.0939999999999999,"5min":3.552,"15min":42.878},"last":2.1179999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":2.0720000000000001,"5min":2.2829999999999999,"15min":2.4329999999999998},"min":{"1min":1.3100000000000001,"5min":1.3100000000000001,"15min":0.81000000000000005},"max":{"1min":3.1110000000000002,"5min":3.5960000000000001,"15min":16.414000000000001},"last":1.359},{"interface":"front","average":{"1min":2.8500000000000001,"5min":2.863,"15min":2.6789999999999998},"min":{"1min":1.968,"5min":1.829,"15min":0.61199999999999999},"max":{"1min":3.794,"5min":4.0960000000000001,"15min":19.512},"last":2.8010000000000002}]},{"osd":6,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":2.7440000000000002,"5min":2.992,"15min":2.867},"min":{"1min":1.637,"5min":1.637,"15min":1.008},"max":{"1min":3.6339999999999999,"5min":4.2910000000000004,"15min":4.2910000000000004},"last":3.6749999999999998},{"interface":"front","average":{"1min":3.2370000000000001,"5min":3.3780000000000001,"15min":3.2480000000000002},"min":{"1min":2.5779999999999998,"5min":2.5499999999999998,"15min":1.1060000000000001},"max":{"1min":4.2400000000000002,"5min":4.5449999999999999,"15min":4.5449999999999999},"last":4.835}]},{"osd":7,"last update":"Thu Nov 12 12:19:17 2020","interfaces":[{"interface":"back","average":{"1min":2.988,"5min":2.7690000000000001,"15min":2.8420000000000001},"min":{"1min":2.4609999999999999,"5min":1.6200000000000001,"15min":0.747},"max":{"1min":3.653,"5min":4.3099999999999996,"15min":43.130000000000003},"last":2.3290000000000002},{"interface":"front","average":{"1min":3.1749999999999998,"5min":3.0800000000000001,"15min":3.1960000000000002},"min":{"1min":2.4649999999999999,"5min":2.1110000000000002,"15min":0.96199999999999997},"max":{"1min":3.9809999999999999,"5min":4.532,"15min":43.003},"last":2.524}]}]},{"osd":0,"up_from":13,"seq":55834575127,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1103452,"kb_used_data":54868,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93268388,"statfs":{"total":96636764160,"available":95506829312,"internally_reserved":1073741824,"allocated":56184832,"data_stored":54487432,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":1.6140000000000001,"5min":1.5189999999999999,"15min":1.5149999999999999},"min":{"1min":1.147,"5min":0.95799999999999996,"15min":0.54400000000000004},"max":{"1min":2.4590000000000001,"5min":2.4590000000000001,"15min":3.7360000000000002},"last":1.3280000000000001},{"interface":"front","average":{"1min":1.444,"5min":1.579,"15min":1.6379999999999999},"min":{"1min":0.91300000000000003,"5min":0.91300000000000003,"15min":0.70199999999999996},"max":{"1min":2.169,"5min":3.2469999999999999,"15min":3.7040000000000002},"last":1.4259999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":1.8979999999999999,"5min":1.8420000000000001,"15min":1.798},"min":{"1min":1.145,"5min":1.0629999999999999,"15min":0.65300000000000002},"max":{"1min":2.7160000000000002,"5min":2.9710000000000001,"15min":3.7370000000000001},"last":1.8169999999999999},{"interface":"front","average":{"1min":2.4380000000000002,"5min":2.2650000000000001,"15min":2.2069999999999999},"min":{"1min":1.524,"5min":1.1719999999999999,"15min":0.86099999999999999},"max":{"1min":3.2599999999999998,"5min":3.2930000000000001,"15min":4.0069999999999997},"last":2.3980000000000001}]},{"osd":3,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":1.9630000000000001,"5min":2.073,"15min":2.1309999999999998},"min":{"1min":1.2010000000000001,"5min":0.90300000000000002,"15min":0.80000000000000004},"max":{"1min":3.0630000000000002,"5min":3.4420000000000002,"15min":4.149},"last":1.6140000000000001},{"interface":"front","average":{"1min":2.6150000000000002,"5min":2.5920000000000001,"15min":2.3439999999999999},"min":{"1min":1.766,"5min":1.05,"15min":0.65400000000000003},"max":{"1min":4.1989999999999998,"5min":4.3360000000000003,"15min":7.0519999999999996},"last":2.1389999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":2.125,"5min":2.0859999999999999,"15min":2.173},"min":{"1min":1.474,"5min":1.3300000000000001,"15min":1.0900000000000001},"max":{"1min":3.403,"5min":3.403,"15min":6.6349999999999998},"last":1.988},{"interface":"front","average":{"1min":2.637,"5min":2.6819999999999999,"15min":2.629},"min":{"1min":1.804,"5min":1.7629999999999999,"15min":1.296},"max":{"1min":3.4180000000000001,"5min":4.1059999999999999,"15min":4.556},"last":2.6320000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":2.5179999999999998,"5min":2.5569999999999999,"15min":2.5720000000000001},"min":{"1min":1.629,"5min":1.5249999999999999,"15min":1.196},"max":{"1min":3.6379999999999999,"5min":3.9910000000000001,"15min":6.3529999999999998},"last":1.9450000000000001},{"interface":"front","average":{"1min":2.2509999999999999,"5min":2.3740000000000001,"15min":2.3969999999999998},"min":{"1min":1.548,"5min":1.5189999999999999,"15min":1.2709999999999999},"max":{"1min":3.4910000000000001,"5min":3.6760000000000002,"15min":6.8550000000000004},"last":2.3239999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":2.4870000000000001,"5min":2.464,"15min":2.5699999999999998},"min":{"1min":1.8140000000000001,"5min":1.272,"15min":1.157},"max":{"1min":3.2919999999999998,"5min":3.4340000000000002,"15min":5.1040000000000001},"last":2.2519999999999998},{"interface":"front","average":{"1min":2.8780000000000001,"5min":2.9220000000000002,"15min":2.8799999999999999},"min":{"1min":1.9530000000000001,"5min":1.7929999999999999,"15min":1.2090000000000001},"max":{"1min":4.4320000000000004,"5min":4.4740000000000002,"15min":8.9199999999999999},"last":3.0230000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:19:24 2020","interfaces":[{"interface":"back","average":{"1min":2.6509999999999998,"5min":2.698,"15min":2.9359999999999999},"min":{"1min":1.9770000000000001,"5min":1.913,"15min":1.427},"max":{"1min":3.9129999999999998,"5min":4.0170000000000003,"15min":37.134999999999998},"last":2.6899999999999999},{"interface":"front","average":{"1min":3.3290000000000002,"5min":3.286,"15min":3.2650000000000001},"min":{"1min":2.4140000000000001,"5min":2.3639999999999999,"15min":1.4199999999999999},"max":{"1min":4.4219999999999997,"5min":4.6470000000000002,"15min":37.094000000000001},"last":2.827}]}]},{"osd":1,"up_from":482,"seq":2070174236851,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1113664,"kb_used_data":65080,"kb_used_omap":126,"kb_used_meta":1048449,"kb_avail":93258176,"statfs":{"total":96636764160,"available":95496372224,"internally_reserved":1073741824,"allocated":66641920,"data_stored":63968709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":129277,"internal_metadata":1073612547},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":1.6100000000000001,"5min":1.5700000000000001,"15min":1.4830000000000001},"min":{"1min":0.57699999999999996,"5min":0.57699999999999996,"15min":0.57699999999999996},"max":{"1min":2.456,"5min":3.2719999999999998,"15min":5.8719999999999999},"last":2.2349999999999999},{"interface":"front","average":{"1min":1.4359999999999999,"5min":1.548,"15min":1.5580000000000001},"min":{"1min":1.0309999999999999,"5min":1.0309999999999999,"15min":0.57799999999999996},"max":{"1min":2.1179999999999999,"5min":2.5910000000000002,"15min":5.3369999999999997},"last":1.663}]},{"osd":2,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":1.5580000000000001,"5min":1.6220000000000001,"15min":1.5980000000000001},"min":{"1min":0.92100000000000004,"5min":0.875,"15min":0.57299999999999995},"max":{"1min":2.46,"5min":3.125,"15min":3.351},"last":1.4450000000000001},{"interface":"front","average":{"1min":2.048,"5min":2.02,"15min":1.887},"min":{"1min":1.2150000000000001,"5min":1.2150000000000001,"15min":0.623},"max":{"1min":2.984,"5min":2.984,"15min":6.1280000000000001},"last":2.431}]},{"osd":3,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":1.8340000000000001,"5min":1.962,"15min":1.944},"min":{"1min":1.004,"5min":1.004,"15min":0.752},"max":{"1min":2.7509999999999999,"5min":3.1680000000000001,"15min":6.8239999999999998},"last":1.6220000000000001},{"interface":"front","average":{"1min":2.073,"5min":2.0299999999999998,"15min":2.0129999999999999},"min":{"1min":1.335,"5min":1.1160000000000001,"15min":0.69899999999999995},"max":{"1min":2.581,"5min":3.1419999999999999,"15min":5.5590000000000002},"last":2.6989999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.262,"5min":2.2309999999999999,"15min":2.1720000000000002},"min":{"1min":1.3109999999999999,"5min":1.3109999999999999,"15min":0.65700000000000003},"max":{"1min":3.1869999999999998,"5min":3.6600000000000001,"15min":3.6600000000000001},"last":1.883},{"interface":"front","average":{"1min":2.4319999999999999,"5min":2.403,"15min":2.444},"min":{"1min":1.5209999999999999,"5min":1.3200000000000001,"15min":0.69899999999999995},"max":{"1min":3.2879999999999998,"5min":3.7469999999999999,"15min":8.4570000000000007},"last":2.1789999999999998}]},{"osd":5,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.633,"5min":2.552,"15min":2.5169999999999999},"min":{"1min":1.8280000000000001,"5min":1.544,"15min":0.88400000000000001},"max":{"1min":3.3170000000000002,"5min":3.8879999999999999,"15min":9.766},"last":2.6699999999999999},{"interface":"front","average":{"1min":2.5550000000000002,"5min":2.4369999999999998,"15min":2.4089999999999998},"min":{"1min":1.7150000000000001,"5min":1.7150000000000001,"15min":0.85199999999999998},"max":{"1min":3.246,"5min":3.9910000000000001,"15min":5.2590000000000003},"last":2.9279999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.6970000000000001,"5min":2.6110000000000002,"15min":2.6280000000000001},"min":{"1min":1.9730000000000001,"5min":1.581,"15min":1.149},"max":{"1min":3.4609999999999999,"5min":3.6190000000000002,"15min":7.9960000000000004},"last":3.1520000000000001},{"interface":"front","average":{"1min":2.927,"5min":2.8450000000000002,"15min":2.6779999999999999},"min":{"1min":2.0979999999999999,"5min":1.946,"15min":0.98399999999999999},"max":{"1min":3.6890000000000001,"5min":4.2240000000000002,"15min":4.2240000000000002},"last":2.8719999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:19:10 2020","interfaces":[{"interface":"back","average":{"1min":2.6960000000000002,"5min":2.6789999999999998,"15min":2.71},"min":{"1min":1.972,"5min":1.9590000000000001,"15min":1.091},"max":{"1min":3.5960000000000001,"5min":3.7490000000000001,"15min":23.716000000000001},"last":2.5649999999999999},{"interface":"front","average":{"1min":2.8820000000000001,"5min":2.863,"15min":2.8479999999999999},"min":{"1min":2.0169999999999999,"5min":1.9119999999999999,"15min":1.276},"max":{"1min":3.6709999999999998,"5min":3.8130000000000002,"15min":13.834},"last":3.3639999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575128,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1123108,"kb_used_data":74524,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93248732,"statfs":{"total":96636764160,"available":95486701568,"internally_reserved":1073741824,"allocated":76312576,"data_stored":71869903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:18 2020","interfaces":[{"interface":"back","average":{"1min":1.665,"5min":1.5609999999999999,"15min":1.494},"min":{"1min":1.1759999999999999,"5min":0.80800000000000005,"15min":0.64500000000000002},"max":{"1min":3.0990000000000002,"5min":3.0990000000000002,"15min":3.0990000000000002},"last":2.0590000000000002},{"interface":"front","average":{"1min":1.8029999999999999,"5min":1.823,"15min":1.764},"min":{"1min":1.016,"5min":0.98799999999999999,"15min":0.627},"max":{"1min":3.7789999999999999,"5min":3.7789999999999999,"15min":4.8710000000000004},"last":1.796}]},{"osd":1,"last update":"Thu Nov 12 12:18:28 2020","interfaces":[{"interface":"back","average":{"1min":1.569,"5min":1.631,"15min":1.5760000000000001},"min":{"1min":0.90000000000000002,"5min":0.86399999999999999,"15min":0.57599999999999996},"max":{"1min":2.331,"5min":2.7599999999999998,"15min":4.7759999999999998},"last":1.3420000000000001},{"interface":"front","average":{"1min":1.792,"5min":1.9079999999999999,"15min":1.8009999999999999},"min":{"1min":1.0880000000000001,"5min":0.629,"15min":0.56799999999999995},"max":{"1min":2.6269999999999998,"5min":4.4690000000000003,"15min":4.4690000000000003},"last":2.5059999999999998}]},{"osd":3,"last update":"Thu Nov 12 12:19:18 2020","interfaces":[{"interface":"back","average":{"1min":1.881,"5min":2.0299999999999998,"15min":1.911},"min":{"1min":1.286,"5min":0.94399999999999995,"15min":0.64800000000000002},"max":{"1min":3.4780000000000002,"5min":3.8210000000000002,"15min":4.9880000000000004},"last":1.968},{"interface":"front","average":{"1min":2.2559999999999998,"5min":2.3039999999999998,"15min":2.1299999999999999},"min":{"1min":1.474,"5min":1.2949999999999999,"15min":0.82399999999999995},"max":{"1min":4.444,"5min":5.8070000000000004,"15min":5.8070000000000004},"last":3.1200000000000001}]},{"osd":4,"last update":"Thu Nov 12 12:19:18 2020","interfaces":[{"interface":"back","average":{"1min":2.556,"5min":2.0739999999999998,"15min":1.9830000000000001},"min":{"1min":1.754,"5min":1.226,"15min":0.83299999999999996},"max":{"1min":3.867,"5min":3.867,"15min":4.8209999999999997},"last":2.1589999999999998},{"interface":"front","average":{"1min":2.5369999999999999,"5min":2.5329999999999999,"15min":2.3980000000000001},"min":{"1min":1.9650000000000001,"5min":1.3360000000000001,"15min":0.69199999999999995},"max":{"1min":4.085,"5min":4.085,"15min":7.2930000000000001},"last":2.282}]},{"osd":5,"last update":"Thu Nov 12 12:19:18 2020","interfaces":[{"interface":"back","average":{"1min":2.8929999999999998,"5min":2.6440000000000001,"15min":2.5049999999999999},"min":{"1min":1.8380000000000001,"5min":1.325,"15min":1.2589999999999999},"max":{"1min":4.9039999999999999,"5min":4.9039999999999999,"15min":5.7160000000000002},"last":3.5139999999999998},{"interface":"front","average":{"1min":2.5600000000000001,"5min":2.3690000000000002,"15min":2.3420000000000001},"min":{"1min":1.8819999999999999,"5min":1.3680000000000001,"15min":1.0589999999999999},"max":{"1min":3.6429999999999998,"5min":3.6930000000000001,"15min":5.6639999999999997},"last":2.0219999999999998}]},{"osd":6,"last update":"Thu Nov 12 12:19:18 2020","interfaces":[{"interface":"back","average":{"1min":2.9180000000000001,"5min":2.6509999999999998,"15min":2.5510000000000002},"min":{"1min":1.865,"5min":1.6619999999999999,"15min":0.83799999999999997},"max":{"1min":4.6239999999999997,"5min":4.6239999999999997,"15min":5.5369999999999999},"last":2.7639999999999998},{"interface":"front","average":{"1min":3.077,"5min":2.8580000000000001,"15min":2.7650000000000001},"min":{"1min":2.2050000000000001,"5min":1.1950000000000001,"15min":1.1950000000000001},"max":{"1min":5.375,"5min":5.375,"15min":14.321},"last":3.8889999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:19:18 2020","interfaces":[{"interface":"back","average":{"1min":3.1379999999999999,"5min":2.919,"15min":2.8109999999999999},"min":{"1min":2.2400000000000002,"5min":1.492,"15min":1.1559999999999999},"max":{"1min":4.8550000000000004,"5min":4.8550000000000004,"15min":5.3499999999999996},"last":2.5699999999999998},{"interface":"front","average":{"1min":3.2090000000000001,"5min":3.1320000000000001,"15min":2.9780000000000002},"min":{"1min":2.149,"5min":1.8520000000000001,"15min":1.2270000000000001},"max":{"1min":4.5279999999999996,"5min":4.5279999999999996,"15min":5.1740000000000004},"last":2.96}]}]},{"osd":3,"up_from":13,"seq":55834575127,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1105868,"kb_used_data":57284,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93265972,"statfs":{"total":96636764160,"available":95504355328,"internally_reserved":1073741824,"allocated":58658816,"data_stored":65002639,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":1.601,"5min":1.5980000000000001,"15min":1.4910000000000001},"min":{"1min":0.88400000000000001,"5min":0.88400000000000001,"15min":0.55400000000000005},"max":{"1min":2.774,"5min":3.1509999999999998,"15min":5.0670000000000002},"last":1.5209999999999999},{"interface":"front","average":{"1min":2.0600000000000001,"5min":2.0590000000000002,"15min":1.905},"min":{"1min":1.1879999999999999,"5min":1.0209999999999999,"15min":0.63100000000000001},"max":{"1min":2.8769999999999998,"5min":4.3689999999999998,"15min":4.3689999999999998},"last":1.706}]},{"osd":1,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":1.613,"5min":1.7350000000000001,"15min":1.6830000000000001},"min":{"1min":0.86099999999999999,"5min":0.73199999999999998,"15min":0.51900000000000002},"max":{"1min":2.859,"5min":4.9059999999999997,"15min":4.9059999999999997},"last":2.2029999999999998},{"interface":"front","average":{"1min":1.704,"5min":1.804,"15min":1.7729999999999999},"min":{"1min":1.24,"5min":0.751,"15min":0.59099999999999997},"max":{"1min":2.9350000000000001,"5min":5.141,"15min":5.141},"last":1.952}]},{"osd":2,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":2.0019999999999998,"5min":1.9339999999999999,"15min":1.8680000000000001},"min":{"1min":1.2629999999999999,"5min":1.165,"15min":0.50800000000000001},"max":{"1min":2.677,"5min":5.2560000000000002,"15min":5.2560000000000002},"last":1.587},{"interface":"front","average":{"1min":2.472,"5min":2.5030000000000001,"15min":2.3439999999999999},"min":{"1min":1.7470000000000001,"5min":1.395,"15min":0.80400000000000005},"max":{"1min":3.1720000000000002,"5min":5.9569999999999999,"15min":5.9569999999999999},"last":2.4609999999999999}]},{"osd":4,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":2.363,"5min":2.1160000000000001,"15min":2.0760000000000001},"min":{"1min":1.595,"5min":1.3220000000000001,"15min":0.92500000000000004},"max":{"1min":3.415,"5min":4.0099999999999998,"15min":4.0099999999999998},"last":1.887},{"interface":"front","average":{"1min":3.012,"5min":2.774,"15min":2.6850000000000001},"min":{"1min":2.0529999999999999,"5min":1.901,"15min":1.1259999999999999},"max":{"1min":4.2050000000000001,"5min":5.0519999999999996,"15min":5.6749999999999998},"last":2.5030000000000001}]},{"osd":5,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":2.3260000000000001,"5min":2.3660000000000001,"15min":2.3359999999999999},"min":{"1min":1.5429999999999999,"5min":1.1890000000000001,"15min":0.73599999999999999},"max":{"1min":3.0409999999999999,"5min":5.4960000000000004,"15min":5.4960000000000004},"last":1.9850000000000001},{"interface":"front","average":{"1min":2.6930000000000001,"5min":2.548,"15min":2.512},"min":{"1min":1.879,"5min":1.639,"15min":1.0349999999999999},"max":{"1min":3.6499999999999999,"5min":4.3140000000000001,"15min":6.1390000000000002},"last":2.085}]},{"osd":6,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":2.7930000000000001,"5min":2.593,"15min":2.488},"min":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":0.93799999999999994},"max":{"1min":3.4750000000000001,"5min":3.9550000000000001,"15min":4.4509999999999996},"last":2.6669999999999998},{"interface":"front","average":{"1min":2.722,"5min":2.7789999999999999,"15min":2.7269999999999999},"min":{"1min":2.0939999999999999,"5min":1.5249999999999999,"15min":1.1120000000000001},"max":{"1min":3.5630000000000002,"5min":5.7169999999999996,"15min":5.7169999999999996},"last":2.1789999999999998}]},{"osd":7,"last update":"Thu Nov 12 12:19:12 2020","interfaces":[{"interface":"back","average":{"1min":3.0950000000000002,"5min":2.8679999999999999,"15min":2.802},"min":{"1min":1.788,"5min":1.788,"15min":1.228},"max":{"1min":3.8330000000000002,"5min":4.6879999999999997,"15min":6.7480000000000002},"last":2.29},{"interface":"front","average":{"1min":2.7320000000000002,"5min":2.7490000000000001,"15min":2.6680000000000001},"min":{"1min":2.1389999999999998,"5min":1.921,"15min":1.0109999999999999},"max":{"1min":3.4039999999999999,"5min":4.7629999999999999,"15min":5.2270000000000003},"last":2.415}]}]}]}} Ignoring malparsed backtrace: 2020-11-12T12:20:36.609 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:36.610 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 12:00:53.527167 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=0, tm_sec=53, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:20:36.610 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:20:48.748 7f1844f70700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.as0 on osd.1 to deep-scrub , 2020-11-12T12:20:49.121 INFO:teuthology.orchestra.run.smithi201:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b Ignoring malparsed backtrace: 2020-11-12T12:21:52.926 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:21:52.926 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:21:52.926 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-12 11:56:58.640486 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=58, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=12, tm_min=7, tm_sec=10, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: raise RuntimeError('Exiting scrub checking -- not all pgs scrubbed.') , RuntimeError: Exiting scrub checking -- not all pgs scrubbed. , 2020-11-12T12:22:34.247 INFO:teuthology.misc:Shutting down mds daemons... Ignoring malparsed backtrace: 2020-11-12T12:23:37.986 INFO:tasks.ceph:Archiving logs... , 2020-11-12T12:23:37.987 DEBUG:teuthology.misc:Transferring archived files from smithi201:/var/log/ceph to /home/teuthworker/archive/xxg-2020-11-12_11:34:06-rados:thrash-erasure-code-overwrites-nautilus-xyz-1829-distro-basic-smithi/5615706/remote/smithi201/log , 2020-11-12T12:23:37.990 INFO:teuthology.orchestra.run.smithi201:> sudo tar cz -f - -C /var/log/ceph -- . Ignoring malparsed backtrace: 2020-11-12T12:23:59.309 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2020-11-12T12:23:59.309 INFO:teuthology.orchestra.run.smithi058:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart , 2020-11-12T12:23:59.314 INFO:teuthology.orchestra.run.smithi201:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 14.2.11-111-g93c5d14 (93c5d149177634d9a3196c2990e4c0af398f8a4d) nautilus (stable) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::string const&)+0xdd) [0x7fdcd07ac524] , 2: (ReadOp::_finish(TestOp::CallbackInfo*)+0x13e8) [0x55c4b1766378] Ignoring malparsed backtrace: 2020-11-12T11:57:24.234 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:24.235 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:55:20.127831", , 2020-11-12T11:57:24.235 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg" Ignoring malparsed backtrace: 2020-11-12T11:57:24.248 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:55:20.128239", , 2020-11-12T11:57:24.248 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled" , 2020-11-12T11:57:24.249 INFO:teuthology.orchestra.run.smithi176.stdout: }, Ignoring malparsed backtrace: 2020-11-12T11:57:24.262 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:24.262 INFO:teuthology.orchestra.run.smithi176.stdout: "events": [ , 2020-11-12T11:57:24.262 INFO:teuthology.orchestra.run.smithi176.stdout: { Ignoring malparsed backtrace: 2020-11-12T11:57:24.276 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:24.276 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:24.276 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:55:59.826472", Ignoring malparsed backtrace: 2020-11-12T11:57:24.292 INFO:teuthology.orchestra.run.smithi176.stdout: "duration": 0.77456658099999998, , 2020-11-12T11:57:24.292 INFO:teuthology.orchestra.run.smithi176.stdout: "type_data": { , 2020-11-12T11:57:24.292 INFO:teuthology.orchestra.run.smithi176.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2020-11-12T11:57:24.306 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:24.306 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:56:38.078463", , 2020-11-12T11:57:24.306 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg" Ignoring malparsed backtrace: 2020-11-12T11:57:24.320 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:56:38.858770", , 2020-11-12T11:57:24.320 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "done" , 2020-11-12T11:57:24.320 INFO:teuthology.orchestra.run.smithi176.stdout: } Ignoring malparsed backtrace: 2020-11-12T11:57:24.333 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled" , 2020-11-12T11:57:24.333 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:24.334 INFO:teuthology.orchestra.run.smithi176.stdout: { Ignoring malparsed backtrace: 2020-11-12T11:57:24.347 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:24.347 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:24.347 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:56:42.940748", Ignoring malparsed backtrace: 2020-11-12T11:57:24.361 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:24.361 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:56:48.870939", , 2020-11-12T11:57:24.361 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "initiated" Ignoring malparsed backtrace: 2020-11-12T11:57:24.374 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:56:48.871084", , 2020-11-12T11:57:24.375 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "queued_for_pg" , 2020-11-12T11:57:24.375 INFO:teuthology.orchestra.run.smithi176.stdout: }, Ignoring malparsed backtrace: 2020-11-12T11:57:24.388 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:24.388 INFO:teuthology.orchestra.run.smithi176.stdout: "time": "2020-11-12 11:57:08.271422", , 2020-11-12T11:57:24.388 INFO:teuthology.orchestra.run.smithi176.stdout: "event": "throttled" Ignoring malparsed backtrace: 2020-11-12T11:57:24.770 INFO:teuthology.orchestra.run.smithi062:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops , 2020-11-12T11:57:24.788 DEBUG:teuthology.orchestra.run:got remote process result: None , 2020-11-12T11:57:24.790 ERROR:teuthology:Uncaught exception (Hub) Ignoring malparsed backtrace: command deprecated , 2020-11-12T11:57:32.429 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 3 1 , 2020-11-12 11:57:32.547 7f1dc907a700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12 11:57:39.747 7ff778a27700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 11:57:39.795 7ff778a27700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12T11:57:39.997 INFO:teuthology.orchestra.run.smithi176.stdout:55834574928 Ignoring malparsed backtrace: 2020-11-12T11:57:41.207 INFO:teuthology.orchestra.run.smithi176.stdout: "addrvec": [ , 2020-11-12T11:57:41.207 INFO:teuthology.orchestra.run.smithi176.stdout: { , 2020-11-12T11:57:41.207 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "v2", Ignoring malparsed backtrace: 2020-11-12T11:57:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: "smtp_destination": { , 2020-11-12T11:57:41.221 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "smtp_destination", Ignoring malparsed backtrace: 2020-11-12T11:57:41.235 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "str", , 2020-11-12T11:57:41.235 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.235 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 1, Ignoring malparsed backtrace: 2020-11-12T11:57:41.249 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "0000", , 2020-11-12T11:57:41.249 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", , 2020-11-12T11:57:41.249 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.263 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.263 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "minimum score, below which no optimization is attempted", , 2020-11-12T11:57:41.263 INFO:teuthology.orchestra.run.smithi176.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.277 INFO:teuthology.orchestra.run.smithi176.stdout: "warn_recent_interval": { , 2020-11-12T11:57:41.277 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "warn_recent_interval", , 2020-11-12T11:57:41.277 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "secs", Ignoring malparsed backtrace: 2020-11-12T11:57:41.290 INFO:teuthology.orchestra.run.smithi176.stdout: "long_desc": "", , 2020-11-12T11:57:41.291 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.291 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T11:57:41.304 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.304 INFO:teuthology.orchestra.run.smithi176.stdout: "GRAFANA_API_USERNAME": { , 2020-11-12T11:57:41.305 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "GRAFANA_API_USERNAME", Ignoring malparsed backtrace: 2020-11-12T11:57:41.318 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "str", , 2020-11-12T11:57:41.318 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.318 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T11:57:41.332 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "False", , 2020-11-12T11:57:41.332 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", , 2020-11-12T11:57:41.332 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.346 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.346 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", , 2020-11-12T11:57:41.346 INFO:teuthology.orchestra.run.smithi176.stdout: "long_desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.360 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "salt_api_url", , 2020-11-12T11:57:41.360 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "str", , 2020-11-12T11:57:41.360 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T11:57:41.373 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.373 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] , 2020-11-12T11:57:41.374 INFO:teuthology.orchestra.run.smithi176.stdout: }, Ignoring malparsed backtrace: 2020-11-12T11:57:41.387 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.387 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.388 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.401 INFO:teuthology.orchestra.run.smithi176.stdout: "long_desc": "", , 2020-11-12T11:57:41.401 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.401 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T11:57:41.415 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.415 INFO:teuthology.orchestra.run.smithi176.stdout: "password": { , 2020-11-12T11:57:41.415 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "password", Ignoring malparsed backtrace: 2020-11-12T11:57:41.428 INFO:teuthology.orchestra.run.smithi176.stdout: "can_run": true, , 2020-11-12T11:57:41.429 INFO:teuthology.orchestra.run.smithi176.stdout: "error_string": "", , 2020-11-12T11:57:41.429 INFO:teuthology.orchestra.run.smithi176.stdout: "module_options": { Ignoring malparsed backtrace: 2020-11-12T11:57:41.442 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.442 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.442 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.456 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.456 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, , 2020-11-12T11:57:41.456 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.470 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.470 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.470 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.483 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.483 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] , 2020-11-12T11:57:41.484 INFO:teuthology.orchestra.run.smithi176.stdout: }, Ignoring malparsed backtrace: 2020-11-12T11:57:41.497 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.497 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.497 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.511 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, , 2020-11-12T11:57:41.511 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "False", , 2020-11-12T11:57:41.511 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.524 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.525 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.525 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.538 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "None", , 2020-11-12T11:57:41.538 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", , 2020-11-12T11:57:41.538 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.552 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.552 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.552 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "SMTP server", Ignoring malparsed backtrace: 2020-11-12T11:57:41.566 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.566 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, , 2020-11-12T11:57:41.566 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: "crush_compat_metrics": { , 2020-11-12T11:57:41.579 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "crush_compat_metrics", Ignoring malparsed backtrace: 2020-11-12T11:57:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] , 2020-11-12T11:57:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.593 INFO:teuthology.orchestra.run.smithi176.stdout: "sleep_interval": { Ignoring malparsed backtrace: 2020-11-12T11:57:41.607 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "AUDIT_API_ENABLED", , 2020-11-12T11:57:41.607 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "bool", , 2020-11-12T11:57:41.607 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T11:57:41.621 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, , 2020-11-12T11:57:41.621 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "True", , 2020-11-12T11:57:41.621 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.634 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.634 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.634 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.648 INFO:teuthology.orchestra.run.smithi176.stdout: "long_desc": "", , 2020-11-12T11:57:41.648 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.648 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] Ignoring malparsed backtrace: 2020-11-12T11:57:41.662 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.662 INFO:teuthology.orchestra.run.smithi176.stdout: "password": { , 2020-11-12T11:57:41.662 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "password", Ignoring malparsed backtrace: 2020-11-12T11:57:41.675 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.675 INFO:teuthology.orchestra.run.smithi176.stdout: "url_prefix": { , 2020-11-12T11:57:41.676 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "url_prefix", Ignoring malparsed backtrace: 2020-11-12T11:57:41.689 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "bool", , 2020-11-12T11:57:41.689 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.689 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 1, Ignoring malparsed backtrace: 2020-11-12T11:57:41.703 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "7257600", , 2020-11-12T11:57:41.703 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", , 2020-11-12T11:57:41.703 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.717 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "diskprediction_ssl_target_name_override", , 2020-11-12T11:57:41.717 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "str", , 2020-11-12T11:57:41.717 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T11:57:41.730 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.730 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] , 2020-11-12T11:57:41.731 INFO:teuthology.orchestra.run.smithi176.stdout: } Ignoring malparsed backtrace: 2020-11-12T11:57:41.744 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", , 2020-11-12T11:57:41.744 INFO:teuthology.orchestra.run.smithi176.stdout: "enum_allowed": [], , 2020-11-12T11:57:41.744 INFO:teuthology.orchestra.run.smithi176.stdout: "desc": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.759 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "3", , 2020-11-12T11:57:41.759 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", , 2020-11-12T11:57:41.759 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.773 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "max_completed_events", , 2020-11-12T11:57:41.773 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "int", , 2020-11-12T11:57:41.773 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T11:57:41.787 INFO:teuthology.orchestra.run.smithi176.stdout: "tags": [], , 2020-11-12T11:57:41.787 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] , 2020-11-12T11:57:41.787 INFO:teuthology.orchestra.run.smithi176.stdout: }, Ignoring malparsed backtrace: 2020-11-12T11:57:41.801 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "str", , 2020-11-12T11:57:41.801 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.801 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T11:57:41.814 INFO:teuthology.orchestra.run.smithi176.stdout: "default_value": "", , 2020-11-12T11:57:41.814 INFO:teuthology.orchestra.run.smithi176.stdout: "min": "", , 2020-11-12T11:57:41.815 INFO:teuthology.orchestra.run.smithi176.stdout: "max": "", Ignoring malparsed backtrace: 2020-11-12T11:57:41.828 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "secs", , 2020-11-12T11:57:41.828 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", , 2020-11-12T11:57:41.828 INFO:teuthology.orchestra.run.smithi176.stdout: "flags": 0, Ignoring malparsed backtrace: 2020-11-12T11:57:41.842 INFO:teuthology.orchestra.run.smithi176.stdout: "see_also": [] , 2020-11-12T11:57:41.842 INFO:teuthology.orchestra.run.smithi176.stdout: }, , 2020-11-12T11:57:41.842 INFO:teuthology.orchestra.run.smithi176.stdout: "device_url": { Ignoring malparsed backtrace: 2020-11-12T11:57:41.856 INFO:teuthology.orchestra.run.smithi176.stdout: "name": "url", , 2020-11-12T11:57:41.856 INFO:teuthology.orchestra.run.smithi176.stdout: "type": "str", , 2020-11-12T11:57:41.856 INFO:teuthology.orchestra.run.smithi176.stdout: "level": "advanced", Ignoring malparsed backtrace: 2020-11-12T11:57:41.869 INFO:teuthology.orchestra.run.smithi176.stdout: } , 2020-11-12T11:57:41.870 INFO:teuthology.orchestra.run.smithi176.stdout: } , 2020-11-12T11:57:41.870 INFO:teuthology.orchestra.run.smithi176.stdout: } Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2020-11-12T11:57:48.222 INFO:tasks.ceph:Scrubbing osd.6 , 2020-11-12T11:57:48.223 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 Ignoring malparsed backtrace: 2020-11-12T11:58:30.607 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T11:58:30.608 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 11:54:14.830505 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=54, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T11:58:30.608 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T11:59:31.821 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T11:59:31.821 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T11:59:31.822 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.f Ignoring malparsed backtrace: 2020-11-12 12:00:01.164 7f522fc0f700 -1 WARNING: all dangerous and experimental features are enabled. , dumped all , 2020-11-12T12:00:01.377 INFO:teuthology.orchestra.run.smithi176.stdout: Ignoring malparsed backtrace: 2020-11-12T12:01:02.648 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-12 11:56:05.288433 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=5, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:01:02.649 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:01:02.649 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 11:57:04.108192 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=4, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: instructing pg 1.6 on osd.3 to deep-scrub , 2020-11-12T12:01:45.464 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.5 , 2020-11-12 12:01:45.591 7ff65302a700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:02:13.147 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 11:56:40.929466 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=40, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:02:13.148 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:02:13.148 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:03:34.422 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json , 2020-11-12 12:03:34.538 7f0f5a76e700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:03:34.583 7f0f5a76e700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:03:59.096 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.0 , 2020-11-12 12:03:59.214 7f836607d700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:03:59.262 7f836607d700 -1 WARNING: all dangerous and experimental features are enabled. Ignoring malparsed backtrace: 2020-11-12T12:04:45.265 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:04:45.265 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-11-12 11:52:29.777275 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=52, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:04:45.266 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:05:46.500 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-12 11:54:14.830505 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=54, tm_sec=14, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:05:46.501 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:05:46.501 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-12 11:56:40.929466 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=40, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:06:12.708 7f930697d700 -1 WARNING: all dangerous and experimental features are enabled. , 2020-11-12 12:06:12.756 7f930697d700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 1.2 on osd.0 to deep-scrub Ignoring malparsed backtrace: dumped all , 2020-11-12T12:07:17.459 INFO:teuthology.orchestra.run.smithi176.stdout: , 2020-11-12T12:07:17.478 INFO:teuthology.orchestra.run.smithi176.stdout:{"pg_ready":true,"pg_map":{"version":855,"stamp":"2020-11-12 12:07:16.727480","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3176713258,"num_objects":1142,"num_object_clones":198,"num_object_copies":6852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":20,"num_read":3976,"num_read_kb":1980271,"num_write":8973,"num_write_kb":2155167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11963,"num_bytes_recovered":29640288881,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22771,"ondisk_log_size":22771,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":11538472,"kb_used_data":3134148,"kb_used_omap":723,"kb_used_meta":8387884,"kb_avail":743436248,"statfs":{"total":773094113280,"available":761278717952,"internally_reserved":8589934592,"allocated":3209367552,"data_stored":3481930191,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":740948,"internal_metadata":8589193644},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002425"},"pg_stats":[{"pgid":"2.f","version":"362'1255","reported_seq":"3039","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.047974","last_change":"2020-11-12 11:57:24.244940","last_active":"2020-11-12 11:57:33.047974","last_peered":"2020-11-12 11:57:33.047974","last_clean":"2020-11-12 11:57:33.047974","last_became_active":"2020-11-12 11:56:51.893987","last_became_peered":"2020-11-12 11:56:51.893987","last_unstale":"2020-11-12 11:57:33.047974","last_undegraded":"2020-11-12 11:57:33.047974","last_fullsized":"2020-11-12 11:57:33.047974","mapping_epoch":329,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":330,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1255,"ondisk_log_size":1255,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":175351513,"num_objects":61,"num_object_clones":8,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":61,"num_whiteouts":0,"num_read":211,"num_read_kb":81569,"num_write":455,"num_write_kb":112288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":264,"num_bytes_recovered":723647392,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"2.e","version":"362'1627","reported_seq":"4920","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.061558","last_change":"2020-11-12 11:57:33.059533","last_active":"2020-11-12 11:57:33.061558","last_peered":"2020-11-12 11:57:33.061558","last_clean":"2020-11-12 11:57:33.061558","last_became_active":"2020-11-12 11:57:33.056796","last_became_peered":"2020-11-12 11:57:33.056796","last_unstale":"2020-11-12 11:57:33.061558","last_undegraded":"2020-11-12 11:57:33.061558","last_fullsized":"2020-11-12 11:57:33.061558","mapping_epoch":369,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":370,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1627,"ondisk_log_size":1627,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":174026025,"num_objects":60,"num_object_clones":6,"num_object_copies":360,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":60,"num_whiteouts":1,"num_read":216,"num_read_kb":94401,"num_write":552,"num_write_kb":123623,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":994,"num_bytes_recovered":2200037383,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.7","version":"0'0","reported_seq":"394","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.046611","last_change":"2020-11-12 11:57:28.217523","last_active":"2020-11-12 11:57:33.046611","last_peered":"2020-11-12 11:57:33.046611","last_clean":"2020-11-12 11:57:33.046611","last_became_active":"2020-11-12 11:54:18.795848","last_became_peered":"2020-11-12 11:54:18.795848","last_unstale":"2020-11-12 11:57:33.046611","last_undegraded":"2020-11-12 11:57:33.046611","last_fullsized":"2020-11-12 11:57:33.046611","mapping_epoch":176,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":177,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:28.217475","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:57:28.217475","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"362'1304","reported_seq":"3963","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.050439","last_change":"2020-11-12 11:57:24.309153","last_active":"2020-11-12 11:57:33.050439","last_peered":"2020-11-12 11:57:33.050439","last_clean":"2020-11-12 11:57:33.050439","last_became_active":"2020-11-12 11:57:08.830558","last_became_peered":"2020-11-12 11:57:08.830558","last_unstale":"2020-11-12 11:57:33.050439","last_undegraded":"2020-11-12 11:57:33.050439","last_fullsized":"2020-11-12 11:57:33.050439","mapping_epoch":346,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":347,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1304,"ondisk_log_size":1304,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":181826042,"num_objects":59,"num_object_clones":6,"num_object_copies":354,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":59,"num_whiteouts":1,"num_read":258,"num_read_kb":160527,"num_write":492,"num_write_kb":132614,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":601,"num_bytes_recovered":1533170152,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.6","version":"0'0","reported_seq":"345","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.049014","last_change":"2020-11-12 11:56:05.288483","last_active":"2020-11-12 11:57:33.049014","last_peered":"2020-11-12 11:57:33.049014","last_clean":"2020-11-12 11:57:33.049014","last_became_active":"2020-11-12 11:55:21.127451","last_became_peered":"2020-11-12 11:55:21.127451","last_unstale":"2020-11-12 11:57:33.049014","last_undegraded":"2020-11-12 11:57:33.049014","last_fullsized":"2020-11-12 11:57:33.049014","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:05.288433","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:56:05.288433","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"362'1188","reported_seq":"3664","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048851","last_change":"2020-11-12 11:57:24.605930","last_active":"2020-11-12 11:57:33.048851","last_peered":"2020-11-12 11:57:33.048851","last_clean":"2020-11-12 11:57:33.048851","last_became_active":"2020-11-12 11:57:07.883237","last_became_peered":"2020-11-12 11:57:07.883237","last_unstale":"2020-11-12 11:57:33.048851","last_undegraded":"2020-11-12 11:57:33.048851","last_fullsized":"2020-11-12 11:57:33.048851","mapping_epoch":345,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":346,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1188,"ondisk_log_size":1188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":159076909,"num_objects":53,"num_object_clones":5,"num_object_copies":318,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":53,"num_whiteouts":1,"num_read":181,"num_read_kb":92222,"num_write":385,"num_write_kb":104981,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":579,"num_bytes_recovered":1478029823,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.5","version":"0'0","reported_seq":"13","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.045179","last_change":"2020-11-12 11:57:30.014090","last_active":"2020-11-12 11:57:33.045179","last_peered":"2020-11-12 11:57:33.045179","last_clean":"2020-11-12 11:57:33.045179","last_became_active":"2020-11-12 11:57:30.013694","last_became_peered":"2020-11-12 11:57:30.013694","last_unstale":"2020-11-12 11:57:33.045179","last_undegraded":"2020-11-12 11:57:33.045179","last_fullsized":"2020-11-12 11:57:33.045179","mapping_epoch":366,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":367,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:57:04.108192","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:57:04.108192","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"362'1448","reported_seq":"4465","reported_epoch":"370","state":"active+clean+scrubbing","last_fresh":"2020-11-12 11:57:33.049164","last_change":"2020-11-12 11:57:29.084823","last_active":"2020-11-12 11:57:33.049164","last_peered":"2020-11-12 11:57:33.049164","last_clean":"2020-11-12 11:57:33.049164","last_became_active":"2020-11-12 11:57:08.834250","last_became_peered":"2020-11-12 11:57:08.834250","last_unstale":"2020-11-12 11:57:33.049164","last_undegraded":"2020-11-12 11:57:33.049164","last_fullsized":"2020-11-12 11:57:33.049164","mapping_epoch":346,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":347,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1448,"ondisk_log_size":1448,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":176411746,"num_objects":70,"num_object_clones":19,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":1,"num_read":215,"num_read_kb":86868,"num_write":498,"num_write_kb":119781,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":660,"num_bytes_recovered":1621902194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.4","version":"0'0","reported_seq":"36","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.053378","last_change":"2020-11-12 11:57:04.866393","last_active":"2020-11-12 11:57:33.053378","last_peered":"2020-11-12 11:57:33.053378","last_clean":"2020-11-12 11:57:33.053378","last_became_active":"2020-11-12 11:57:04.865833","last_became_peered":"2020-11-12 11:57:04.865833","last_unstale":"2020-11-12 11:57:33.053378","last_undegraded":"2020-11-12 11:57:33.053378","last_fullsized":"2020-11-12 11:57:33.053378","mapping_epoch":342,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":343,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:52:29.777275","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:52:29.777275","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"362'1397","reported_seq":"4126","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.049127","last_change":"2020-11-12 11:57:24.635753","last_active":"2020-11-12 11:57:33.049127","last_peered":"2020-11-12 11:57:33.049127","last_clean":"2020-11-12 11:57:33.049127","last_became_active":"2020-11-12 11:56:47.833700","last_became_peered":"2020-11-12 11:56:47.833700","last_unstale":"2020-11-12 11:57:33.049127","last_undegraded":"2020-11-12 11:57:33.049127","last_fullsized":"2020-11-12 11:57:33.049127","mapping_epoch":325,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":326,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1397,"ondisk_log_size":1397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":194918647,"num_objects":67,"num_object_clones":11,"num_object_copies":402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":67,"num_whiteouts":0,"num_read":247,"num_read_kb":157289,"num_write":517,"num_write_kb":124319,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":686,"num_bytes_recovered":1929681777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.0","version":"0'0","reported_seq":"376","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.046311","last_change":"2020-11-12 11:56:16.170944","last_active":"2020-11-12 11:57:33.046311","last_peered":"2020-11-12 11:57:33.046311","last_clean":"2020-11-12 11:57:33.046311","last_became_active":"2020-11-12 11:52:10.572482","last_became_peered":"2020-11-12 11:52:10.572482","last_unstale":"2020-11-12 11:57:33.046311","last_undegraded":"2020-11-12 11:57:33.046311","last_fullsized":"2020-11-12 11:57:33.046311","mapping_epoch":47,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":48,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:16.170890","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:56:16.170890","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"356'1523","reported_seq":"4118","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048854","last_change":"2020-11-12 11:56:51.057324","last_active":"2020-11-12 11:57:33.048854","last_peered":"2020-11-12 11:57:33.048854","last_clean":"2020-11-12 11:57:33.048854","last_became_active":"2020-11-12 11:56:01.819789","last_became_peered":"2020-11-12 11:56:01.819789","last_unstale":"2020-11-12 11:57:33.048854","last_undegraded":"2020-11-12 11:57:33.048854","last_fullsized":"2020-11-12 11:57:33.048854","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":280,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1523,"ondisk_log_size":1523,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":21,"stat_sum":{"num_bytes":181388569,"num_objects":79,"num_object_clones":25,"num_object_copies":474,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":79,"num_whiteouts":2,"num_read":228,"num_read_kb":95039,"num_write":593,"num_write_kb":122859,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":595,"num_bytes_recovered":1590127505,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"349","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048800","last_change":"2020-11-12 11:55:21.134253","last_active":"2020-11-12 11:57:33.048800","last_peered":"2020-11-12 11:57:33.048800","last_clean":"2020-11-12 11:57:33.048800","last_became_active":"2020-11-12 11:55:21.133347","last_became_peered":"2020-11-12 11:55:21.133347","last_unstale":"2020-11-12 11:57:33.048800","last_undegraded":"2020-11-12 11:57:33.048800","last_fullsized":"2020-11-12 11:57:33.048800","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":239,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:52:27.326013","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:52:27.326013","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"362'1356","reported_seq":"4747","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048944","last_change":"2020-11-12 11:57:24.428140","last_active":"2020-11-12 11:57:33.048944","last_peered":"2020-11-12 11:57:33.048944","last_clean":"2020-11-12 11:57:33.048944","last_became_active":"2020-11-12 11:57:09.833939","last_became_peered":"2020-11-12 11:57:09.833939","last_unstale":"2020-11-12 11:57:33.048944","last_undegraded":"2020-11-12 11:57:33.048944","last_fullsized":"2020-11-12 11:57:33.048944","mapping_epoch":347,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":348,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1356,"ondisk_log_size":1356,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":190975312,"num_objects":70,"num_object_clones":9,"num_object_copies":420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":1,"num_read":246,"num_read_kb":149551,"num_write":530,"num_write_kb":129156,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":769,"num_bytes_recovered":1958745448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"2.1","version":"362'1310","reported_seq":"4184","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.053267","last_change":"2020-11-12 11:57:24.397306","last_active":"2020-11-12 11:57:33.053267","last_peered":"2020-11-12 11:57:33.053267","last_clean":"2020-11-12 11:57:33.053267","last_became_active":"2020-11-12 11:57:08.827766","last_became_peered":"2020-11-12 11:57:08.827766","last_unstale":"2020-11-12 11:57:33.053267","last_undegraded":"2020-11-12 11:57:33.053267","last_fullsized":"2020-11-12 11:57:33.053267","mapping_epoch":346,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":347,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1310,"ondisk_log_size":1310,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":211213597,"num_objects":68,"num_object_clones":7,"num_object_copies":408,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":313,"num_read_kb":218681,"num_write":643,"num_write_kb":154496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":651,"num_bytes_recovered":1633293799,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.2","version":"0'0","reported_seq":"53","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.047883","last_change":"2020-11-12 11:56:47.826796","last_active":"2020-11-12 11:57:33.047883","last_peered":"2020-11-12 11:57:33.047883","last_clean":"2020-11-12 11:57:33.047883","last_became_active":"2020-11-12 11:56:47.823660","last_became_peered":"2020-11-12 11:56:47.823660","last_unstale":"2020-11-12 11:57:33.047883","last_undegraded":"2020-11-12 11:57:33.047883","last_fullsized":"2020-11-12 11:57:33.047883","mapping_epoch":325,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":326,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:54:14.830505","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:54:14.830505","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"362'2102","reported_seq":"5481","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048840","last_change":"2020-11-12 11:57:24.430082","last_active":"2020-11-12 11:57:33.048840","last_peered":"2020-11-12 11:57:33.048840","last_clean":"2020-11-12 11:57:33.048840","last_became_active":"2020-11-12 11:57:09.830285","last_became_peered":"2020-11-12 11:57:09.830285","last_unstale":"2020-11-12 11:57:33.048840","last_undegraded":"2020-11-12 11:57:33.048840","last_fullsized":"2020-11-12 11:57:33.048840","mapping_epoch":347,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":348,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":2102,"ondisk_log_size":2102,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":237518630,"num_objects":82,"num_object_clones":10,"num_object_copies":492,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":82,"num_whiteouts":0,"num_read":323,"num_read_kb":149949,"num_write":728,"num_write_kb":171198,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1030,"num_bytes_recovered":2577100110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"1.3","version":"0'0","reported_seq":"310","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048757","last_change":"2020-11-12 11:56:40.929508","last_active":"2020-11-12 11:57:33.048757","last_peered":"2020-11-12 11:57:33.048757","last_clean":"2020-11-12 11:57:33.048757","last_became_active":"2020-11-12 11:55:58.816158","last_became_peered":"2020-11-12 11:55:58.816158","last_unstale":"2020-11-12 11:57:33.048757","last_undegraded":"2020-11-12 11:57:33.048757","last_fullsized":"2020-11-12 11:57:33.048757","mapping_epoch":276,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":277,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:56:40.929466","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:15.052658","last_clean_scrub_stamp":"2020-11-12 11:56:40.929466","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"362'1189","reported_seq":"3832","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048291","last_change":"2020-11-12 11:57:24.241430","last_active":"2020-11-12 11:57:33.048291","last_peered":"2020-11-12 11:57:33.048291","last_clean":"2020-11-12 11:57:33.048291","last_became_active":"2020-11-12 11:57:08.827935","last_became_peered":"2020-11-12 11:57:08.827935","last_unstale":"2020-11-12 11:57:33.048291","last_undegraded":"2020-11-12 11:57:33.048291","last_fullsized":"2020-11-12 11:57:33.048291","mapping_epoch":346,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":347,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1189,"ondisk_log_size":1189,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":194407678,"num_objects":64,"num_object_clones":5,"num_object_copies":384,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":1,"num_read":242,"num_read_kb":127474,"num_write":501,"num_write_kb":134548,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":625,"num_bytes_recovered":1592877204,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"2.9","version":"362'1605","reported_seq":"6176","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048622","last_change":"2020-11-12 11:57:24.456465","last_active":"2020-11-12 11:57:33.048622","last_peered":"2020-11-12 11:57:33.048622","last_clean":"2020-11-12 11:57:33.048622","last_became_active":"2020-11-12 11:57:08.835696","last_became_peered":"2020-11-12 11:57:08.835696","last_unstale":"2020-11-12 11:57:33.048622","last_undegraded":"2020-11-12 11:57:33.048622","last_fullsized":"2020-11-12 11:57:33.048622","mapping_epoch":346,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":347,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1605,"ondisk_log_size":1605,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":235282174,"num_objects":85,"num_object_clones":14,"num_object_copies":510,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":85,"num_whiteouts":0,"num_read":268,"num_read_kb":98974,"num_write":664,"num_write_kb":157676,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1349,"num_bytes_recovered":3379068675,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"2.a","version":"349'1251","reported_seq":"4364","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.054034","last_change":"2020-11-12 11:57:10.862844","last_active":"2020-11-12 11:57:33.054034","last_peered":"2020-11-12 11:57:33.054034","last_clean":"2020-11-12 11:57:33.054034","last_became_active":"2020-11-12 11:56:52.881507","last_became_peered":"2020-11-12 11:56:52.881507","last_unstale":"2020-11-12 11:57:33.054034","last_undegraded":"2020-11-12 11:57:33.054034","last_fullsized":"2020-11-12 11:57:33.054034","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1251,"ondisk_log_size":1251,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":10,"stat_sum":{"num_bytes":234483607,"num_objects":94,"num_object_clones":25,"num_object_copies":564,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":94,"num_whiteouts":3,"num_read":239,"num_read_kb":97130,"num_write":510,"num_write_kb":133516,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":824,"num_bytes_recovered":2185780738,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"e5","length":"1"},{"start":"100","length":"2"},{"start":"10d","length":"2"},{"start":"112","length":"1"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"}]},{"pgid":"2.b","version":"362'1639","reported_seq":"4175","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.048983","last_change":"2020-11-12 11:57:24.747492","last_active":"2020-11-12 11:57:33.048983","last_peered":"2020-11-12 11:57:33.048983","last_clean":"2020-11-12 11:57:33.048983","last_became_active":"2020-11-12 11:56:52.881356","last_became_peered":"2020-11-12 11:56:52.881356","last_unstale":"2020-11-12 11:57:33.048983","last_undegraded":"2020-11-12 11:57:33.048983","last_fullsized":"2020-11-12 11:57:33.048983","mapping_epoch":330,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":331,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1639,"ondisk_log_size":1639,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":219245508,"num_objects":73,"num_object_clones":12,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":73,"num_whiteouts":1,"num_read":261,"num_read_kb":116260,"num_write":572,"num_write_kb":151179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":613,"num_bytes_recovered":1501546609,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]},{"pgid":"2.c","version":"360'1214","reported_seq":"4136","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.054137","last_change":"2020-11-12 11:57:22.618208","last_active":"2020-11-12 11:57:33.054137","last_peered":"2020-11-12 11:57:33.054137","last_clean":"2020-11-12 11:57:33.054137","last_became_active":"2020-11-12 11:57:09.845248","last_became_peered":"2020-11-12 11:57:09.845248","last_unstale":"2020-11-12 11:57:33.054137","last_undegraded":"2020-11-12 11:57:33.054137","last_fullsized":"2020-11-12 11:57:33.054137","mapping_epoch":347,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":348,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1214,"ondisk_log_size":1214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"stat_sum":{"num_bytes":206838070,"num_objects":86,"num_object_clones":28,"num_object_copies":516,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":86,"num_whiteouts":3,"num_read":263,"num_read_kb":126363,"num_write":644,"num_write_kb":145509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":825,"num_bytes_recovered":1877272395,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ff","length":"3"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"12a","length":"1"}]},{"pgid":"2.d","version":"362'1363","reported_seq":"4416","reported_epoch":"370","state":"active+clean","last_fresh":"2020-11-12 11:57:33.062173","last_change":"2020-11-12 11:57:33.059455","last_active":"2020-11-12 11:57:33.062173","last_peered":"2020-11-12 11:57:33.062173","last_clean":"2020-11-12 11:57:33.062173","last_became_active":"2020-11-12 11:57:33.057054","last_became_peered":"2020-11-12 11:57:33.057054","last_unstale":"2020-11-12 11:57:33.062173","last_undegraded":"2020-11-12 11:57:33.062173","last_fullsized":"2020-11-12 11:57:33.062173","mapping_epoch":369,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":370,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-12 11:51:33.355045","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-12 11:51:33.355045","last_clean_scrub_stamp":"2020-11-12 11:51:33.355045","log_size":1363,"ondisk_log_size":1363,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":203749231,"num_objects":71,"num_object_clones":8,"num_object_copies":426,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":3,"num_read":265,"num_read_kb":127974,"num_write":689,"num_write_kb":137424,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":898,"num_bytes_recovered":1858007677,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"c4","length":"1"},{"start":"d7","length":"1"},{"start":"e5","length":"1"},{"start":"ec","length":"1"},{"start":"ff","length":"3"},{"start":"10b","length":"1"},{"start":"10d","length":"2"},{"start":"112","length":"3"},{"start":"118","length":"1"},{"start":"11a","length":"1"},{"start":"120","length":"1"},{"start":"122","length":"2"},{"start":"129","length":"2"},{"start":"131","length":"1"}]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":3176713258,"num_objects":1142,"num_object_clones":198,"num_object_copies":6852,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1142,"num_whiteouts":20,"num_read":3976,"num_read_kb":1980271,"num_write":8973,"num_write_kb":2155167,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11963,"num_bytes_recovered":29640288881,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":3173224448,"data_stored":3462494031,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":22771,"ondisk_log_size":22771,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575044,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1427972,"kb_used_data":372948,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92943868,"statfs":{"total":96636764160,"available":95174520832,"internally_reserved":1073741824,"allocated":381898752,"data_stored":382192107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:43 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.02,"15min":0.96099999999999997},"min":{"1min":0.55100000000000005,"5min":0.46800000000000003,"15min":0.436},"max":{"1min":1.4350000000000001,"5min":1.6060000000000001,"15min":3.835},"last":0.56899999999999995},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.1240000000000001,"15min":1.0640000000000001},"min":{"1min":0.81200000000000006,"5min":0.66500000000000004,"15min":0.53800000000000003},"max":{"1min":1.659,"5min":1.9039999999999999,"15min":4.3460000000000001},"last":1.0880000000000001}]},{"osd":1,"last update":"Thu Nov 12 12:06:43 2020","interfaces":[{"interface":"back","average":{"1min":0.86099999999999999,"5min":0.83599999999999997,"15min":0.85799999999999998},"min":{"1min":0.63200000000000001,"5min":0.49299999999999999,"15min":0.48799999999999999},"max":{"1min":1.3420000000000001,"5min":1.6439999999999999,"15min":4.0650000000000004},"last":0.85099999999999998},{"interface":"front","average":{"1min":0.84199999999999997,"5min":0.90100000000000002,"15min":0.93700000000000006},"min":{"1min":0.56999999999999995,"5min":0.47599999999999998,"15min":0.44},"max":{"1min":1.159,"5min":1.54,"15min":4.9009999999999998},"last":0.63400000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:06:43 2020","interfaces":[{"interface":"back","average":{"1min":1.028,"5min":0.98999999999999999,"15min":0.96999999999999997},"min":{"1min":0.59399999999999997,"5min":0.47899999999999998,"15min":0.47899999999999998},"max":{"1min":1.4450000000000001,"5min":1.782,"15min":5.351},"last":0.65300000000000002},{"interface":"front","average":{"1min":0.98099999999999998,"5min":1.0029999999999999,"15min":1.0389999999999999},"min":{"1min":0.70899999999999996,"5min":0.63100000000000001,"15min":0.61699999999999999},"max":{"1min":1.4610000000000001,"5min":1.4930000000000001,"15min":5.2110000000000003},"last":0.99299999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:06:46 2020","interfaces":[{"interface":"back","average":{"1min":1.008,"5min":0.98299999999999998,"15min":0.98899999999999999},"min":{"1min":0.625,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.5029999999999999,"5min":1.6160000000000001,"15min":6.4829999999999997},"last":0.83499999999999996},{"interface":"front","average":{"1min":0.93600000000000005,"5min":1.056,"15min":1.026},"min":{"1min":0.623,"5min":0.623,"15min":0.623},"max":{"1min":1.5609999999999999,"5min":1.7889999999999999,"15min":2.6800000000000002},"last":0.77800000000000002}]},{"osd":4,"last update":"Thu Nov 12 12:06:18 2020","interfaces":[{"interface":"back","average":{"1min":0.84699999999999998,"5min":0.90700000000000003,"15min":0.96799999999999997},"min":{"1min":0.53500000000000003,"5min":0.53500000000000003,"15min":0.53500000000000003},"max":{"1min":1.0920000000000001,"5min":1.804,"15min":1.8280000000000001},"last":0.755},{"interface":"front","average":{"1min":0.94099999999999995,"5min":0.91400000000000003,"15min":1.073},"min":{"1min":0.58199999999999996,"5min":0.58199999999999996,"15min":0.52600000000000002},"max":{"1min":1.5389999999999999,"5min":1.5389999999999999,"15min":4.9960000000000004},"last":0.70199999999999996}]},{"osd":5,"last update":"Thu Nov 12 12:06:43 2020","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":0.99299999999999999,"15min":1.113},"min":{"1min":0.68200000000000005,"5min":0.58899999999999997,"15min":0.54300000000000004},"max":{"1min":1.5009999999999999,"5min":1.585,"15min":4.8310000000000004},"last":0.92400000000000004},{"interface":"front","average":{"1min":1.1459999999999999,"5min":1.1579999999999999,"15min":1.165},"min":{"1min":0.88100000000000001,"5min":0.72299999999999998,"15min":0.627},"max":{"1min":1.548,"5min":1.7010000000000001,"15min":3.9049999999999998},"last":0.91000000000000003}]},{"osd":6,"last update":"Thu Nov 12 12:06:43 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.2150000000000001,"15min":1.2490000000000001},"min":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.65200000000000002},"max":{"1min":1.6080000000000001,"5min":1.6910000000000001,"15min":4.883},"last":1.018},{"interface":"front","average":{"1min":1.3400000000000001,"5min":1.3759999999999999,"15min":1.367},"min":{"1min":0.97699999999999998,"5min":0.90000000000000002,"15min":0.86399999999999999},"max":{"1min":1.74,"5min":2.008,"15min":5.1710000000000003},"last":1.165}]}]},{"osd":6,"up_from":13,"seq":55834575046,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1430624,"kb_used_data":382040,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92941216,"statfs":{"total":96636764160,"available":95171805184,"internally_reserved":1073741824,"allocated":391208960,"data_stored":436105911,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:41 2020","interfaces":[{"interface":"back","average":{"1min":0.72199999999999998,"5min":0.90600000000000003,"15min":0.875},"min":{"1min":0.55400000000000005,"5min":0.498,"15min":0.433},"max":{"1min":0.92200000000000004,"5min":1.6879999999999999,"15min":4.9249999999999998},"last":0.91300000000000003},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.92400000000000004,"15min":0.93500000000000005},"min":{"1min":0.60699999999999998,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.157,"5min":1.446,"15min":9.1500000000000004},"last":1.472}]},{"osd":1,"last update":"Thu Nov 12 12:06:41 2020","interfaces":[{"interface":"back","average":{"1min":0.93600000000000005,"5min":0.93799999999999994,"15min":0.96099999999999997},"min":{"1min":0.55600000000000005,"5min":0.52500000000000002,"15min":0.51000000000000001},"max":{"1min":1.446,"5min":1.552,"15min":11.996},"last":1.246},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.2210000000000001,"15min":1.1990000000000001},"min":{"1min":0.80000000000000004,"5min":0.73399999999999999,"15min":0.46000000000000002},"max":{"1min":1.4350000000000001,"5min":1.7030000000000001,"15min":12.025},"last":1.4490000000000001}]},{"osd":2,"last update":"Thu Nov 12 12:06:41 2020","interfaces":[{"interface":"back","average":{"1min":0.89400000000000002,"5min":0.96899999999999997,"15min":0.98799999999999999},"min":{"1min":0.70799999999999996,"5min":0.59499999999999997,"15min":0.55600000000000005},"max":{"1min":1.105,"5min":1.6339999999999999,"15min":2.415},"last":1.026},{"interface":"front","average":{"1min":1.069,"5min":1.0760000000000001,"15min":1.0589999999999999},"min":{"1min":0.63400000000000001,"5min":0.63400000000000001,"15min":0.56899999999999995},"max":{"1min":1.375,"5min":1.8320000000000001,"15min":3.4199999999999999},"last":1.139}]},{"osd":3,"last update":"Thu Nov 12 12:06:41 2020","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":0.98099999999999998,"15min":1.046},"min":{"1min":0.66100000000000003,"5min":0.63,"15min":0.63},"max":{"1min":1.452,"5min":1.611,"15min":3.0960000000000001},"last":1.3899999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.081,"15min":1.1699999999999999},"min":{"1min":0.66800000000000004,"5min":0.64600000000000002,"15min":0.63900000000000001},"max":{"1min":1.256,"5min":1.788,"15min":9.4139999999999997},"last":1.121}]},{"osd":4,"last update":"Thu Nov 12 12:06:20 2020","interfaces":[{"interface":"back","average":{"1min":0.86699999999999999,"5min":0.91100000000000003,"15min":1.119},"min":{"1min":0.57399999999999995,"5min":0.45100000000000001,"15min":0.45100000000000001},"max":{"1min":1.2869999999999999,"5min":1.7789999999999999,"15min":9.6039999999999992},"last":1.296},{"interface":"front","average":{"1min":1.0649999999999999,"5min":1.0649999999999999,"15min":1.175},"min":{"1min":0.73899999999999999,"5min":0.60599999999999998,"15min":0.56299999999999994},"max":{"1min":1.605,"5min":2.0449999999999999,"15min":4.609},"last":0.83199999999999996}]},{"osd":5,"last update":"Thu Nov 12 12:06:41 2020","interfaces":[{"interface":"back","average":{"1min":1.1499999999999999,"5min":1.115,"15min":1.1220000000000001},"min":{"1min":0.82499999999999996,"5min":0.61399999999999999,"15min":0.53200000000000003},"max":{"1min":1.524,"5min":1.5580000000000001,"15min":2.4660000000000002},"last":1.038},{"interface":"front","average":{"1min":1.2749999999999999,"5min":1.3069999999999999,"15min":1.272},"min":{"1min":0.82699999999999996,"5min":0.76300000000000001,"15min":0.53800000000000003},"max":{"1min":1.6919999999999999,"5min":1.8839999999999999,"15min":3.153},"last":0.94999999999999996}]},{"osd":7,"last update":"Thu Nov 12 12:06:41 2020","interfaces":[{"interface":"back","average":{"1min":1.1120000000000001,"5min":1.161,"15min":1.165},"min":{"1min":0.80000000000000004,"5min":0.68500000000000005,"15min":0.52800000000000002},"max":{"1min":1.575,"5min":1.734,"15min":3.0030000000000001},"last":1.206},{"interface":"front","average":{"1min":1.335,"5min":1.413,"15min":1.3720000000000001},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":0.57199999999999995},"max":{"1min":1.603,"5min":1.9179999999999999,"15min":2.6160000000000001},"last":1.353}]}]},{"osd":5,"up_from":47,"seq":201863463095,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1581588,"kb_used_data":529660,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":92790252,"statfs":{"total":96636764160,"available":95017218048,"internally_reserved":1073741824,"allocated":542371840,"data_stored":597568203,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8283,"internal_metadata":1073733541},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:35 2020","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":1.0229999999999999,"15min":0.97299999999999998},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.442},"max":{"1min":1.718,"5min":1.718,"15min":6.1959999999999997},"last":0.72699999999999998},{"interface":"front","average":{"1min":0.85899999999999999,"5min":0.86499999999999999,"15min":0.89100000000000001},"min":{"1min":0.52900000000000003,"5min":0.52000000000000002,"15min":0.45800000000000002},"max":{"1min":1.2809999999999999,"5min":1.577,"15min":3.6230000000000002},"last":0.746}]},{"osd":1,"last update":"Thu Nov 12 12:06:39 2020","interfaces":[{"interface":"back","average":{"1min":1.0529999999999999,"5min":0.96399999999999997,"15min":0.97699999999999998},"min":{"1min":0.51900000000000002,"5min":0.51900000000000002,"15min":0.47799999999999998},"max":{"1min":2.173,"5min":2.173,"15min":5.194},"last":1.121},{"interface":"front","average":{"1min":1.0680000000000001,"5min":1.085,"15min":1.04},"min":{"1min":0.58899999999999997,"5min":0.58499999999999996,"15min":0.53300000000000003},"max":{"1min":1.5740000000000001,"5min":1.5800000000000001,"15min":5.2270000000000003},"last":1.262}]},{"osd":2,"last update":"Thu Nov 12 12:06:35 2020","interfaces":[{"interface":"back","average":{"1min":0.95399999999999996,"5min":0.91600000000000004,"15min":0.93899999999999995},"min":{"1min":0.64700000000000002,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.3169999999999999,"5min":1.393,"15min":3.8220000000000001},"last":0.84099999999999997},{"interface":"front","average":{"1min":0.97599999999999998,"5min":1,"15min":1.0700000000000001},"min":{"1min":0.71899999999999997,"5min":0.67100000000000004,"15min":0.60399999999999998},"max":{"1min":1.244,"5min":1.3959999999999999,"15min":6.9420000000000002},"last":1.335}]},{"osd":3,"last update":"Thu Nov 12 12:06:35 2020","interfaces":[{"interface":"back","average":{"1min":1.123,"5min":1.089,"15min":1.087},"min":{"1min":0.79900000000000004,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":1.383,"5min":1.6160000000000001,"15min":2.3370000000000002},"last":1.149},{"interface":"front","average":{"1min":1.2929999999999999,"5min":1.272,"15min":1.127},"min":{"1min":1.1060000000000001,"5min":0.90100000000000002,"15min":0.60899999999999999},"max":{"1min":1.5149999999999999,"5min":1.7669999999999999,"15min":2.669},"last":1.345}]},{"osd":4,"last update":"Thu Nov 12 12:06:21 2020","interfaces":[{"interface":"back","average":{"1min":1.0880000000000001,"5min":1.0660000000000001,"15min":1.0309999999999999},"min":{"1min":0.64900000000000002,"5min":0.64900000000000002,"15min":0.59499999999999997},"max":{"1min":1.5820000000000001,"5min":1.5820000000000001,"15min":2.5489999999999999},"last":1.3979999999999999},{"interface":"front","average":{"1min":1.113,"5min":1.002,"15min":1.0369999999999999},"min":{"1min":0.80000000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.871,"5min":1.9490000000000001,"15min":1.9490000000000001},"last":1.6539999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:06:35 2020","interfaces":[{"interface":"back","average":{"1min":1.3300000000000001,"5min":1.1739999999999999,"15min":1.1739999999999999},"min":{"1min":0.625,"5min":0.58099999999999996,"15min":0.52500000000000002},"max":{"1min":2.4729999999999999,"5min":2.4729999999999999,"15min":2.911},"last":1.494},{"interface":"front","average":{"1min":0.96399999999999997,"5min":0.97199999999999998,"15min":1.0649999999999999},"min":{"1min":0.69299999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":1.4510000000000001,"5min":1.748,"15min":4.5549999999999997},"last":1.3140000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:06:35 2020","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.2649999999999999,"15min":1.29},"min":{"1min":0.77000000000000002,"5min":0.77000000000000002,"15min":0.66500000000000004},"max":{"1min":2.0270000000000001,"5min":2.0270000000000001,"15min":2.7770000000000001},"last":1.6359999999999999},{"interface":"front","average":{"1min":1.464,"5min":1.3899999999999999,"15min":1.3879999999999999},"min":{"1min":1.083,"5min":0.873,"15min":0.753},"max":{"1min":2.3239999999999998,"5min":2.3239999999999998,"15min":3.1110000000000002},"last":1.7350000000000001}]}]},{"osd":4,"up_from":276,"seq":1185410973835,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1456224,"kb_used_data":407640,"kb_used_omap":226,"kb_used_meta":1048349,"kb_avail":92915616,"statfs":{"total":96636764160,"available":95145590784,"internally_reserved":1073741824,"allocated":417423360,"data_stored":457640407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":231794,"internal_metadata":1073510030},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:22 2020","interfaces":[{"interface":"back","average":{"1min":0.84499999999999997,"5min":0.89300000000000002,"15min":0.96299999999999997},"min":{"1min":0.46400000000000002,"5min":0.46400000000000002,"15min":0.44600000000000001},"max":{"1min":1.25,"5min":1.506,"15min":3.4529999999999998},"last":1.0409999999999999},{"interface":"front","average":{"1min":0.85499999999999998,"5min":0.95699999999999996,"15min":1.1830000000000001},"min":{"1min":0.54500000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.347,"5min":1.895,"15min":5.718},"last":1.0149999999999999}]},{"osd":1,"last update":"Thu Nov 12 12:06:22 2020","interfaces":[{"interface":"back","average":{"1min":0.91500000000000004,"5min":0.94399999999999995,"15min":1.0980000000000001},"min":{"1min":0.56200000000000006,"5min":0.439,"15min":0.439},"max":{"1min":1.2729999999999999,"5min":1.6699999999999999,"15min":10.352},"last":0.77700000000000002},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.02,"15min":1.1639999999999999},"min":{"1min":0.74199999999999999,"5min":0.55100000000000005,"15min":0.55100000000000005},"max":{"1min":1.526,"5min":1.7090000000000001,"15min":4.4660000000000002},"last":1.196}]},{"osd":2,"last update":"Thu Nov 12 12:06:22 2020","interfaces":[{"interface":"back","average":{"1min":0.93799999999999994,"5min":0.96799999999999997,"15min":0.98899999999999999},"min":{"1min":0.58499999999999996,"5min":0.54400000000000004,"15min":0.54400000000000004},"max":{"1min":1.379,"5min":1.484,"15min":2.0209999999999999},"last":1.1559999999999999},{"interface":"front","average":{"1min":1.0589999999999999,"5min":1.042,"15min":1.2390000000000001},"min":{"1min":0.72799999999999998,"5min":0.56499999999999995,"15min":0.55800000000000005},"max":{"1min":1.462,"5min":1.6180000000000001,"15min":7.3680000000000003},"last":0.84099999999999997}]},{"osd":3,"last update":"Thu Nov 12 12:06:22 2020","interfaces":[{"interface":"back","average":{"1min":0.98499999999999999,"5min":0.98399999999999999,"15min":1.075},"min":{"1min":0.70499999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.427,"5min":1.488,"15min":5.0430000000000001},"last":1.389},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0649999999999999,"15min":1.165},"min":{"1min":0.68000000000000005,"5min":0.628,"15min":0.628},"max":{"1min":1.377,"5min":1.734,"15min":4.9359999999999999},"last":1.3069999999999999}]},{"osd":5,"last update":"Thu Nov 12 12:06:26 2020","interfaces":[{"interface":"back","average":{"1min":0.89500000000000002,"5min":0.93100000000000005,"15min":1.143},"min":{"1min":0.56000000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":1.292,"5min":1.5720000000000001,"15min":6.4580000000000002},"last":1.2250000000000001},{"interface":"front","average":{"1min":1.0449999999999999,"5min":0.99099999999999999,"15min":1.1240000000000001},"min":{"1min":0.54600000000000004,"5min":0.51600000000000001,"15min":0.51600000000000001},"max":{"1min":1.528,"5min":1.653,"15min":5.1669999999999998},"last":1.3600000000000001}]},{"osd":6,"last update":"Thu Nov 12 12:06:22 2020","interfaces":[{"interface":"back","average":{"1min":0.998,"5min":1.034,"15min":1.1319999999999999},"min":{"1min":0.68000000000000005,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.452,"5min":1.623,"15min":2.8210000000000002},"last":0.96999999999999997},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.1379999999999999,"15min":1.27},"min":{"1min":0.71299999999999997,"5min":0.71299999999999997,"15min":0.71199999999999997},"max":{"1min":1.6339999999999999,"5min":1.6499999999999999,"15min":3.8580000000000001},"last":1.52}]},{"osd":7,"last update":"Thu Nov 12 12:06:22 2020","interfaces":[{"interface":"back","average":{"1min":1.0940000000000001,"5min":1.139,"15min":1.2},"min":{"1min":0.64400000000000002,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":1.5449999999999999,"5min":1.746,"15min":4.9160000000000004},"last":1.5469999999999999},{"interface":"front","average":{"1min":1.2529999999999999,"5min":1.3009999999999999,"15min":1.3600000000000001},"min":{"1min":0.92900000000000005,"5min":0.879,"15min":0.71799999999999997},"max":{"1min":1.5449999999999999,"5min":1.9199999999999999,"15min":3.214},"last":1.45}]}]},{"osd":0,"up_from":13,"seq":55834575046,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1439548,"kb_used_data":390964,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92932292,"statfs":{"total":96636764160,"available":95162667008,"internally_reserved":1073741824,"allocated":400347136,"data_stored":426203154,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.60599999999999998,"5min":0.64800000000000002,"15min":0.73299999999999998},"min":{"1min":0.45100000000000001,"5min":0.40500000000000003,"15min":0.40500000000000003},"max":{"1min":0.80500000000000005,"5min":1.365,"15min":11.390000000000001},"last":0.57999999999999996},{"interface":"front","average":{"1min":0.69599999999999995,"5min":0.71699999999999997,"15min":0.752},"min":{"1min":0.47099999999999997,"5min":0.437,"15min":0.41899999999999998},"max":{"1min":1.405,"5min":1.405,"15min":3.3490000000000002},"last":0.497}]},{"osd":2,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.86299999999999999,"5min":0.83399999999999996,"15min":0.871},"min":{"1min":0.51600000000000001,"5min":0.50900000000000001,"15min":0.433},"max":{"1min":1.246,"5min":1.3520000000000001,"15min":4.1040000000000001},"last":0.747},{"interface":"front","average":{"1min":1.0820000000000001,"5min":1.0549999999999999,"15min":1.032},"min":{"1min":0.84499999999999997,"5min":0.748,"15min":0.48299999999999998},"max":{"1min":1.444,"5min":1.6020000000000001,"15min":13.228},"last":1.0289999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.79900000000000004,"5min":0.81999999999999995,"15min":0.92600000000000005},"min":{"1min":0.58599999999999997,"5min":0.53300000000000003,"15min":0.42799999999999999},"max":{"1min":0.97599999999999998,"5min":1.3500000000000001,"15min":13.491},"last":0.44600000000000001},{"interface":"front","average":{"1min":0.88800000000000001,"5min":0.90900000000000003,"15min":0.96899999999999997},"min":{"1min":0.64400000000000002,"5min":0.63,"15min":0.57999999999999996},"max":{"1min":1.278,"5min":1.411,"15min":2.903},"last":0.89000000000000001}]},{"osd":4,"last update":"Thu Nov 12 12:06:14 2020","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":1.038,"15min":1.0840000000000001},"min":{"1min":0.60199999999999998,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":1.4350000000000001,"5min":1.9119999999999999,"15min":12.968999999999999},"last":0.68500000000000005},{"interface":"front","average":{"1min":1.1890000000000001,"5min":1.1599999999999999,"15min":1.1419999999999999},"min":{"1min":0.79500000000000004,"5min":0.71399999999999997,"15min":0.63300000000000001},"max":{"1min":1.6819999999999999,"5min":1.718,"15min":1.9399999999999999},"last":1.147}]},{"osd":5,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":1.157,"15min":1.1479999999999999},"min":{"1min":0.70099999999999996,"5min":0.70099999999999996,"15min":0.63200000000000001},"max":{"1min":1.915,"5min":1.915,"15min":5.3689999999999998},"last":1.3049999999999999},{"interface":"front","average":{"1min":1.1830000000000001,"5min":1.204,"15min":1.2450000000000001},"min":{"1min":0.78000000000000003,"5min":0.72599999999999998,"15min":0.71899999999999997},"max":{"1min":1.6080000000000001,"5min":1.7170000000000001,"15min":13.103},"last":0.78000000000000003}]},{"osd":6,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":1.1870000000000001,"5min":1.222,"15min":1.2589999999999999},"min":{"1min":0.83199999999999996,"5min":0.70199999999999996,"15min":0.59499999999999997},"max":{"1min":1.6990000000000001,"5min":1.869,"15min":4.3090000000000002},"last":0.76700000000000002},{"interface":"front","average":{"1min":1.359,"5min":1.345,"15min":1.407},"min":{"1min":1.1439999999999999,"5min":0.95799999999999996,"15min":0.62},"max":{"1min":1.944,"5min":1.996,"15min":18.216999999999999},"last":1.2330000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.93000000000000005,"5min":0.99399999999999999,"15min":1.117},"min":{"1min":0.67000000000000004,"5min":0.67000000000000004,"15min":0.65600000000000003},"max":{"1min":1.47,"5min":1.47,"15min":2.8079999999999998},"last":0.94199999999999995},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.0640000000000001,"15min":1.103},"min":{"1min":0.90000000000000002,"5min":0.77300000000000002,"15min":0.67000000000000004},"max":{"1min":1.2869999999999999,"5min":1.427,"15min":2.5710000000000002},"last":1.0780000000000001}]}]},{"osd":1,"up_from":13,"seq":55834575046,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1335076,"kb_used_data":283968,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93036764,"statfs":{"total":96636764160,"available":95269646336,"internally_reserved":1073741824,"allocated":290783232,"data_stored":315684007,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:44 2020","interfaces":[{"interface":"back","average":{"1min":0.64300000000000002,"5min":0.67100000000000004,"15min":0.79100000000000004},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.36599999999999999},"max":{"1min":1.1799999999999999,"5min":1.1799999999999999,"15min":17.437000000000001},"last":0.753},{"interface":"front","average":{"1min":0.76500000000000001,"5min":0.80700000000000005,"15min":0.89900000000000002},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.50600000000000001},"max":{"1min":1.202,"5min":1.268,"15min":20.553999999999998},"last":0.73499999999999999}]},{"osd":2,"last update":"Thu Nov 12 12:06:44 2020","interfaces":[{"interface":"back","average":{"1min":0.66100000000000003,"5min":0.74099999999999999,"15min":0.79600000000000004},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.42899999999999999},"max":{"1min":0.90700000000000003,"5min":1.3839999999999999,"15min":5.141},"last":0.79700000000000004},{"interface":"front","average":{"1min":0.79600000000000004,"5min":0.85899999999999999,"15min":0.99299999999999999},"min":{"1min":0.61599999999999999,"5min":0.58099999999999996,"15min":0.495},"max":{"1min":1.2669999999999999,"5min":1.296,"15min":18.247},"last":0.58199999999999996}]},{"osd":3,"last update":"Thu Nov 12 12:06:44 2020","interfaces":[{"interface":"back","average":{"1min":0.73899999999999999,"5min":0.78300000000000003,"15min":1.222},"min":{"1min":0.55000000000000004,"5min":0.47199999999999998,"15min":0.46800000000000003},"max":{"1min":1.1479999999999999,"5min":1.248,"15min":101.705},"last":0.66000000000000003},{"interface":"front","average":{"1min":0.76400000000000001,"5min":0.84699999999999998,"15min":1.3100000000000001},"min":{"1min":0.53700000000000003,"5min":0.499,"15min":0.499},"max":{"1min":1.054,"5min":1.292,"15min":101.547},"last":1.0920000000000001}]},{"osd":4,"last update":"Thu Nov 12 12:07:14 2020","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":1.05,"15min":1.2050000000000001},"min":{"1min":0.72499999999999998,"5min":0.58399999999999996,"15min":0.55900000000000005},"max":{"1min":1.2509999999999999,"5min":1.671,"15min":6.2000000000000002},"last":1.1100000000000001},{"interface":"front","average":{"1min":1.0900000000000001,"5min":1.171,"15min":1.4650000000000001},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.325,"5min":2.0299999999999998,"15min":18.151},"last":0.83499999999999996}]},{"osd":5,"last update":"Thu Nov 12 12:06:44 2020","interfaces":[{"interface":"back","average":{"1min":1.018,"5min":1.0609999999999999,"15min":1.202},"min":{"1min":0.77900000000000003,"5min":0.66100000000000003,"15min":0.61699999999999999},"max":{"1min":1.3149999999999999,"5min":1.8069999999999999,"15min":17.885000000000002},"last":1.2490000000000001},{"interface":"front","average":{"1min":1.1319999999999999,"5min":1.1870000000000001,"15min":1.28},"min":{"1min":0.90300000000000002,"5min":0.80600000000000005,"15min":0.76000000000000001},"max":{"1min":1.468,"5min":2.1400000000000001,"15min":7.3019999999999996},"last":0.91200000000000003}]},{"osd":6,"last update":"Thu Nov 12 12:06:44 2020","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.0960000000000001,"15min":1.2110000000000001},"min":{"1min":0.76000000000000001,"5min":0.71299999999999997,"15min":0.67800000000000005},"max":{"1min":1.331,"5min":2.0089999999999999,"15min":20.434999999999999},"last":1.276},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.1930000000000001,"15min":1.282},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.60499999999999998},"max":{"1min":1.462,"5min":2.1789999999999998,"15min":5.9219999999999997},"last":1.3460000000000001}]},{"osd":7,"last update":"Thu Nov 12 12:06:44 2020","interfaces":[{"interface":"back","average":{"1min":1.204,"5min":1.262,"15min":1.355},"min":{"1min":0.94199999999999995,"5min":0.76400000000000001,"15min":0.67300000000000004},"max":{"1min":1.508,"5min":2.2320000000000002,"15min":18.024999999999999},"last":1.034},{"interface":"front","average":{"1min":1.232,"5min":1.292,"15min":1.3420000000000001},"min":{"1min":0.84299999999999997,"5min":0.78600000000000003,"15min":0.78300000000000003},"max":{"1min":1.5820000000000001,"5min":2.1030000000000002,"15min":20.172999999999998},"last":1.1899999999999999}]}]},{"osd":2,"up_from":13,"seq":55834575047,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1406592,"kb_used_data":354664,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":92965248,"statfs":{"total":96636764160,"available":95196413952,"internally_reserved":1073741824,"allocated":363175936,"data_stored":394936263,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:42 2020","interfaces":[{"interface":"back","average":{"1min":0.71099999999999997,"5min":0.66500000000000004,"15min":0.74299999999999999},"min":{"1min":0.47299999999999998,"5min":0.42299999999999999,"15min":0.41099999999999998},"max":{"1min":1.1439999999999999,"5min":1.4079999999999999,"15min":9.75},"last":0.63100000000000001},{"interface":"front","average":{"1min":0.82599999999999996,"5min":0.88400000000000001,"15min":0.94399999999999995},"min":{"1min":0.47899999999999998,"5min":0.47899999999999998,"15min":0.42199999999999999},"max":{"1min":1.2470000000000001,"5min":1.51,"15min":7.29},"last":0.78700000000000003}]},{"osd":1,"last update":"Thu Nov 12 12:06:42 2020","interfaces":[{"interface":"back","average":{"1min":0.76400000000000001,"5min":0.745,"15min":0.79000000000000004},"min":{"1min":0.497,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":1.1919999999999999,"5min":1.4239999999999999,"15min":3.0310000000000001},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.88600000000000001,"5min":0.89800000000000002,"15min":0.93799999999999994},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.47099999999999997},"max":{"1min":1.4359999999999999,"5min":1.7150000000000001,"15min":5.5750000000000002},"last":1.0569999999999999}]},{"osd":3,"last update":"Thu Nov 12 12:06:42 2020","interfaces":[{"interface":"back","average":{"1min":0.78500000000000003,"5min":0.78100000000000003,"15min":0.84399999999999997},"min":{"1min":0.51500000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":1.2110000000000001,"5min":1.4199999999999999,"15min":6.4539999999999997},"last":1.0049999999999999},{"interface":"front","average":{"1min":0.90700000000000003,"5min":0.94799999999999995,"15min":0.93500000000000005},"min":{"1min":0.66600000000000004,"5min":0.60199999999999998,"15min":0.59999999999999998},"max":{"1min":1.268,"5min":1.627,"15min":7.4790000000000001},"last":0.94799999999999995}]},{"osd":4,"last update":"Thu Nov 12 12:06:19 2020","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":1.0069999999999999,"15min":1.107},"min":{"1min":0.61199999999999999,"5min":0.61199999999999999,"15min":0.60399999999999998},"max":{"1min":1.754,"5min":1.754,"15min":6.3170000000000002},"last":0.81999999999999995},{"interface":"front","average":{"1min":1.099,"5min":1.119,"15min":1.131},"min":{"1min":0.80400000000000005,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":1.8440000000000001,"5min":1.8440000000000001,"15min":3.1589999999999998},"last":0.91700000000000004}]},{"osd":5,"last update":"Thu Nov 12 12:06:27 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.0980000000000001,"15min":1.1919999999999999},"min":{"1min":0.75600000000000001,"5min":0.70299999999999996,"15min":0.58599999999999997},"max":{"1min":1.863,"5min":1.863,"15min":5.8819999999999997},"last":0.74099999999999999},{"interface":"front","average":{"1min":1.1759999999999999,"5min":1.1259999999999999,"15min":1.1759999999999999},"min":{"1min":0.77300000000000002,"5min":0.745,"15min":0.56000000000000005},"max":{"1min":1.972,"5min":1.972,"15min":7.343},"last":0.72099999999999997}]},{"osd":6,"last update":"Thu Nov 12 12:06:42 2020","interfaces":[{"interface":"back","average":{"1min":1.1890000000000001,"5min":1.1870000000000001,"15min":1.2210000000000001},"min":{"1min":0.81000000000000005,"5min":0.71099999999999997,"15min":0.67600000000000005},"max":{"1min":1.425,"5min":1.8220000000000001,"15min":7.6900000000000004},"last":0.85199999999999998},{"interface":"front","average":{"1min":1.2070000000000001,"5min":1.2010000000000001,"15min":1.268},"min":{"1min":0.871,"5min":0.82799999999999996,"15min":0.73499999999999999},"max":{"1min":1.5580000000000001,"5min":1.7949999999999999,"15min":7.75},"last":1.0269999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:06:42 2020","interfaces":[{"interface":"back","average":{"1min":1.2689999999999999,"5min":1.2549999999999999,"15min":1.3540000000000001},"min":{"1min":0.91800000000000004,"5min":0.82899999999999996,"15min":0.79000000000000004},"max":{"1min":1.7430000000000001,"5min":1.8580000000000001,"15min":7.5979999999999999},"last":0.93700000000000006},{"interface":"front","average":{"1min":1.2809999999999999,"5min":1.2789999999999999,"15min":1.335},"min":{"1min":0.94599999999999995,"5min":0.78900000000000003,"15min":0.77900000000000003},"max":{"1min":2.101,"5min":2.101,"15min":7.5179999999999998},"last":1.1819999999999999}]}]},{"osd":3,"up_from":238,"seq":1022202216594,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1460848,"kb_used_data":412264,"kb_used_omap":489,"kb_used_meta":1048086,"kb_avail":92910992,"statfs":{"total":96636764160,"available":95140855808,"internally_reserved":1073741824,"allocated":422158336,"data_stored":471600139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":500871,"internal_metadata":1073240953},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.68300000000000005,"5min":0.66500000000000004,"15min":0.92300000000000004},"min":{"1min":0.436,"5min":0.436,"15min":0.35299999999999998},"max":{"1min":0.93100000000000005,"5min":1.087,"15min":11.891999999999999},"last":0.64500000000000002},{"interface":"front","average":{"1min":0.81699999999999995,"5min":0.84299999999999997,"15min":0.91800000000000004},"min":{"1min":0.48999999999999999,"5min":0.41399999999999998,"15min":0.41399999999999998},"max":{"1min":1.421,"5min":1.421,"15min":5.2199999999999998},"last":0.71699999999999997}]},{"osd":1,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.746,"5min":0.745,"15min":0.76900000000000002},"min":{"1min":0.503,"5min":0.5,"15min":0.46500000000000002},"max":{"1min":1.0229999999999999,"5min":1.266,"15min":3.883},"last":0.78100000000000003},{"interface":"front","average":{"1min":0.86099999999999999,"5min":0.82999999999999996,"15min":1.0049999999999999},"min":{"1min":0.60799999999999998,"5min":0.52200000000000002,"15min":0.49099999999999999},"max":{"1min":1.234,"5min":1.423,"15min":8.8330000000000002},"last":0.82399999999999995}]},{"osd":2,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":0.88200000000000001,"5min":0.85399999999999998,"15min":0.996},"min":{"1min":0.58499999999999996,"5min":0.49099999999999999,"15min":0.49099999999999999},"max":{"1min":1.46,"5min":1.46,"15min":7.1820000000000004},"last":0.87},{"interface":"front","average":{"1min":0.97999999999999998,"5min":0.96599999999999997,"15min":0.99399999999999999},"min":{"1min":0.73399999999999999,"5min":0.57099999999999995,"15min":0.55200000000000005},"max":{"1min":1.296,"5min":1.3160000000000001,"15min":2.46},"last":0.85699999999999998}]},{"osd":4,"last update":"Thu Nov 12 12:06:19 2020","interfaces":[{"interface":"back","average":{"1min":1.0349999999999999,"5min":1.0289999999999999,"15min":1.0469999999999999},"min":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"max":{"1min":1.3560000000000001,"5min":1.454,"15min":2.3239999999999998},"last":1.157},{"interface":"front","average":{"1min":1.194,"5min":1.131,"15min":1.26},"min":{"1min":0.748,"5min":0.62,"15min":0.62},"max":{"1min":1.827,"5min":1.827,"15min":6.4779999999999998},"last":0.92000000000000004}]},{"osd":5,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.121,"15min":1.323},"min":{"1min":0.77600000000000002,"5min":0.76400000000000001,"15min":0.75800000000000001},"max":{"1min":1.6160000000000001,"5min":1.696,"15min":8.7029999999999994},"last":1.0800000000000001},{"interface":"front","average":{"1min":1.2050000000000001,"5min":1.1719999999999999,"15min":1.298},"min":{"1min":0.89200000000000002,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6890000000000001,"5min":1.6890000000000001,"15min":7.0620000000000003},"last":1.1359999999999999}]},{"osd":6,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.155,"15min":1.3620000000000001},"min":{"1min":0.83899999999999997,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.712,"5min":1.8,"15min":8.5820000000000007},"last":1.004},{"interface":"front","average":{"1min":1.2470000000000001,"5min":1.256,"15min":1.3300000000000001},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":4.9630000000000001},"last":1.0609999999999999}]},{"osd":7,"last update":"Thu Nov 12 12:06:38 2020","interfaces":[{"interface":"back","average":{"1min":1.119,"5min":1.141,"15min":1.1910000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":1.609,"5min":1.619,"15min":2.802},"last":1.238},{"interface":"front","average":{"1min":1.3560000000000001,"5min":1.2789999999999999,"15min":1.4890000000000001},"min":{"1min":0.97999999999999998,"5min":0.93600000000000005,"15min":0.77800000000000002},"max":{"1min":1.8080000000000001,"5min":1.958,"15min":8.9580000000000002},"last":1.175}]}]}]}} Ignoring malparsed backtrace: 2020-11-12T12:08:18.725 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:18.726 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-12 11:57:04.108192 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=4, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:08:18.726 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:08:26.673 7f9103a5d700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.as0 on osd.6 to deep-scrub , 2020-11-12T12:08:26.891 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b Ignoring malparsed backtrace: 2020-11-12T12:09:29.248 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:09:29.248 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:09:29.248 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12 12:10:30.635 7f2a188f4700 -1 WARNING: all dangerous and experimental features are enabled. , instructing pg 2.fs0 on osd.0 to deep-scrub , 2020-11-12T12:10:30.849 INFO:teuthology.orchestra.run.smithi176:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.e Ignoring malparsed backtrace: 2020-11-12T12:10:59.980 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:10:59.980 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:10:59.981 INFO:tasks.ceph:pgid 1.7 last_scrub_stamp 2020-11-12 11:57:28.217475 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=28, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:12:01.212 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-11-12 11:52:29.777275 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=52, tm_sec=29, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:01.212 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-12 11:51:33.355045 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=51, tm_sec=33, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) , 2020-11-12T12:12:01.213 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-12 11:56:16.170890 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=56, tm_sec=16, tm_wday=3, tm_yday=317, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=12, tm_hour=11, tm_min=57, tm_sec=43, tm_wday=3, tm_yday=317, tm_isdst=0) Ignoring malparsed backtrace: 2020-11-12T12:12:21.939 INFO:tasks.ceph.osd.5:Stopped , 2020-11-12T12:12:21.940 DEBUG:tasks.ceph.osd.6:waiting for process to exit , 2020-11-12T12:12:21.941 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: run.wait(tests.values()) , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait , proc.wait() Ignoring malparsed backtrace: 2020-11-12T12:14:14.196 INFO:teuthology.orchestra.run.smithi062.stdout:kernel.core_pattern = core , 2020-11-12T12:14:14.209 INFO:teuthology.orchestra.run.smithi176:> test -e /home/ubuntu/cephtest/archive/coredump , 2020-11-12T12:14:14.249 WARNING:teuthology.task.internal:Found coredumps on ubuntu@smithi176.front.sepia.ceph.com, flagging run as failed Found 1 distinct failure reasons Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --pool-snaps --max-ops 4000 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op write_excl 50 --pool unique_pool_0' 3 jobs: ['5615707', '5615706', '5615708'] suites intersection: ['ceph.yaml', 'clusters/{fixed-2.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code-overwrites/{bluestore-bitmap.yaml', 'thrashosds-health.yaml'] suites union: ['ceph.yaml', 'clusters/{fixed-2.yaml', 'fast/fast.yaml', 'fast/normal.yaml', 'msgr-failures/fastclose.yaml', 'msgr-failures/few.yaml', 'msgr-failures/osd-delay.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code-overwrites/{bluestore-bitmap.yaml', 'recovery-overrides/{more-active-recovery.yaml}', 'recovery-overrides/{more-partial-recovery.yaml}', 'supported-random-distro$/{centos_latest.yaml}', 'supported-random-distro$/{rhel_latest.yaml}', 'thrashers/fastread.yaml', 'thrashers/morepggrow.yaml', 'thrashers/pggrow.yaml', 'thrashosds-health.yaml', 'workloads/ec-pool-snaps-few-objects-overwrites.yaml}', 'workloads/ec-small-objects-fast-read-overwrites.yaml}', 'workloads/ec-snaps-few-objects-overwrites.yaml}']