Found 60 jobs
Ignoring malparsed backtrace:  ceph version 14.2.11-113-g5c0b894435 (5c0b894435c8a34e4ce6446e264581811994cca3) nautilus (stable)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xdf) [0x7fe4bc08f59c]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5eb) [0x423adb]

Ignoring malparsed backtrace: 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:11.499929",
, 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.312 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:35.306506",

Ignoring malparsed backtrace: 2020-11-21T01:49:09.331 INFO:teuthology.orchestra.run.smithi059.stdout:                    "client_addr": "172.21.15.18:0/3425446096",
, 2020-11-21T01:49:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:                    "tid": 5662
, 2020-11-21T01:49:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:                },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.257616",
, 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "started"
, 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "commit_sent"
, 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.391 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.392 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.392 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.244887",

Ignoring malparsed backtrace: 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:01.173631",
, 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "commit_sent"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.265179",
, 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"
, 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.452 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"
, 2020-11-21T01:49:09.453 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.453 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:44.827457",
, 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.493 INFO:teuthology.orchestra.run.smithi059.stdout:            }
, 2020-11-21T01:49:09.493 INFO:teuthology.orchestra.run.smithi059.stdout:        },
, 2020-11-21T01:49:09.494 INFO:teuthology.orchestra.run.smithi059.stdout:        {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "queued_for_pg"
, 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:46:03.096418",
, 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "sub_op_committed"
, 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:32.306018",
, 2020-11-21T01:49:10.018 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "sub_op_started"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.038 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:32.297480",
, 2020-11-21T01:49:10.038 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"
, 2020-11-21T01:49:10.039 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.060 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.061 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:49.577772",
, 2020-11-21T01:49:10.061 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "throttled"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "initiated_at": "2020-11-21 01:44:09.765184",
, 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "age": 300.21945402799997,
, 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "duration": 1.0039103819999999,

Ignoring malparsed backtrace: 2020-11-21T01:49:10.103 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"
, 2020-11-21T01:49:10.104 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:10.104 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:44:09.844709",
, 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:46:43.935210",
, 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "all_read"
, 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.165 INFO:teuthology.orchestra.run.smithi059.stdout:        },
, 2020-11-21T01:49:10.166 INFO:teuthology.orchestra.run.smithi059.stdout:        {
, 2020-11-21T01:49:10.166 INFO:teuthology.orchestra.run.smithi059.stdout:            "description": "osd_op(client.4353.0:9502 2.1s0 2:805fb934:::smithi01816282-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e149)",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:                ]
, 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:            }
, 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:        },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                "events": [
, 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:47:56.729375",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:44:54.345299",
, 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "started"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:44:54.335963",
, 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"
, 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                "events": [
, 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:20.445942",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:20.446277",
, 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "waiting for peered"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "initiated_at": "2020-11-21 01:45:20.563415",
, 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "age": 230.0142993,
, 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "duration": 0.86483692599999995,

Ignoring malparsed backtrace: 2020-11-21T01:49:10.697 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "dispatched"
, 2020-11-21T01:49:10.697 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.698 INFO:teuthology.orchestra.run.smithi018.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:21.540535",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:46:04.939266",
, 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "started"
, 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"
, 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.783 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.783 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:46:04.947451",
, 2020-11-21T01:49:10.784 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:            }
, 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:        },
, 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:        {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.826 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.827 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.827 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:48:00.734910",

Ignoring malparsed backtrace: command deprecated
, 2020-11-21T01:49:27.933 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 6 1
, reweighted osd.6 to 1 (10000)

Ignoring malparsed backtrace: 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:                "osdmap-prune",
, 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:                "nautilus"
, 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:            ],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:    "mgrmap": {
, 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:        "epoch": 3,
, 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:        "active_gid": 4108,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.406 INFO:teuthology.orchestra.run.smithi018.stdout:                            "smtp_port": {
, 2020-11-21T01:49:36.406 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "smtp_port",
, 2020-11-21T01:49:36.407 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.426 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []

Ignoring malparsed backtrace: 2020-11-21T01:49:36.447 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "0.001",
, 2020-11-21T01:49:36.447 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "0.999",
, 2020-11-21T01:49:36.448 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "5",
, 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "1",
, 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                            },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                            "REST_REQUESTS_TIMEOUT": {
, 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "REST_REQUESTS_TIMEOUT",
, 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "level": "advanced",
, 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "flags": 0,
, 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "True",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.565 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.565 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",
, 2020-11-21T01:49:36.566 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",
, 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "automatically mark OSD if it may fail before this long",
, 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "",
, 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.644 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                            },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.682 INFO:teuthology.orchestra.run.smithi018.stdout:                            "username": {
, 2020-11-21T01:49:36.682 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "username",
, 2020-11-21T01:49:36.683 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "str",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                            },
, 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                            "prefix": {

Ignoring malparsed backtrace: 2020-11-21T01:49:36.721 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.721 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "how frequently to persist completed events",
, 2020-11-21T01:49:36.722 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "can_run": true,
, 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "error_string": "",
, 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "module_options": {}

Ignoring malparsed backtrace: 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                            },
, 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                            "testnewline": {

Ignoring malparsed backtrace: 2020-11-21T01:49:36.799 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "bool",
, 2020-11-21T01:49:36.799 INFO:teuthology.orchestra.run.smithi018.stdout:                                "level": "advanced",
, 2020-11-21T01:49:36.800 INFO:teuthology.orchestra.run.smithi018.stdout:                                "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "False",
, 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "volumes",
, 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                        "can_run": true,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "60",
, 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "Use SSL to connect to SMTP server",
, 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.898 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:36.898 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:36.899 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                    "min_score": {
, 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "min_score",
, 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "float",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.937 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.937 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",
, 2020-11-21T01:49:36.938 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.956 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "bool",
, 2020-11-21T01:49:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "",
, 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",
, 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:37.016 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                    "ssl_server_port": {
, 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "ssl_server_port",
, 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",
, 2020-11-21T01:49:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 1,
, 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "86400",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                    "diskprediction_port": {
, 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "diskprediction_port",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "str",
, 2020-11-21T01:49:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.114 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "30",
, 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.152 INFO:teuthology.orchestra.run.smithi018.stdout:            {
, 2020-11-21T01:49:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:                "name": "iostat",
, 2020-11-21T01:49:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:                "can_run": true,

Ignoring malparsed backtrace: 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                "module_options": {
, 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                    "orchestrator": {
, 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "orchestrator",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",
, 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",
, 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                    "server_port": {
, 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "server_port",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,
, 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.250 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.250 INFO:teuthology.orchestra.run.smithi018.stdout:                    "ssh_config_file": {
, 2020-11-21T01:49:37.251 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "ssh_config_file",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",
, 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []

Ignoring malparsed backtrace: 2020-11-21T01:49:37.289 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.289 INFO:teuthology.orchestra.run.smithi018.stdout:                    "leaderboard": {
, 2020-11-21T01:49:37.290 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "leaderboard",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: Set osd_debug_deep_scrub_sleep to 0
, 2020-11-21T01:49:41.868 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 3
, instructed osd(s) 3 to deep-scrub

Ignoring malparsed backtrace: 2020-11-21T01:50:25.617 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:50:25.617 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:50:25.618 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2020-11-21 01:46:15.310508 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:51:28.158 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.c
, instructing pg 2.cs0 on osd.6 to deep-scrub
, 2020-11-21T01:51:28.506 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b

Ignoring malparsed backtrace: 2020-11-21T01:52:37.520 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json
, 2020-11-21T01:52:37.956 INFO:teuthology.orchestra.run.smithi018.stdout:
, dumped all

Ignoring malparsed backtrace: 2020-11-21T01:53:39.356 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-11-21 01:45:59.251426 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=45, tm_sec=59, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:53:39.356 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:53:39.357 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-21 01:46:01.028764 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=1, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:54:29.240 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:54:29.241 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:54:29.241 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:55:30.645 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:55:30.646 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-21 01:45:15.118160 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=45, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:55:30.646 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:56:20.265 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-21 01:46:15.622973 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:56:20.266 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:56:20.266 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:57:42.070 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":693,"stamp":"2020-11-21 01:57:40.423329","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9694619,"num_objects":9,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4863,"num_read_kb":2628,"num_write":11063,"num_write_kb":3124134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":120576433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14547,"ondisk_log_size":14547,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8442452,"kb_used_data":51636,"kb_used_omap":12,"kb_used_meta":8388595,"kb_avail":746532268,"statfs":{"total":773094113280,"available":764449042432,"internally_reserved":8589934592,"allocated":52875264,"data_stored":40791016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13029,"internal_metadata":8589921563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004262"},"pg_stats":[{"pgid":"2.f","version":"218'704","reported_seq":"1316","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.579539","last_change":"2020-11-21 01:48:23.138350","last_active":"2020-11-21 01:49:27.579539","last_peered":"2020-11-21 01:49:27.579539","last_clean":"2020-11-21 01:49:27.579539","last_became_active":"2020-11-21 01:48:23.137013","last_became_peered":"2020-11-21 01:48:23.137013","last_unstale":"2020-11-21 01:49:27.579539","last_undegraded":"2020-11-21 01:49:27.579539","last_fullsized":"2020-11-21 01:49:27.579539","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":704,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2646456,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":228,"num_read_kb":122,"num_write":533,"num_write_kb":161328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5301007,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"218'740","reported_seq":"1328","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802871","last_change":"2020-11-21 01:47:36.346751","last_active":"2020-11-21 01:49:27.802871","last_peered":"2020-11-21 01:49:27.802871","last_clean":"2020-11-21 01:49:27.802871","last_became_active":"2020-11-21 01:47:36.345399","last_became_peered":"2020-11-21 01:47:36.345399","last_unstale":"2020-11-21 01:49:27.802871","last_undegraded":"2020-11-21 01:49:27.802871","last_fullsized":"2020-11-21 01:49:27.802871","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":740,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":134,"num_write":563,"num_write_kb":153923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":2507015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"218'1407","reported_seq":"2251","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.804338","last_change":"2020-11-21 01:49:21.461898","last_active":"2020-11-21 01:49:27.804338","last_peered":"2020-11-21 01:49:27.804338","last_clean":"2020-11-21 01:49:27.804338","last_became_active":"2020-11-21 01:49:21.459434","last_became_peered":"2020-11-21 01:49:21.459434","last_unstale":"2020-11-21 01:49:27.804338","last_undegraded":"2020-11-21 01:49:27.804338","last_fullsized":"2020-11-21 01:49:27.804338","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1407,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4805509,"num_objects":2,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":482,"num_read_kb":262,"num_write":1091,"num_write_kb":308491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":10228125,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"218'2049","reported_seq":"3023","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.531234","last_change":"2020-11-21 01:49:21.445018","last_active":"2020-11-21 01:49:27.531234","last_peered":"2020-11-21 01:49:27.531234","last_clean":"2020-11-21 01:49:27.531234","last_became_active":"2020-11-21 01:49:21.441526","last_became_peered":"2020-11-21 01:49:21.441526","last_unstale":"2020-11-21 01:49:27.531234","last_undegraded":"2020-11-21 01:49:27.531234","last_fullsized":"2020-11-21 01:49:27.531234","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":2049,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56000,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":386,"num_write":1567,"num_write_kb":447186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":20898718,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"218'676","reported_seq":"1253","reported_epoch":"231","state":"active+clean+scrubbing","last_fresh":"2020-11-21 01:49:27.799483","last_change":"2020-11-21 01:49:11.430911","last_active":"2020-11-21 01:49:27.799483","last_peered":"2020-11-21 01:49:27.799483","last_clean":"2020-11-21 01:49:27.799483","last_became_active":"2020-11-21 01:47:42.443530","last_became_peered":"2020-11-21 01:47:42.443530","last_unstale":"2020-11-21 01:49:27.799483","last_undegraded":"2020-11-21 01:49:27.799483","last_fullsized":"2020-11-21 01:49:27.799483","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":676,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":119,"num_write":495,"num_write_kb":141622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":6890404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"432","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.530837","last_change":"2020-11-21 01:49:21.439481","last_active":"2020-11-21 01:49:27.530837","last_peered":"2020-11-21 01:49:27.530837","last_clean":"2020-11-21 01:49:27.530837","last_became_active":"2020-11-21 01:49:21.436946","last_became_peered":"2020-11-21 01:49:21.436946","last_unstale":"2020-11-21 01:49:27.530837","last_undegraded":"2020-11-21 01:49:27.530837","last_fullsized":"2020-11-21 01:49:27.530837","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.9","version":"218'1492","reported_seq":"2411","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802592","last_change":"2020-11-21 01:49:21.440824","last_active":"2020-11-21 01:49:27.802592","last_peered":"2020-11-21 01:49:27.802592","last_clean":"2020-11-21 01:49:27.802592","last_became_active":"2020-11-21 01:49:21.437802","last_became_peered":"2020-11-21 01:49:21.437802","last_unstale":"2020-11-21 01:49:27.802592","last_undegraded":"2020-11-21 01:49:27.802592","last_fullsized":"2020-11-21 01:49:27.802592","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1492,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72807,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":491,"num_read_kb":255,"num_write":1110,"num_write_kb":302366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":13025087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"218'1473","reported_seq":"2309","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.578953","last_change":"2020-11-21 01:47:42.447558","last_active":"2020-11-21 01:49:27.578953","last_peered":"2020-11-21 01:49:27.578953","last_clean":"2020-11-21 01:49:27.578953","last_became_active":"2020-11-21 01:47:42.445405","last_became_peered":"2020-11-21 01:47:42.445405","last_unstale":"2020-11-21 01:49:27.578953","last_undegraded":"2020-11-21 01:49:27.578953","last_fullsized":"2020-11-21 01:49:27.578953","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1473,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":425754,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":263,"num_write":1135,"num_write_kb":325611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26507271,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"252","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.532554","last_change":"2020-11-21 01:49:18.495622","last_active":"2020-11-21 01:49:27.532554","last_peered":"2020-11-21 01:49:27.532554","last_clean":"2020-11-21 01:49:27.532554","last_became_active":"2020-11-21 01:49:18.494721","last_became_peered":"2020-11-21 01:49:18.494721","last_unstale":"2020-11-21 01:49:27.532554","last_undegraded":"2020-11-21 01:49:27.532554","last_fullsized":"2020-11-21 01:49:27.532554","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:43:35.218295","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:43:35.218295","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"564","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802891","last_change":"2020-11-21 01:49:21.435350","last_active":"2020-11-21 01:49:27.802891","last_peered":"2020-11-21 01:49:27.802891","last_clean":"2020-11-21 01:49:27.802891","last_became_active":"2020-11-21 01:49:21.433370","last_became_peered":"2020-11-21 01:49:21.433370","last_unstale":"2020-11-21 01:49:27.802891","last_undegraded":"2020-11-21 01:49:27.802891","last_fullsized":"2020-11-21 01:49:27.802891","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"154","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.533217","last_change":"2020-11-21 01:45:59.251495","last_active":"2020-11-21 01:49:27.533217","last_peered":"2020-11-21 01:49:27.533217","last_clean":"2020-11-21 01:49:27.533217","last_became_active":"2020-11-21 01:45:59.194369","last_became_peered":"2020-11-21 01:45:59.194369","last_unstale":"2020-11-21 01:49:27.533217","last_undegraded":"2020-11-21 01:49:27.533217","last_fullsized":"2020-11-21 01:49:27.533217","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:45:59.251426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:45:59.251426","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"476","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799676","last_change":"2020-11-21 01:49:21.447000","last_active":"2020-11-21 01:49:27.799676","last_peered":"2020-11-21 01:49:27.799676","last_clean":"2020-11-21 01:49:27.799676","last_became_active":"2020-11-21 01:49:21.443761","last_became_peered":"2020-11-21 01:49:21.443761","last_unstale":"2020-11-21 01:49:27.799676","last_undegraded":"2020-11-21 01:49:27.799676","last_fullsized":"2020-11-21 01:49:27.799676","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"227","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802892","last_change":"2020-11-21 01:46:01.028877","last_active":"2020-11-21 01:49:27.802892","last_peered":"2020-11-21 01:49:27.802892","last_clean":"2020-11-21 01:49:27.802892","last_became_active":"2020-11-21 01:42:26.196186","last_became_peered":"2020-11-21 01:42:26.196186","last_unstale":"2020-11-21 01:49:27.802892","last_undegraded":"2020-11-21 01:49:27.802892","last_fullsized":"2020-11-21 01:49:27.802892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:01.028764","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:01.028764","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"218'1418","reported_seq":"2127","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799283","last_change":"2020-11-21 01:49:21.450011","last_active":"2020-11-21 01:49:27.799283","last_peered":"2020-11-21 01:49:27.799283","last_clean":"2020-11-21 01:49:27.799283","last_became_active":"2020-11-21 01:49:21.447333","last_became_peered":"2020-11-21 01:49:21.447333","last_unstale":"2020-11-21 01:49:27.799283","last_undegraded":"2020-11-21 01:49:27.799283","last_fullsized":"2020-11-21 01:49:27.799283","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1418,"ondisk_log_size":1418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":717052,"num_objects":2,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":245,"num_write":1050,"num_write_kb":293922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":7786358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"122","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.579055","last_change":"2020-11-21 01:46:15.623092","last_active":"2020-11-21 01:49:27.579055","last_peered":"2020-11-21 01:49:27.579055","last_clean":"2020-11-21 01:49:27.579055","last_became_active":"2020-11-21 01:45:59.201470","last_became_peered":"2020-11-21 01:45:59.201470","last_unstale":"2020-11-21 01:49:27.579055","last_undegraded":"2020-11-21 01:49:27.579055","last_fullsized":"2020-11-21 01:49:27.579055","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:15.622973","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:15.622973","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"218'1454","reported_seq":"2134","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.533066","last_change":"2020-11-21 01:49:07.494863","last_active":"2020-11-21 01:49:27.533066","last_peered":"2020-11-21 01:49:27.533066","last_clean":"2020-11-21 01:49:27.533066","last_became_active":"2020-11-21 01:47:36.349048","last_became_peered":"2020-11-21 01:47:36.349048","last_unstale":"2020-11-21 01:49:27.533066","last_undegraded":"2020-11-21 01:49:27.533066","last_fullsized":"2020-11-21 01:49:27.533066","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1454,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":341719,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":473,"num_read_kb":260,"num_write":1090,"num_write_kb":307978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":8725372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"243","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.798586","last_change":"2020-11-21 01:47:33.321369","last_active":"2020-11-21 01:49:27.798586","last_peered":"2020-11-21 01:49:27.798586","last_clean":"2020-11-21 01:49:27.798586","last_became_active":"2020-11-21 01:47:33.320616","last_became_peered":"2020-11-21 01:47:33.320616","last_unstale":"2020-11-21 01:49:27.798586","last_undegraded":"2020-11-21 01:49:27.798586","last_fullsized":"2020-11-21 01:49:27.798586","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:16.763583","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:16.763583","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"406","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799530","last_change":"2020-11-21 01:49:21.445247","last_active":"2020-11-21 01:49:27.799530","last_peered":"2020-11-21 01:49:27.799530","last_clean":"2020-11-21 01:49:27.799530","last_became_active":"2020-11-21 01:49:21.443350","last_became_peered":"2020-11-21 01:49:21.443350","last_unstale":"2020-11-21 01:49:27.799530","last_undegraded":"2020-11-21 01:49:27.799530","last_fullsized":"2020-11-21 01:49:27.799530","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"77","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799321","last_change":"2020-11-21 01:49:18.499430","last_active":"2020-11-21 01:49:27.799321","last_peered":"2020-11-21 01:49:27.799321","last_clean":"2020-11-21 01:49:27.799321","last_became_active":"2020-11-21 01:49:18.492869","last_became_peered":"2020-11-21 01:49:18.492869","last_unstale":"2020-11-21 01:49:27.799321","last_undegraded":"2020-11-21 01:49:27.799321","last_fullsized":"2020-11-21 01:49:27.799321","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:15.310508","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:15.310508","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"218'1541","reported_seq":"2368","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799593","last_change":"2020-11-21 01:49:21.446334","last_active":"2020-11-21 01:49:27.799593","last_peered":"2020-11-21 01:49:27.799593","last_clean":"2020-11-21 01:49:27.799593","last_became_active":"2020-11-21 01:49:21.443330","last_became_peered":"2020-11-21 01:49:21.443330","last_unstale":"2020-11-21 01:49:27.799593","last_undegraded":"2020-11-21 01:49:27.799593","last_fullsized":"2020-11-21 01:49:27.799593","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1541,"ondisk_log_size":1541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":629322,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":287,"num_write":1198,"num_write_kb":331555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":14772258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"77","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799637","last_change":"2020-11-21 01:49:18.494641","last_active":"2020-11-21 01:49:27.799637","last_peered":"2020-11-21 01:49:27.799637","last_clean":"2020-11-21 01:49:27.799637","last_became_active":"2020-11-21 01:49:18.492628","last_became_peered":"2020-11-21 01:49:18.492628","last_unstale":"2020-11-21 01:49:27.799637","last_undegraded":"2020-11-21 01:49:27.799637","last_fullsized":"2020-11-21 01:49:27.799637","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:45:15.118160","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:45:15.118160","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"490","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799796","last_change":"2020-11-21 01:49:21.449358","last_active":"2020-11-21 01:49:27.799796","last_peered":"2020-11-21 01:49:27.799796","last_clean":"2020-11-21 01:49:27.799796","last_became_active":"2020-11-21 01:49:21.442547","last_became_peered":"2020-11-21 01:49:21.442547","last_unstale":"2020-11-21 01:49:27.799796","last_undegraded":"2020-11-21 01:49:27.799796","last_fullsized":"2020-11-21 01:49:27.799796","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"58","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.798799","last_change":"2020-11-21 01:49:18.489979","last_active":"2020-11-21 01:49:27.798799","last_peered":"2020-11-21 01:49:27.798799","last_clean":"2020-11-21 01:49:27.798799","last_became_active":"2020-11-21 01:49:18.489348","last_became_peered":"2020-11-21 01:49:18.489348","last_unstale":"2020-11-21 01:49:27.798799","last_undegraded":"2020-11-21 01:49:27.798799","last_fullsized":"2020-11-21 01:49:27.798799","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:43:37.944445","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:43:37.944445","last_clean_scrub_stamp":"2020-11-21 01:43:37.944445","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"218'1593","reported_seq":"2310","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.803509","last_change":"2020-11-21 01:49:21.450622","last_active":"2020-11-21 01:49:27.803509","last_peered":"2020-11-21 01:49:27.803509","last_clean":"2020-11-21 01:49:27.803509","last_became_active":"2020-11-21 01:49:21.448205","last_became_peered":"2020-11-21 01:49:21.448205","last_unstale":"2020-11-21 01:49:27.803509","last_undegraded":"2020-11-21 01:49:27.803509","last_fullsized":"2020-11-21 01:49:27.803509","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1593,"ondisk_log_size":1593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":550,"num_read_kb":295,"num_write":1231,"num_write_kb":350152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3934818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":9694619,"num_objects":9,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4863,"num_read_kb":2628,"num_write":11063,"num_write_kb":3124134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":120576433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30396416,"data_stored":30316440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14547,"ondisk_log_size":14547,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056272,"kb_used_data":6616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315568,"statfs":{"total":96636764160,"available":95555141632,"internally_reserved":1073741824,"allocated":6774784,"data_stored":5263069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":2.1869999999999998,"15min":2.7029999999999998},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.505},"max":{"1min":2.0409999999999999,"5min":5.2649999999999997,"15min":176.50299999999999},"last":2.6509999999999998},{"interface":"front","average":{"1min":45.786000000000001,"5min":18.466000000000001,"15min":12.922000000000001},"min":{"1min":1.4890000000000001,"5min":1.407,"15min":0.93999999999999995},"max":{"1min":874.53499999999997,"5min":874.53499999999997,"15min":874.53499999999997},"last":4.6159999999999997}]},{"osd":1,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.8759999999999999,"15min":13.609},"min":{"1min":1.6599999999999999,"5min":1.6499999999999999,"15min":0.68799999999999994},"max":{"1min":3.4870000000000001,"5min":5.5549999999999997,"15min":959.54899999999998},"last":2},{"interface":"front","average":{"1min":2.7330000000000001,"5min":11.808,"15min":8.2910000000000004},"min":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":0.61499999999999999},"max":{"1min":3.5329999999999999,"5min":960.101,"15min":960.101},"last":2.1920000000000002}]},{"osd":2,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":6.5430000000000001,"15min":9.577},"min":{"1min":1.405,"5min":1.405,"15min":0.72499999999999998},"max":{"1min":2.7469999999999999,"5min":503.74000000000001,"15min":593.19299999999998},"last":2.1070000000000002},{"interface":"front","average":{"1min":2.9239999999999999,"5min":13.635,"15min":8.0709999999999997},"min":{"1min":1.669,"5min":1.669,"15min":0.76500000000000001},"max":{"1min":3.5920000000000001,"5min":503.89499999999998,"15min":504.392},"last":2.593}]},{"osd":3,"last update":"Sat Nov 21 01:57:33 2020","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":8.7430000000000003,"15min":6.375},"min":{"1min":1.4670000000000001,"5min":1.2410000000000001,"15min":0.88200000000000001},"max":{"1min":3.7349999999999999,"5min":576.24300000000005,"15min":607.37800000000004},"last":1.9490000000000001},{"interface":"front","average":{"1min":2.9209999999999998,"5min":10.885999999999999,"15min":10.068},"min":{"1min":2.2879999999999998,"5min":1.746,"15min":1.0549999999999999},"max":{"1min":4.0999999999999996,"5min":503.45699999999999,"15min":707.11599999999999},"last":4.3090000000000002}]},{"osd":4,"last update":"Sat Nov 21 01:56:59 2020","interfaces":[{"interface":"back","average":{"1min":2.605,"5min":3.2730000000000001,"15min":3.044},"min":{"1min":1.883,"5min":1.825,"15min":0.98999999999999999},"max":{"1min":4.1779999999999999,"5min":5.0460000000000003,"15min":29.231999999999999},"last":4.4260000000000002},{"interface":"front","average":{"1min":3.1579999999999999,"5min":3.5760000000000001,"15min":4.7549999999999999},"min":{"1min":2.327,"5min":2.1389999999999998,"15min":0.82799999999999996},"max":{"1min":4.3049999999999997,"5min":5.1609999999999996,"15min":559.48500000000001},"last":4.7960000000000003}]},{"osd":5,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":10.624000000000001,"15min":9.1129999999999995},"min":{"1min":2.2040000000000002,"5min":1.456,"15min":0.77900000000000003},"max":{"1min":3.661,"5min":805.25800000000004,"15min":805.25800000000004},"last":2.044},{"interface":"front","average":{"1min":3.2469999999999999,"5min":10.907999999999999,"15min":7.7530000000000001},"min":{"1min":2.4300000000000002,"5min":2.097,"15min":0.80600000000000005},"max":{"1min":4.2679999999999998,"5min":791.87900000000002,"15min":791.87900000000002},"last":4.4989999999999997}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":3.625,"5min":3.927,"15min":5.3949999999999996},"min":{"1min":2.984,"5min":2.4849999999999999,"15min":2.4849999999999999},"max":{"1min":4.7210000000000001,"5min":6.2460000000000004,"15min":504.67899999999997},"last":4.7210000000000001},{"interface":"front","average":{"1min":3.6789999999999998,"5min":4.0149999999999997,"15min":5.6100000000000003},"min":{"1min":2.948,"5min":2.7360000000000002,"15min":2.7360000000000002},"max":{"1min":4.8799999999999999,"5min":6.3330000000000002,"15min":504.77300000000002},"last":4.8799999999999999}]}]},{"osd":6,"up_from":221,"seq":949187772519,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1052856,"kb_used_data":4272,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93318984,"statfs":{"total":96636764160,"available":95558639616,"internally_reserved":1073741824,"allocated":4374528,"data_stored":2859761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4746,"internal_metadata":1073737078},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":2.262,"15min":2.605},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":3.359,"5min":4.3710000000000004,"15min":114.23699999999999},"last":2.641},{"interface":"front","average":{"1min":23.812000000000001,"5min":9.2200000000000006,"15min":4.5650000000000004},"min":{"1min":1.5720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"max":{"1min":447.74700000000001,"5min":447.74700000000001,"15min":447.74700000000001},"last":2.9830000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.4079999999999999,"5min":9.5619999999999994,"15min":4.9370000000000003},"min":{"1min":1.8320000000000001,"5min":1.738,"15min":1.5469999999999999},"max":{"1min":3.633,"5min":718.55799999999999,"15min":718.55799999999999},"last":1.992},{"interface":"front","average":{"1min":2.2210000000000001,"5min":3.9390000000000001,"15min":2.9870000000000001},"min":{"1min":1.6180000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":3.2280000000000002,"5min":149.46799999999999,"15min":149.46799999999999},"last":2.4620000000000002}]},{"osd":2,"last update":"Sat Nov 21 01:57:33 2020","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":5.1630000000000003,"15min":3.5510000000000002},"min":{"1min":1.804,"5min":1.494,"15min":1.494},"max":{"1min":3.7330000000000001,"5min":236.29900000000001,"15min":236.29900000000001},"last":2.0950000000000002},{"interface":"front","average":{"1min":41.996000000000002,"5min":10.558,"15min":5.3739999999999997},"min":{"1min":1.839,"5min":1.516,"15min":1.516},"max":{"1min":832.87699999999995,"5min":832.87699999999995,"15min":832.87699999999995},"last":2.3199999999999998}]},{"osd":3,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":2.9630000000000001,"15min":2.8679999999999999},"min":{"1min":1.899,"5min":1.859,"15min":1.8220000000000001},"max":{"1min":3.6930000000000001,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":2.7000000000000002},{"interface":"front","average":{"1min":2.7759999999999998,"5min":2.8130000000000002,"15min":2.9540000000000002},"min":{"1min":2.1179999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"max":{"1min":3.835,"5min":4.9169999999999998,"15min":4.9409999999999998},"last":2.8069999999999999}]},{"osd":4,"last update":"Sat Nov 21 01:57:30 2020","interfaces":[{"interface":"back","average":{"1min":2.5529999999999999,"5min":11.363,"15min":5.8449999999999998},"min":{"1min":1.931,"5min":1.6220000000000001,"15min":1.6220000000000001},"max":{"1min":3.3069999999999999,"5min":856.87599999999998,"15min":856.87599999999998},"last":1.363},{"interface":"front","average":{"1min":39.381999999999998,"5min":15.183,"15min":9.7669999999999995},"min":{"1min":2.1720000000000002,"5min":1.6970000000000001,"15min":1.6970000000000001},"max":{"1min":730.24000000000001,"5min":730.24000000000001,"15min":893.66300000000001},"last":2.9119999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":3.032,"5min":3.347,"15min":31.992999999999999},"min":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"max":{"1min":4.0289999999999999,"5min":4.8769999999999998,"15min":965.67499999999995},"last":2.0459999999999998},{"interface":"front","average":{"1min":3.242,"5min":10.368,"15min":11.821},"min":{"1min":2.2040000000000002,"5min":2.073,"15min":1.978},"max":{"1min":4.0890000000000004,"5min":603.04399999999998,"15min":946.12400000000002},"last":3.1539999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":50.793999999999997,"5min":13.048,"15min":6.7569999999999997},"min":{"1min":2.6499999999999999,"5min":2.444,"15min":2.444},"max":{"1min":1000.6799999999999,"5min":1000.6799999999999,"15min":1000.6799999999999},"last":2.5590000000000002},{"interface":"front","average":{"1min":3.4630000000000001,"5min":3.464,"15min":3.6360000000000001},"min":{"1min":2.6379999999999999,"5min":2.109,"15min":2.109},"max":{"1min":4.1539999999999999,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":3.327}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1055808,"kb_used_data":7224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93316032,"statfs":{"total":96636764160,"available":95555616768,"internally_reserved":1073741824,"allocated":7397376,"data_stored":5889551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":9.0969999999999995,"15min":7.7830000000000004},"min":{"1min":1.1359999999999999,"5min":1.101,"15min":0.432},"max":{"1min":2.5449999999999999,"5min":616.86699999999996,"15min":706.45299999999997},"last":1.885},{"interface":"front","average":{"1min":15.257999999999999,"5min":4.9610000000000003,"15min":9.9320000000000004},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.56799999999999995},"max":{"1min":276.80900000000003,"5min":276.80900000000003,"15min":677.94000000000005},"last":2.25}]},{"osd":2,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":30.193999999999999,"15min":11.397},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":0.58499999999999996},"max":{"1min":3.4630000000000001,"5min":982.75900000000001,"15min":982.75900000000001},"last":1.9419999999999999},{"interface":"front","average":{"1min":2.4199999999999999,"5min":2.9350000000000001,"15min":7.585},"min":{"1min":1.216,"5min":1.216,"15min":0.66000000000000003},"max":{"1min":4.1660000000000004,"5min":4.5119999999999996,"15min":644.53200000000004},"last":2.4649999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:25 2020","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":2.9710000000000001,"15min":2.6459999999999999},"min":{"1min":1.7629999999999999,"5min":1.4690000000000001,"15min":0.78800000000000003},"max":{"1min":3.6890000000000001,"5min":6.7229999999999999,"15min":11.039999999999999},"last":2.1520000000000001},{"interface":"front","average":{"1min":2.5990000000000002,"5min":5.6310000000000002,"15min":6.9279999999999999},"min":{"1min":1.8700000000000001,"5min":1.093,"15min":0.71099999999999997},"max":{"1min":3.9319999999999999,"5min":266.06799999999998,"15min":874.19399999999996},"last":2.5350000000000001}]},{"osd":4,"last update":"Sat Nov 21 01:56:58 2020","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":3.375,"15min":5.4790000000000001},"min":{"1min":1.724,"5min":1.724,"15min":1.0149999999999999},"max":{"1min":4.117,"5min":5.758,"15min":503.79599999999999},"last":2.4209999999999998},{"interface":"front","average":{"1min":2.867,"5min":3.355,"15min":12.294},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":0.81200000000000006},"max":{"1min":4.1660000000000004,"5min":4.7089999999999996,"15min":921.67100000000005},"last":2.589}]},{"osd":5,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":11.9,"15min":6.1130000000000004},"min":{"1min":1.413,"5min":1.413,"15min":0.75700000000000001},"max":{"1min":3.9849999999999999,"5min":825.02099999999996,"15min":825.02099999999996},"last":2.3380000000000001},{"interface":"front","average":{"1min":2.8250000000000002,"5min":3.0579999999999998,"15min":2.903},"min":{"1min":1.573,"5min":1.4239999999999999,"15min":0.97899999999999998},"max":{"1min":4.0350000000000001,"5min":5.8789999999999996,"15min":41.399999999999999},"last":2.6280000000000001}]},{"osd":6,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":57.990000000000002,"5min":14.18,"15min":6.6859999999999999},"min":{"1min":2.5169999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"max":{"1min":543.01700000000005,"5min":543.01700000000005,"15min":543.01700000000005},"last":3.4340000000000002},{"interface":"front","average":{"1min":30.597999999999999,"5min":19.466999999999999,"15min":9.2479999999999993},"min":{"1min":2.3980000000000001,"5min":1.6659999999999999,"15min":1.6659999999999999},"max":{"1min":603.42200000000003,"5min":603.42200000000003,"15min":603.42200000000003},"last":173.56899999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":3.0350000000000001,"5min":11.760999999999999,"15min":6.6390000000000002},"min":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":1.008},"max":{"1min":3.996,"5min":819.81200000000001,"15min":819.81200000000001},"last":2.673},{"interface":"front","average":{"1min":3.3130000000000002,"5min":8.6189999999999998,"15min":7.4299999999999997},"min":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":0.94799999999999995},"max":{"1min":4.0330000000000004,"5min":511.72800000000001,"15min":659.43100000000004},"last":3.1320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1054756,"kb_used_data":6172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93317084,"statfs":{"total":96636764160,"available":95556694016,"internally_reserved":1073741824,"allocated":6320128,"data_stored":4813443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":8.3879999999999999,"15min":4.0549999999999997},"min":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":0.66700000000000004},"max":{"1min":3.8220000000000001,"5min":358.28899999999999,"15min":358.28899999999999},"last":2.4390000000000001},{"interface":"front","average":{"1min":2.6120000000000001,"5min":8.5660000000000007,"15min":4.6230000000000002},"min":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":0.68200000000000005},"max":{"1min":3.8730000000000002,"5min":605.75599999999997,"15min":605.75599999999997},"last":2.5139999999999998}]},{"osd":2,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":7.7549999999999999,"15min":6.8250000000000002},"min":{"1min":1.5700000000000001,"5min":1.379,"15min":0.745},"max":{"1min":3.4300000000000002,"5min":630.73199999999997,"15min":630.73199999999997},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.7880000000000003,"5min":3.601,"15min":7.6429999999999998},"min":{"1min":1.714,"5min":1.6839999999999999,"15min":0.76700000000000002},"max":{"1min":44.380000000000003,"5min":44.380000000000003,"15min":666.09299999999996},"last":1.5269999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:24 2020","interfaces":[{"interface":"back","average":{"1min":2.476,"5min":11.656000000000001,"15min":11.058},"min":{"1min":1.7010000000000001,"5min":0.81200000000000006,"15min":0.75900000000000001},"max":{"1min":3.3650000000000002,"5min":856.28300000000002,"15min":863.24900000000002},"last":2.4769999999999999},{"interface":"front","average":{"1min":3.2480000000000002,"5min":10.92,"15min":5.2859999999999996},"min":{"1min":2.1099999999999999,"5min":1.5049999999999999,"15min":0.56699999999999995},"max":{"1min":4.3689999999999998,"5min":843.16800000000001,"15min":843.16800000000001},"last":2.726}]},{"osd":4,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":10.308999999999999,"15min":5.1589999999999998},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.01},"max":{"1min":3.6680000000000001,"5min":582.78499999999997,"15min":582.78499999999997},"last":2.5739999999999998},{"interface":"front","average":{"1min":2.6440000000000001,"5min":3.202,"15min":2.879},"min":{"1min":1.353,"5min":1.353,"15min":0.84499999999999997},"max":{"1min":3.7730000000000001,"5min":5.6589999999999998,"15min":18.436},"last":3.1429999999999998}]},{"osd":5,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":17.994,"5min":9.7539999999999996,"15min":8.3599999999999994},"min":{"1min":1.26,"5min":1.26,"15min":0.85799999999999998},"max":{"1min":291.95100000000002,"5min":291.95100000000002,"15min":440.05900000000003},"last":3.2000000000000002},{"interface":"front","average":{"1min":2.948,"5min":7.3259999999999996,"15min":4.1189999999999998},"min":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":0.77900000000000003},"max":{"1min":4.3230000000000004,"5min":487.197,"15min":487.197},"last":2.6309999999999998}]},{"osd":6,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":10.468,"15min":10.647},"min":{"1min":1.8149999999999999,"5min":1.5940000000000001,"15min":1.538},"max":{"1min":4.5460000000000003,"5min":838.65700000000004,"15min":838.65700000000004},"last":3.242},{"interface":"front","average":{"1min":3.7810000000000001,"5min":3.5939999999999999,"15min":6.4880000000000004},"min":{"1min":2.8780000000000001,"5min":1.722,"15min":1.722},"max":{"1min":4.8159999999999998,"5min":5.7830000000000004,"15min":505.416},"last":2.6800000000000002}]},{"osd":7,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.504,"5min":2.7149999999999999,"15min":3.371},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":0.93500000000000005},"max":{"1min":3.504,"5min":4.2069999999999999,"15min":143.36500000000001},"last":2.1800000000000002},{"interface":"front","average":{"1min":6.0060000000000002,"5min":14.949999999999999,"15min":7.1509999999999998},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.2769999999999999},"max":{"1min":58.357999999999997,"5min":536.05999999999995,"15min":536.05999999999995},"last":3.423}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056080,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315760,"statfs":{"total":96636764160,"available":95555338240,"internally_reserved":1073741824,"allocated":7675904,"data_stored":6170596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":2.2610000000000001,"5min":12.776,"15min":11.308},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.55000000000000004},"max":{"1min":3.1459999999999999,"5min":962.596,"15min":962.596},"last":2.0600000000000001},{"interface":"front","average":{"1min":35.854999999999997,"5min":30.399999999999999,"15min":13.113},"min":{"1min":1.21,"5min":1.21,"15min":0.627},"max":{"1min":684.34799999999996,"5min":838.06299999999999,"15min":838.06299999999999},"last":1.974}]},{"osd":1,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":18.277999999999999,"5min":12.526,"15min":8.0730000000000004},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.66800000000000004},"max":{"1min":318.74400000000003,"5min":505.46699999999998,"15min":909.34000000000003},"last":2.23},{"interface":"front","average":{"1min":2.653,"5min":11.750999999999999,"15min":5.3399999999999999},"min":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":0.81000000000000005},"max":{"1min":3.367,"5min":505.87799999999999,"15min":505.87799999999999},"last":2.3450000000000002}]},{"osd":3,"last update":"Sat Nov 21 01:57:19 2020","interfaces":[{"interface":"back","average":{"1min":2.456,"5min":3.0379999999999998,"15min":2.4830000000000001},"min":{"1min":1.7989999999999999,"5min":1.403,"15min":0.66600000000000004},"max":{"1min":3.653,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":2.1349999999999998},{"interface":"front","average":{"1min":2.601,"5min":7.1600000000000001,"15min":12.487},"min":{"1min":1.8640000000000001,"5min":1.476,"15min":0.81999999999999995},"max":{"1min":3.8039999999999998,"5min":395.85399999999998,"15min":998.50900000000001},"last":2.2690000000000001}]},{"osd":4,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":2.6859999999999999,"5min":3.1099999999999999,"15min":4.9180000000000001},"min":{"1min":1.427,"5min":1.427,"15min":0.83399999999999996},"max":{"1min":4.0119999999999996,"5min":5.1289999999999996,"15min":503.00799999999998},"last":3.7709999999999999},{"interface":"front","average":{"1min":3.0150000000000001,"5min":3.6659999999999999,"15min":10.271000000000001},"min":{"1min":1.9970000000000001,"5min":1.9630000000000001,"15min":0.88},"max":{"1min":3.8650000000000002,"5min":7.7069999999999999,"15min":532.94000000000005},"last":3.8759999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:56:54 2020","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":16.928999999999998,"15min":9.0150000000000006},"min":{"1min":1.843,"5min":1.843,"15min":0.82599999999999996},"max":{"1min":3.6779999999999999,"5min":503.97500000000002,"15min":503.97500000000002},"last":3.9430000000000001},{"interface":"front","average":{"1min":2.7509999999999999,"5min":12.058,"15min":10.577},"min":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.002},"max":{"1min":3.742,"5min":832.74400000000003,"15min":846.91800000000001},"last":3.3119999999999998}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":3.1179999999999999,"5min":8.718,"15min":5.9109999999999996},"min":{"1min":2.3180000000000001,"5min":1.8,"15min":1.46},"max":{"1min":3.9199999999999999,"5min":540.46500000000003,"15min":540.46500000000003},"last":3.8050000000000002},{"interface":"front","average":{"1min":3.141,"5min":12.093,"15min":7.8090000000000002},"min":{"1min":2.2130000000000001,"5min":2.21,"15min":1.885},"max":{"1min":4.7889999999999997,"5min":956.26999999999998,"15min":956.26999999999998},"last":2.9969999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":13.583,"15min":14.641},"min":{"1min":2.5529999999999999,"5min":2.3849999999999998,"15min":1.024},"max":{"1min":4.3319999999999999,"5min":817.15499999999997,"15min":884.05799999999999},"last":4.516},{"interface":"front","average":{"1min":3.286,"5min":13.715999999999999,"15min":6.6319999999999997},"min":{"1min":2.4350000000000001,"5min":2.4060000000000001,"15min":1.222},"max":{"1min":4.2880000000000003,"5min":794.65300000000002,"15min":794.65300000000002},"last":4.4480000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1054020,"kb_used_data":5436,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":93317820,"statfs":{"total":96636764160,"available":95557447680,"internally_reserved":1073741824,"allocated":5566464,"data_stored":4057102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8283,"internal_metadata":1073733541},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":2.6389999999999998,"5min":2.415,"15min":3.5590000000000002},"min":{"1min":1.8360000000000001,"5min":1.2270000000000001,"15min":0.51300000000000001},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":409.524},"last":2.819},{"interface":"front","average":{"1min":2.786,"5min":2.5470000000000002,"15min":9.0559999999999992},"min":{"1min":1.958,"5min":1.274,"15min":0.57299999999999995},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":819.28899999999999},"last":2.9529999999999998}]},{"osd":1,"last update":"Sat Nov 21 01:57:15 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":11.744,"15min":12.388},"min":{"1min":1.4930000000000001,"5min":1.1180000000000001,"15min":0.63},"max":{"1min":3.1019999999999999,"5min":889.19299999999998,"15min":889.19299999999998},"last":2.0760000000000001},{"interface":"front","average":{"1min":10.907999999999999,"5min":4.6059999999999999,"15min":7.1790000000000003},"min":{"1min":1.2490000000000001,"5min":0.85099999999999998,"15min":0.57699999999999996},"max":{"1min":180.934,"5min":180.934,"15min":715.11300000000006},"last":2.109}]},{"osd":2,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":25.577000000000002,"5min":19.806999999999999,"15min":8.0739999999999998},"min":{"1min":1.804,"5min":1.196,"15min":0.72699999999999998},"max":{"1min":513.471,"5min":663.274,"15min":663.274},"last":3.2210000000000001},{"interface":"front","average":{"1min":2.8140000000000001,"5min":13.693,"15min":5.944},"min":{"1min":1.411,"5min":1.411,"15min":0.78700000000000003},"max":{"1min":4.492,"5min":959.93799999999999,"15min":959.93799999999999},"last":3.024}]},{"osd":4,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":46.642000000000003,"5min":11.228999999999999,"15min":7.5069999999999997},"min":{"1min":1.8109999999999999,"5min":1.4079999999999999,"15min":0.76800000000000002},"max":{"1min":973.91499999999996,"5min":973.91499999999996,"15min":973.91499999999996},"last":2.4780000000000002},{"interface":"front","average":{"1min":2.7650000000000001,"5min":9.4930000000000003,"15min":4.8380000000000001},"min":{"1min":1.8500000000000001,"5min":1.542,"15min":0.81599999999999995},"max":{"1min":4.0030000000000001,"5min":500.58100000000002,"15min":500.58100000000002},"last":2.2589999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":3.04,"5min":5.7800000000000002,"15min":9.2769999999999992},"min":{"1min":1.9299999999999999,"5min":1.6220000000000001,"15min":0.95799999999999996},"max":{"1min":4.0910000000000002,"5min":222.786,"15min":916.59299999999996},"last":3.0609999999999999},{"interface":"front","average":{"1min":3.1869999999999998,"5min":5.2370000000000001,"15min":3.6019999999999999},"min":{"1min":2.3959999999999999,"5min":2.2010000000000001,"15min":0.98899999999999999},"max":{"1min":4.2210000000000001,"5min":156.923,"15min":156.923},"last":3.1080000000000001}]},{"osd":6,"last update":"Sat Nov 21 01:57:29 2020","interfaces":[{"interface":"back","average":{"1min":3.2919999999999998,"5min":7.827,"15min":4.8920000000000003},"min":{"1min":2.391,"5min":1.837,"15min":1.6539999999999999},"max":{"1min":4.9379999999999997,"5min":504.084,"15min":504.084},"last":739.15800000000002},{"interface":"front","average":{"1min":3.3839999999999999,"5min":10.037000000000001,"15min":5.3570000000000002},"min":{"1min":2.2999999999999998,"5min":1.8819999999999999,"15min":1.8819999999999999},"max":{"1min":4.9779999999999998,"5min":504.26600000000002,"15min":504.26600000000002},"last":3.2650000000000001}]},{"osd":7,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":2.8570000000000002,"5min":2.6930000000000001,"15min":5.8550000000000004},"min":{"1min":2.2400000000000002,"5min":1.73,"15min":0.96999999999999997},"max":{"1min":4.1900000000000004,"5min":4.1900000000000004,"15min":503.988},"last":2.8700000000000001},{"interface":"front","average":{"1min":3.339,"5min":9.3759999999999994,"15min":7.1280000000000001},"min":{"1min":2.5779999999999998,"5min":1.9279999999999999,"15min":1.113},"max":{"1min":3.9830000000000001,"5min":516.32899999999995,"15min":516.32899999999995},"last":3.1699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056128,"kb_used_data":6472,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315712,"statfs":{"total":96636764160,"available":95555289088,"internally_reserved":1073741824,"allocated":6627328,"data_stored":5123134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":3.0630000000000002,"5min":16.297999999999998,"15min":8.9179999999999993},"min":{"1min":1.698,"5min":1.2370000000000001,"15min":0.64100000000000001},"max":{"1min":4.4429999999999996,"5min":916.29999999999995,"15min":916.29999999999995},"last":1.5269999999999999},{"interface":"front","average":{"1min":3.3239999999999998,"5min":2.8959999999999999,"15min":11.291},"min":{"1min":2.1280000000000001,"5min":1.526,"15min":0.75700000000000001},"max":{"1min":4.5730000000000004,"5min":4.7320000000000002,"15min":767.30399999999997},"last":2.2450000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":8.4600000000000009,"5min":3.7269999999999999,"15min":4.6539999999999999},"min":{"1min":1.458,"5min":1.458,"15min":0.624},"max":{"1min":138.65600000000001,"5min":138.65600000000001,"15min":504.04599999999999},"last":3.298},{"interface":"front","average":{"1min":2.819,"5min":8.0690000000000008,"15min":6.1840000000000002},"min":{"1min":1.7270000000000001,"5min":1.6930000000000001,"15min":0.78300000000000003},"max":{"1min":4.2889999999999997,"5min":461.66300000000001,"15min":554.63400000000001},"last":3.056}]},{"osd":2,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.7120000000000002,"15min":7.6619999999999999},"min":{"1min":1.7470000000000001,"5min":1.647,"15min":0.74199999999999999},"max":{"1min":3.5099999999999998,"5min":4.2409999999999997,"15min":778.90099999999995},"last":1.613},{"interface":"front","average":{"1min":3.3420000000000001,"5min":3.1680000000000001,"15min":3.4500000000000002},"min":{"1min":1.746,"5min":1.746,"15min":0.85099999999999998},"max":{"1min":4.641,"5min":4.7939999999999996,"15min":152.31399999999999},"last":3.1259999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":8.468,"5min":4.0129999999999999,"15min":5.6299999999999999},"min":{"1min":2.0569999999999999,"5min":1.5680000000000001,"15min":0.76100000000000001},"max":{"1min":118.27800000000001,"5min":118.27800000000001,"15min":729.13999999999999},"last":3.1840000000000002},{"interface":"front","average":{"1min":2.7759999999999998,"5min":3.992,"15min":7.5700000000000003},"min":{"1min":1.8400000000000001,"5min":1.5600000000000001,"15min":0.89000000000000001},"max":{"1min":3.9550000000000001,"5min":89.834999999999994,"15min":488.00200000000001},"last":3.2519999999999998}]},{"osd":5,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":2.9849999999999999,"15min":4.9100000000000001},"min":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":0.98699999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":694.28700000000003},"last":3.3959999999999999},{"interface":"front","average":{"1min":3.7309999999999999,"5min":11.435,"15min":10.186999999999999},"min":{"1min":1.851,"5min":1.851,"15min":0.83599999999999997},"max":{"1min":5.6459999999999999,"5min":756.149,"15min":863.53899999999999},"last":3.0169999999999999}]},{"osd":6,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.8959999999999999,"5min":2.9790000000000001,"15min":3.5070000000000001},"min":{"1min":2.0219999999999998,"5min":1.9530000000000001,"15min":1.903},"max":{"1min":3.6680000000000001,"5min":4.3010000000000002,"15min":87.953999999999994},"last":2.4329999999999998},{"interface":"front","average":{"1min":3.448,"5min":3.7450000000000001,"15min":3.5470000000000002},"min":{"1min":2.7679999999999998,"5min":2.5590000000000002,"15min":2.218},"max":{"1min":4.2779999999999996,"5min":6.0259999999999998,"15min":10.332000000000001},"last":3.3570000000000002}]},{"osd":7,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":3.2519999999999998,"5min":3.2850000000000001,"15min":4.1920000000000002},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":1.046},"max":{"1min":4.3099999999999996,"5min":4.9260000000000002,"15min":370.06999999999999},"last":2.0070000000000001},{"interface":"front","average":{"1min":11.036,"5min":4.8630000000000004,"15min":5.4720000000000004},"min":{"1min":2.472,"5min":2.3010000000000002,"15min":1.0760000000000001},"max":{"1min":180.90000000000001,"5min":180.90000000000001,"15min":250.59200000000001},"last":3.4820000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056532,"kb_used_data":7948,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315308,"statfs":{"total":96636764160,"available":95554875392,"internally_reserved":1073741824,"allocated":8138752,"data_stored":6614360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:54 2020","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":13.654999999999999,"15min":12.284000000000001},"min":{"1min":1.591,"5min":1.3560000000000001,"15min":0.69699999999999995},"max":{"1min":3.8239999999999998,"5min":503.875,"15min":837.21299999999997},"last":1.659},{"interface":"front","average":{"1min":2.2930000000000001,"5min":19.245999999999999,"15min":10.851000000000001},"min":{"1min":1.7390000000000001,"5min":1.347,"15min":0.59199999999999997},"max":{"1min":2.9550000000000001,"5min":909.01099999999997,"15min":909.01099999999997},"last":2.4630000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:56:44 2020","interfaces":[{"interface":"back","average":{"1min":2.605,"5min":3.0219999999999998,"15min":5.0220000000000002},"min":{"1min":1.405,"5min":1.405,"15min":0.88},"max":{"1min":3.6669999999999998,"5min":5.9749999999999996,"15min":614.09100000000001},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.8769999999999998,"5min":3.0950000000000002,"15min":2.8250000000000002},"min":{"1min":2.0030000000000001,"5min":1.4910000000000001,"15min":1.046},"max":{"1min":3.714,"5min":6.0250000000000004,"15min":10.260999999999999},"last":2.0779999999999998}]},{"osd":2,"last update":"Sat Nov 21 01:56:45 2020","interfaces":[{"interface":"back","average":{"1min":53.997,"5min":13.462,"15min":6.2039999999999997},"min":{"1min":2.2389999999999999,"5min":1.6439999999999999,"15min":0.76600000000000001},"max":{"1min":945.43200000000002,"5min":945.43200000000002,"15min":945.43200000000002},"last":2.1320000000000001},{"interface":"front","average":{"1min":2.9220000000000002,"5min":3.9180000000000001,"15min":4.9720000000000004},"min":{"1min":1.8129999999999999,"5min":1.4119999999999999,"15min":0.70599999999999996},"max":{"1min":4.1580000000000004,"5min":109.07299999999999,"15min":250.98699999999999},"last":1.7689999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:15 2020","interfaces":[{"interface":"back","average":{"1min":3.0979999999999999,"5min":11.407,"15min":10.769},"min":{"1min":2.1429999999999998,"5min":2.0539999999999998,"15min":0.93700000000000006},"max":{"1min":4.1870000000000003,"5min":644.36800000000005,"15min":904.99900000000002},"last":2.7629999999999999},{"interface":"front","average":{"1min":3.1779999999999999,"5min":11.866,"15min":7.7140000000000004},"min":{"1min":2.226,"5min":2.226,"15min":0.876},"max":{"1min":4.1139999999999999,"5min":606.54700000000003,"15min":606.54700000000003},"last":2.2349999999999999}]},{"osd":4,"last update":"Sat Nov 21 01:56:44 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":2.9790000000000001,"15min":3.3769999999999998},"min":{"1min":2.2189999999999999,"5min":1.601,"15min":0.97899999999999998},"max":{"1min":4.2859999999999996,"5min":4.8339999999999996,"15min":99.460999999999999},"last":2.4039999999999999},{"interface":"front","average":{"1min":2.4550000000000001,"5min":9.4819999999999993,"15min":9.0380000000000003},"min":{"1min":1.988,"5min":1.423,"15min":0.78300000000000003},"max":{"1min":3.165,"5min":504.702,"15min":996.00300000000004},"last":3.0209999999999999}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":2.8919999999999999,"5min":9.9299999999999997,"15min":5.3129999999999997},"min":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":1.825},"max":{"1min":3.3370000000000002,"5min":665.43399999999997,"15min":665.43399999999997},"last":2.548},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.8719999999999999,"15min":2.8279999999999998},"min":{"1min":2.0720000000000001,"5min":1.8620000000000001,"15min":1.8320000000000001},"max":{"1min":3.3380000000000001,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":2.8799999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:52 2020","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":3.9660000000000002,"15min":8.8460000000000001},"min":{"1min":2.8220000000000001,"5min":2.379,"15min":0.73099999999999998},"max":{"1min":5.1079999999999997,"5min":6.7999999999999998,"15min":713.923},"last":2.823},{"interface":"front","average":{"1min":3.7999999999999998,"5min":11.068,"15min":9.0869999999999997},"min":{"1min":2.8599999999999999,"5min":2.766,"15min":0.85899999999999999},"max":{"1min":5.1580000000000004,"5min":471.07400000000001,"15min":520.44500000000005},"last":2.9380000000000002}]}]}]}}
, 2020-11-21T01:57:42.073 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:57:42.073 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: instructing pg 2.4s0 on osd.5 to deep-scrub
, 2020-11-21T01:58:10.939 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed.
, 2020-11-21T01:58:30.941 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json

Ignoring malparsed backtrace: 2020-11-21T01:59:33.038 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:59:33.038 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-21 01:43:35.218295 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=43, tm_sec=35, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:59:33.039 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T02:00:18.649 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.0
, instructing pg 2.0s0 on osd.3 to deep-scrub
, 2020-11-21T02:00:19.003 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.2

Ignoring malparsed backtrace: 2020-11-21T02:01:23.814 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T02:01:23.814 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T02:01:23.815 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2020-11-21 01:46:15.310508 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T02:02:26.228 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.c
, instructing pg 2.cs0 on osd.6 to deep-scrub
, 2020-11-21T02:02:26.575 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b

Ignoring malparsed backtrace: 2020-11-21T02:03:34.465 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json
, dumped all
, 2020-11-21T02:03:34.891 INFO:teuthology.orchestra.run.smithi018.stdout:

Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_nautilus-testing-162/qa/tasks/rados.py", line 260, in thread
,     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait

Ignoring malparsed backtrace: 2020-11-21T02:04:19.436 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.ifJG5wR5oD is 1MB
, 2020-11-21T02:04:19.504 INFO:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.ifJG5wR5oD
, 2020-11-21T02:04:19.512 INFO:tasks.ceph:Cleaning ceph cluster...

Ignoring malparsed backtrace: 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:==============================================================================
, 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 216.240.36.24    3 u    4   64  377    0.075   -2.292   0.370
, 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:*hv02.front.sepi 163.237.218.18   2 u    6   64  377    0.074   -2.202   0.360

Ignoring malparsed backtrace:  ceph version 14.2.11-113-g5c0b894435 (5c0b894435c8a34e4ce6446e264581811994cca3) nautilus (stable)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xdf) [0x7fe4bc08f59c]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5eb) [0x423adb]

Ignoring malparsed backtrace: 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:11.499929",
, 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.312 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:35.306506",

Ignoring malparsed backtrace: 2020-11-21T01:49:09.331 INFO:teuthology.orchestra.run.smithi059.stdout:                    "client_addr": "172.21.15.18:0/3425446096",
, 2020-11-21T01:49:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:                    "tid": 5662
, 2020-11-21T01:49:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:                },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.257616",
, 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "started"
, 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "commit_sent"
, 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.391 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.392 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.392 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.244887",

Ignoring malparsed backtrace: 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:01.173631",
, 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "commit_sent"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.265179",
, 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"
, 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.452 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"
, 2020-11-21T01:49:09.453 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.453 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:44.827457",
, 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.493 INFO:teuthology.orchestra.run.smithi059.stdout:            }
, 2020-11-21T01:49:09.493 INFO:teuthology.orchestra.run.smithi059.stdout:        },
, 2020-11-21T01:49:09.494 INFO:teuthology.orchestra.run.smithi059.stdout:        {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "queued_for_pg"
, 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:46:03.096418",
, 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "sub_op_committed"
, 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:32.306018",
, 2020-11-21T01:49:10.018 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "sub_op_started"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.038 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:32.297480",
, 2020-11-21T01:49:10.038 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"
, 2020-11-21T01:49:10.039 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.060 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.061 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:49.577772",
, 2020-11-21T01:49:10.061 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "throttled"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "initiated_at": "2020-11-21 01:44:09.765184",
, 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "age": 300.21945402799997,
, 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "duration": 1.0039103819999999,

Ignoring malparsed backtrace: 2020-11-21T01:49:10.103 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"
, 2020-11-21T01:49:10.104 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:10.104 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:44:09.844709",
, 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:46:43.935210",
, 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "all_read"
, 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.165 INFO:teuthology.orchestra.run.smithi059.stdout:        },
, 2020-11-21T01:49:10.166 INFO:teuthology.orchestra.run.smithi059.stdout:        {
, 2020-11-21T01:49:10.166 INFO:teuthology.orchestra.run.smithi059.stdout:            "description": "osd_op(client.4353.0:9502 2.1s0 2:805fb934:::smithi01816282-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e149)",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:                ]
, 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:            }
, 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:        },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                "events": [
, 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:47:56.729375",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:44:54.345299",
, 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "started"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:44:54.335963",
, 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"
, 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                "events": [
, 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:20.445942",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:20.446277",
, 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "waiting for peered"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "initiated_at": "2020-11-21 01:45:20.563415",
, 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "age": 230.0142993,
, 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "duration": 0.86483692599999995,

Ignoring malparsed backtrace: 2020-11-21T01:49:10.697 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "dispatched"
, 2020-11-21T01:49:10.697 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.698 INFO:teuthology.orchestra.run.smithi018.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:21.540535",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:46:04.939266",
, 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "started"
, 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"
, 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.783 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.783 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:46:04.947451",
, 2020-11-21T01:49:10.784 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:            }
, 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:        },
, 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:        {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.826 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.827 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.827 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:48:00.734910",

Ignoring malparsed backtrace: command deprecated
, 2020-11-21T01:49:27.933 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 6 1
, reweighted osd.6 to 1 (10000)

Ignoring malparsed backtrace: 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:                "osdmap-prune",
, 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:                "nautilus"
, 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:            ],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:    "mgrmap": {
, 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:        "epoch": 3,
, 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:        "active_gid": 4108,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.406 INFO:teuthology.orchestra.run.smithi018.stdout:                            "smtp_port": {
, 2020-11-21T01:49:36.406 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "smtp_port",
, 2020-11-21T01:49:36.407 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.426 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []

Ignoring malparsed backtrace: 2020-11-21T01:49:36.447 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "0.001",
, 2020-11-21T01:49:36.447 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "0.999",
, 2020-11-21T01:49:36.448 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "5",
, 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "1",
, 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                            },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                            "REST_REQUESTS_TIMEOUT": {
, 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "REST_REQUESTS_TIMEOUT",
, 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "level": "advanced",
, 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "flags": 0,
, 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "True",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.565 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.565 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",
, 2020-11-21T01:49:36.566 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",
, 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "automatically mark OSD if it may fail before this long",
, 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "",
, 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.644 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                            },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.682 INFO:teuthology.orchestra.run.smithi018.stdout:                            "username": {
, 2020-11-21T01:49:36.682 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "username",
, 2020-11-21T01:49:36.683 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "str",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                            },
, 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                            "prefix": {

Ignoring malparsed backtrace: 2020-11-21T01:49:36.721 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.721 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "how frequently to persist completed events",
, 2020-11-21T01:49:36.722 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "can_run": true,
, 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "error_string": "",
, 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "module_options": {}

Ignoring malparsed backtrace: 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                            },
, 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                            "testnewline": {

Ignoring malparsed backtrace: 2020-11-21T01:49:36.799 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "bool",
, 2020-11-21T01:49:36.799 INFO:teuthology.orchestra.run.smithi018.stdout:                                "level": "advanced",
, 2020-11-21T01:49:36.800 INFO:teuthology.orchestra.run.smithi018.stdout:                                "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "False",
, 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "volumes",
, 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                        "can_run": true,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "60",
, 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "Use SSL to connect to SMTP server",
, 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.898 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:36.898 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:36.899 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                    "min_score": {
, 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "min_score",
, 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "float",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.937 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.937 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",
, 2020-11-21T01:49:36.938 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.956 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "bool",
, 2020-11-21T01:49:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "",
, 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",
, 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:37.016 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                    "ssl_server_port": {
, 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "ssl_server_port",
, 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",
, 2020-11-21T01:49:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 1,
, 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "86400",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                    "diskprediction_port": {
, 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "diskprediction_port",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "str",
, 2020-11-21T01:49:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.114 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "30",
, 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.152 INFO:teuthology.orchestra.run.smithi018.stdout:            {
, 2020-11-21T01:49:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:                "name": "iostat",
, 2020-11-21T01:49:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:                "can_run": true,

Ignoring malparsed backtrace: 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                "module_options": {
, 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                    "orchestrator": {
, 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "orchestrator",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",
, 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",
, 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                    "server_port": {
, 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "server_port",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,
, 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.250 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.250 INFO:teuthology.orchestra.run.smithi018.stdout:                    "ssh_config_file": {
, 2020-11-21T01:49:37.251 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "ssh_config_file",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",
, 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []

Ignoring malparsed backtrace: 2020-11-21T01:49:37.289 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.289 INFO:teuthology.orchestra.run.smithi018.stdout:                    "leaderboard": {
, 2020-11-21T01:49:37.290 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "leaderboard",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: Set osd_debug_deep_scrub_sleep to 0
, 2020-11-21T01:49:41.868 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 3
, instructed osd(s) 3 to deep-scrub

Ignoring malparsed backtrace: 2020-11-21T01:50:25.617 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:50:25.617 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:50:25.618 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2020-11-21 01:46:15.310508 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:51:28.158 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.c
, instructing pg 2.cs0 on osd.6 to deep-scrub
, 2020-11-21T01:51:28.506 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b

Ignoring malparsed backtrace: 2020-11-21T01:52:37.520 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json
, 2020-11-21T01:52:37.956 INFO:teuthology.orchestra.run.smithi018.stdout:
, dumped all

Ignoring malparsed backtrace: 2020-11-21T01:53:39.356 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-11-21 01:45:59.251426 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=45, tm_sec=59, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:53:39.356 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:53:39.357 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-21 01:46:01.028764 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=1, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:54:29.240 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:54:29.241 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:54:29.241 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:55:30.645 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:55:30.646 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-21 01:45:15.118160 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=45, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:55:30.646 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:56:20.265 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-21 01:46:15.622973 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:56:20.266 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:56:20.266 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:57:42.070 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":693,"stamp":"2020-11-21 01:57:40.423329","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9694619,"num_objects":9,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4863,"num_read_kb":2628,"num_write":11063,"num_write_kb":3124134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":120576433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14547,"ondisk_log_size":14547,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8442452,"kb_used_data":51636,"kb_used_omap":12,"kb_used_meta":8388595,"kb_avail":746532268,"statfs":{"total":773094113280,"available":764449042432,"internally_reserved":8589934592,"allocated":52875264,"data_stored":40791016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13029,"internal_metadata":8589921563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004262"},"pg_stats":[{"pgid":"2.f","version":"218'704","reported_seq":"1316","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.579539","last_change":"2020-11-21 01:48:23.138350","last_active":"2020-11-21 01:49:27.579539","last_peered":"2020-11-21 01:49:27.579539","last_clean":"2020-11-21 01:49:27.579539","last_became_active":"2020-11-21 01:48:23.137013","last_became_peered":"2020-11-21 01:48:23.137013","last_unstale":"2020-11-21 01:49:27.579539","last_undegraded":"2020-11-21 01:49:27.579539","last_fullsized":"2020-11-21 01:49:27.579539","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":704,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2646456,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":228,"num_read_kb":122,"num_write":533,"num_write_kb":161328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5301007,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"218'740","reported_seq":"1328","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802871","last_change":"2020-11-21 01:47:36.346751","last_active":"2020-11-21 01:49:27.802871","last_peered":"2020-11-21 01:49:27.802871","last_clean":"2020-11-21 01:49:27.802871","last_became_active":"2020-11-21 01:47:36.345399","last_became_peered":"2020-11-21 01:47:36.345399","last_unstale":"2020-11-21 01:49:27.802871","last_undegraded":"2020-11-21 01:49:27.802871","last_fullsized":"2020-11-21 01:49:27.802871","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":740,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":134,"num_write":563,"num_write_kb":153923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":2507015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"218'1407","reported_seq":"2251","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.804338","last_change":"2020-11-21 01:49:21.461898","last_active":"2020-11-21 01:49:27.804338","last_peered":"2020-11-21 01:49:27.804338","last_clean":"2020-11-21 01:49:27.804338","last_became_active":"2020-11-21 01:49:21.459434","last_became_peered":"2020-11-21 01:49:21.459434","last_unstale":"2020-11-21 01:49:27.804338","last_undegraded":"2020-11-21 01:49:27.804338","last_fullsized":"2020-11-21 01:49:27.804338","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1407,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4805509,"num_objects":2,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":482,"num_read_kb":262,"num_write":1091,"num_write_kb":308491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":10228125,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"218'2049","reported_seq":"3023","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.531234","last_change":"2020-11-21 01:49:21.445018","last_active":"2020-11-21 01:49:27.531234","last_peered":"2020-11-21 01:49:27.531234","last_clean":"2020-11-21 01:49:27.531234","last_became_active":"2020-11-21 01:49:21.441526","last_became_peered":"2020-11-21 01:49:21.441526","last_unstale":"2020-11-21 01:49:27.531234","last_undegraded":"2020-11-21 01:49:27.531234","last_fullsized":"2020-11-21 01:49:27.531234","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":2049,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56000,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":386,"num_write":1567,"num_write_kb":447186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":20898718,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"218'676","reported_seq":"1253","reported_epoch":"231","state":"active+clean+scrubbing","last_fresh":"2020-11-21 01:49:27.799483","last_change":"2020-11-21 01:49:11.430911","last_active":"2020-11-21 01:49:27.799483","last_peered":"2020-11-21 01:49:27.799483","last_clean":"2020-11-21 01:49:27.799483","last_became_active":"2020-11-21 01:47:42.443530","last_became_peered":"2020-11-21 01:47:42.443530","last_unstale":"2020-11-21 01:49:27.799483","last_undegraded":"2020-11-21 01:49:27.799483","last_fullsized":"2020-11-21 01:49:27.799483","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":676,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":119,"num_write":495,"num_write_kb":141622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":6890404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"432","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.530837","last_change":"2020-11-21 01:49:21.439481","last_active":"2020-11-21 01:49:27.530837","last_peered":"2020-11-21 01:49:27.530837","last_clean":"2020-11-21 01:49:27.530837","last_became_active":"2020-11-21 01:49:21.436946","last_became_peered":"2020-11-21 01:49:21.436946","last_unstale":"2020-11-21 01:49:27.530837","last_undegraded":"2020-11-21 01:49:27.530837","last_fullsized":"2020-11-21 01:49:27.530837","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.9","version":"218'1492","reported_seq":"2411","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802592","last_change":"2020-11-21 01:49:21.440824","last_active":"2020-11-21 01:49:27.802592","last_peered":"2020-11-21 01:49:27.802592","last_clean":"2020-11-21 01:49:27.802592","last_became_active":"2020-11-21 01:49:21.437802","last_became_peered":"2020-11-21 01:49:21.437802","last_unstale":"2020-11-21 01:49:27.802592","last_undegraded":"2020-11-21 01:49:27.802592","last_fullsized":"2020-11-21 01:49:27.802592","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1492,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72807,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":491,"num_read_kb":255,"num_write":1110,"num_write_kb":302366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":13025087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"218'1473","reported_seq":"2309","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.578953","last_change":"2020-11-21 01:47:42.447558","last_active":"2020-11-21 01:49:27.578953","last_peered":"2020-11-21 01:49:27.578953","last_clean":"2020-11-21 01:49:27.578953","last_became_active":"2020-11-21 01:47:42.445405","last_became_peered":"2020-11-21 01:47:42.445405","last_unstale":"2020-11-21 01:49:27.578953","last_undegraded":"2020-11-21 01:49:27.578953","last_fullsized":"2020-11-21 01:49:27.578953","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1473,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":425754,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":263,"num_write":1135,"num_write_kb":325611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26507271,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"252","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.532554","last_change":"2020-11-21 01:49:18.495622","last_active":"2020-11-21 01:49:27.532554","last_peered":"2020-11-21 01:49:27.532554","last_clean":"2020-11-21 01:49:27.532554","last_became_active":"2020-11-21 01:49:18.494721","last_became_peered":"2020-11-21 01:49:18.494721","last_unstale":"2020-11-21 01:49:27.532554","last_undegraded":"2020-11-21 01:49:27.532554","last_fullsized":"2020-11-21 01:49:27.532554","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:43:35.218295","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:43:35.218295","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"564","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802891","last_change":"2020-11-21 01:49:21.435350","last_active":"2020-11-21 01:49:27.802891","last_peered":"2020-11-21 01:49:27.802891","last_clean":"2020-11-21 01:49:27.802891","last_became_active":"2020-11-21 01:49:21.433370","last_became_peered":"2020-11-21 01:49:21.433370","last_unstale":"2020-11-21 01:49:27.802891","last_undegraded":"2020-11-21 01:49:27.802891","last_fullsized":"2020-11-21 01:49:27.802891","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"154","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.533217","last_change":"2020-11-21 01:45:59.251495","last_active":"2020-11-21 01:49:27.533217","last_peered":"2020-11-21 01:49:27.533217","last_clean":"2020-11-21 01:49:27.533217","last_became_active":"2020-11-21 01:45:59.194369","last_became_peered":"2020-11-21 01:45:59.194369","last_unstale":"2020-11-21 01:49:27.533217","last_undegraded":"2020-11-21 01:49:27.533217","last_fullsized":"2020-11-21 01:49:27.533217","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:45:59.251426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:45:59.251426","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"476","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799676","last_change":"2020-11-21 01:49:21.447000","last_active":"2020-11-21 01:49:27.799676","last_peered":"2020-11-21 01:49:27.799676","last_clean":"2020-11-21 01:49:27.799676","last_became_active":"2020-11-21 01:49:21.443761","last_became_peered":"2020-11-21 01:49:21.443761","last_unstale":"2020-11-21 01:49:27.799676","last_undegraded":"2020-11-21 01:49:27.799676","last_fullsized":"2020-11-21 01:49:27.799676","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"227","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802892","last_change":"2020-11-21 01:46:01.028877","last_active":"2020-11-21 01:49:27.802892","last_peered":"2020-11-21 01:49:27.802892","last_clean":"2020-11-21 01:49:27.802892","last_became_active":"2020-11-21 01:42:26.196186","last_became_peered":"2020-11-21 01:42:26.196186","last_unstale":"2020-11-21 01:49:27.802892","last_undegraded":"2020-11-21 01:49:27.802892","last_fullsized":"2020-11-21 01:49:27.802892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:01.028764","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:01.028764","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"218'1418","reported_seq":"2127","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799283","last_change":"2020-11-21 01:49:21.450011","last_active":"2020-11-21 01:49:27.799283","last_peered":"2020-11-21 01:49:27.799283","last_clean":"2020-11-21 01:49:27.799283","last_became_active":"2020-11-21 01:49:21.447333","last_became_peered":"2020-11-21 01:49:21.447333","last_unstale":"2020-11-21 01:49:27.799283","last_undegraded":"2020-11-21 01:49:27.799283","last_fullsized":"2020-11-21 01:49:27.799283","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1418,"ondisk_log_size":1418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":717052,"num_objects":2,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":245,"num_write":1050,"num_write_kb":293922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":7786358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"122","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.579055","last_change":"2020-11-21 01:46:15.623092","last_active":"2020-11-21 01:49:27.579055","last_peered":"2020-11-21 01:49:27.579055","last_clean":"2020-11-21 01:49:27.579055","last_became_active":"2020-11-21 01:45:59.201470","last_became_peered":"2020-11-21 01:45:59.201470","last_unstale":"2020-11-21 01:49:27.579055","last_undegraded":"2020-11-21 01:49:27.579055","last_fullsized":"2020-11-21 01:49:27.579055","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:15.622973","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:15.622973","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"218'1454","reported_seq":"2134","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.533066","last_change":"2020-11-21 01:49:07.494863","last_active":"2020-11-21 01:49:27.533066","last_peered":"2020-11-21 01:49:27.533066","last_clean":"2020-11-21 01:49:27.533066","last_became_active":"2020-11-21 01:47:36.349048","last_became_peered":"2020-11-21 01:47:36.349048","last_unstale":"2020-11-21 01:49:27.533066","last_undegraded":"2020-11-21 01:49:27.533066","last_fullsized":"2020-11-21 01:49:27.533066","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1454,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":341719,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":473,"num_read_kb":260,"num_write":1090,"num_write_kb":307978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":8725372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"243","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.798586","last_change":"2020-11-21 01:47:33.321369","last_active":"2020-11-21 01:49:27.798586","last_peered":"2020-11-21 01:49:27.798586","last_clean":"2020-11-21 01:49:27.798586","last_became_active":"2020-11-21 01:47:33.320616","last_became_peered":"2020-11-21 01:47:33.320616","last_unstale":"2020-11-21 01:49:27.798586","last_undegraded":"2020-11-21 01:49:27.798586","last_fullsized":"2020-11-21 01:49:27.798586","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:16.763583","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:16.763583","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"406","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799530","last_change":"2020-11-21 01:49:21.445247","last_active":"2020-11-21 01:49:27.799530","last_peered":"2020-11-21 01:49:27.799530","last_clean":"2020-11-21 01:49:27.799530","last_became_active":"2020-11-21 01:49:21.443350","last_became_peered":"2020-11-21 01:49:21.443350","last_unstale":"2020-11-21 01:49:27.799530","last_undegraded":"2020-11-21 01:49:27.799530","last_fullsized":"2020-11-21 01:49:27.799530","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"77","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799321","last_change":"2020-11-21 01:49:18.499430","last_active":"2020-11-21 01:49:27.799321","last_peered":"2020-11-21 01:49:27.799321","last_clean":"2020-11-21 01:49:27.799321","last_became_active":"2020-11-21 01:49:18.492869","last_became_peered":"2020-11-21 01:49:18.492869","last_unstale":"2020-11-21 01:49:27.799321","last_undegraded":"2020-11-21 01:49:27.799321","last_fullsized":"2020-11-21 01:49:27.799321","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:15.310508","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:15.310508","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"218'1541","reported_seq":"2368","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799593","last_change":"2020-11-21 01:49:21.446334","last_active":"2020-11-21 01:49:27.799593","last_peered":"2020-11-21 01:49:27.799593","last_clean":"2020-11-21 01:49:27.799593","last_became_active":"2020-11-21 01:49:21.443330","last_became_peered":"2020-11-21 01:49:21.443330","last_unstale":"2020-11-21 01:49:27.799593","last_undegraded":"2020-11-21 01:49:27.799593","last_fullsized":"2020-11-21 01:49:27.799593","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1541,"ondisk_log_size":1541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":629322,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":287,"num_write":1198,"num_write_kb":331555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":14772258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"77","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799637","last_change":"2020-11-21 01:49:18.494641","last_active":"2020-11-21 01:49:27.799637","last_peered":"2020-11-21 01:49:27.799637","last_clean":"2020-11-21 01:49:27.799637","last_became_active":"2020-11-21 01:49:18.492628","last_became_peered":"2020-11-21 01:49:18.492628","last_unstale":"2020-11-21 01:49:27.799637","last_undegraded":"2020-11-21 01:49:27.799637","last_fullsized":"2020-11-21 01:49:27.799637","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:45:15.118160","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:45:15.118160","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"490","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799796","last_change":"2020-11-21 01:49:21.449358","last_active":"2020-11-21 01:49:27.799796","last_peered":"2020-11-21 01:49:27.799796","last_clean":"2020-11-21 01:49:27.799796","last_became_active":"2020-11-21 01:49:21.442547","last_became_peered":"2020-11-21 01:49:21.442547","last_unstale":"2020-11-21 01:49:27.799796","last_undegraded":"2020-11-21 01:49:27.799796","last_fullsized":"2020-11-21 01:49:27.799796","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"58","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.798799","last_change":"2020-11-21 01:49:18.489979","last_active":"2020-11-21 01:49:27.798799","last_peered":"2020-11-21 01:49:27.798799","last_clean":"2020-11-21 01:49:27.798799","last_became_active":"2020-11-21 01:49:18.489348","last_became_peered":"2020-11-21 01:49:18.489348","last_unstale":"2020-11-21 01:49:27.798799","last_undegraded":"2020-11-21 01:49:27.798799","last_fullsized":"2020-11-21 01:49:27.798799","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:43:37.944445","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:43:37.944445","last_clean_scrub_stamp":"2020-11-21 01:43:37.944445","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"218'1593","reported_seq":"2310","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.803509","last_change":"2020-11-21 01:49:21.450622","last_active":"2020-11-21 01:49:27.803509","last_peered":"2020-11-21 01:49:27.803509","last_clean":"2020-11-21 01:49:27.803509","last_became_active":"2020-11-21 01:49:21.448205","last_became_peered":"2020-11-21 01:49:21.448205","last_unstale":"2020-11-21 01:49:27.803509","last_undegraded":"2020-11-21 01:49:27.803509","last_fullsized":"2020-11-21 01:49:27.803509","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1593,"ondisk_log_size":1593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":550,"num_read_kb":295,"num_write":1231,"num_write_kb":350152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3934818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":9694619,"num_objects":9,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4863,"num_read_kb":2628,"num_write":11063,"num_write_kb":3124134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":120576433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30396416,"data_stored":30316440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14547,"ondisk_log_size":14547,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056272,"kb_used_data":6616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315568,"statfs":{"total":96636764160,"available":95555141632,"internally_reserved":1073741824,"allocated":6774784,"data_stored":5263069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":2.1869999999999998,"15min":2.7029999999999998},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.505},"max":{"1min":2.0409999999999999,"5min":5.2649999999999997,"15min":176.50299999999999},"last":2.6509999999999998},{"interface":"front","average":{"1min":45.786000000000001,"5min":18.466000000000001,"15min":12.922000000000001},"min":{"1min":1.4890000000000001,"5min":1.407,"15min":0.93999999999999995},"max":{"1min":874.53499999999997,"5min":874.53499999999997,"15min":874.53499999999997},"last":4.6159999999999997}]},{"osd":1,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.8759999999999999,"15min":13.609},"min":{"1min":1.6599999999999999,"5min":1.6499999999999999,"15min":0.68799999999999994},"max":{"1min":3.4870000000000001,"5min":5.5549999999999997,"15min":959.54899999999998},"last":2},{"interface":"front","average":{"1min":2.7330000000000001,"5min":11.808,"15min":8.2910000000000004},"min":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":0.61499999999999999},"max":{"1min":3.5329999999999999,"5min":960.101,"15min":960.101},"last":2.1920000000000002}]},{"osd":2,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":6.5430000000000001,"15min":9.577},"min":{"1min":1.405,"5min":1.405,"15min":0.72499999999999998},"max":{"1min":2.7469999999999999,"5min":503.74000000000001,"15min":593.19299999999998},"last":2.1070000000000002},{"interface":"front","average":{"1min":2.9239999999999999,"5min":13.635,"15min":8.0709999999999997},"min":{"1min":1.669,"5min":1.669,"15min":0.76500000000000001},"max":{"1min":3.5920000000000001,"5min":503.89499999999998,"15min":504.392},"last":2.593}]},{"osd":3,"last update":"Sat Nov 21 01:57:33 2020","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":8.7430000000000003,"15min":6.375},"min":{"1min":1.4670000000000001,"5min":1.2410000000000001,"15min":0.88200000000000001},"max":{"1min":3.7349999999999999,"5min":576.24300000000005,"15min":607.37800000000004},"last":1.9490000000000001},{"interface":"front","average":{"1min":2.9209999999999998,"5min":10.885999999999999,"15min":10.068},"min":{"1min":2.2879999999999998,"5min":1.746,"15min":1.0549999999999999},"max":{"1min":4.0999999999999996,"5min":503.45699999999999,"15min":707.11599999999999},"last":4.3090000000000002}]},{"osd":4,"last update":"Sat Nov 21 01:56:59 2020","interfaces":[{"interface":"back","average":{"1min":2.605,"5min":3.2730000000000001,"15min":3.044},"min":{"1min":1.883,"5min":1.825,"15min":0.98999999999999999},"max":{"1min":4.1779999999999999,"5min":5.0460000000000003,"15min":29.231999999999999},"last":4.4260000000000002},{"interface":"front","average":{"1min":3.1579999999999999,"5min":3.5760000000000001,"15min":4.7549999999999999},"min":{"1min":2.327,"5min":2.1389999999999998,"15min":0.82799999999999996},"max":{"1min":4.3049999999999997,"5min":5.1609999999999996,"15min":559.48500000000001},"last":4.7960000000000003}]},{"osd":5,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":10.624000000000001,"15min":9.1129999999999995},"min":{"1min":2.2040000000000002,"5min":1.456,"15min":0.77900000000000003},"max":{"1min":3.661,"5min":805.25800000000004,"15min":805.25800000000004},"last":2.044},{"interface":"front","average":{"1min":3.2469999999999999,"5min":10.907999999999999,"15min":7.7530000000000001},"min":{"1min":2.4300000000000002,"5min":2.097,"15min":0.80600000000000005},"max":{"1min":4.2679999999999998,"5min":791.87900000000002,"15min":791.87900000000002},"last":4.4989999999999997}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":3.625,"5min":3.927,"15min":5.3949999999999996},"min":{"1min":2.984,"5min":2.4849999999999999,"15min":2.4849999999999999},"max":{"1min":4.7210000000000001,"5min":6.2460000000000004,"15min":504.67899999999997},"last":4.7210000000000001},{"interface":"front","average":{"1min":3.6789999999999998,"5min":4.0149999999999997,"15min":5.6100000000000003},"min":{"1min":2.948,"5min":2.7360000000000002,"15min":2.7360000000000002},"max":{"1min":4.8799999999999999,"5min":6.3330000000000002,"15min":504.77300000000002},"last":4.8799999999999999}]}]},{"osd":6,"up_from":221,"seq":949187772519,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1052856,"kb_used_data":4272,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93318984,"statfs":{"total":96636764160,"available":95558639616,"internally_reserved":1073741824,"allocated":4374528,"data_stored":2859761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4746,"internal_metadata":1073737078},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":2.262,"15min":2.605},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":3.359,"5min":4.3710000000000004,"15min":114.23699999999999},"last":2.641},{"interface":"front","average":{"1min":23.812000000000001,"5min":9.2200000000000006,"15min":4.5650000000000004},"min":{"1min":1.5720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"max":{"1min":447.74700000000001,"5min":447.74700000000001,"15min":447.74700000000001},"last":2.9830000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.4079999999999999,"5min":9.5619999999999994,"15min":4.9370000000000003},"min":{"1min":1.8320000000000001,"5min":1.738,"15min":1.5469999999999999},"max":{"1min":3.633,"5min":718.55799999999999,"15min":718.55799999999999},"last":1.992},{"interface":"front","average":{"1min":2.2210000000000001,"5min":3.9390000000000001,"15min":2.9870000000000001},"min":{"1min":1.6180000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":3.2280000000000002,"5min":149.46799999999999,"15min":149.46799999999999},"last":2.4620000000000002}]},{"osd":2,"last update":"Sat Nov 21 01:57:33 2020","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":5.1630000000000003,"15min":3.5510000000000002},"min":{"1min":1.804,"5min":1.494,"15min":1.494},"max":{"1min":3.7330000000000001,"5min":236.29900000000001,"15min":236.29900000000001},"last":2.0950000000000002},{"interface":"front","average":{"1min":41.996000000000002,"5min":10.558,"15min":5.3739999999999997},"min":{"1min":1.839,"5min":1.516,"15min":1.516},"max":{"1min":832.87699999999995,"5min":832.87699999999995,"15min":832.87699999999995},"last":2.3199999999999998}]},{"osd":3,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":2.9630000000000001,"15min":2.8679999999999999},"min":{"1min":1.899,"5min":1.859,"15min":1.8220000000000001},"max":{"1min":3.6930000000000001,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":2.7000000000000002},{"interface":"front","average":{"1min":2.7759999999999998,"5min":2.8130000000000002,"15min":2.9540000000000002},"min":{"1min":2.1179999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"max":{"1min":3.835,"5min":4.9169999999999998,"15min":4.9409999999999998},"last":2.8069999999999999}]},{"osd":4,"last update":"Sat Nov 21 01:57:30 2020","interfaces":[{"interface":"back","average":{"1min":2.5529999999999999,"5min":11.363,"15min":5.8449999999999998},"min":{"1min":1.931,"5min":1.6220000000000001,"15min":1.6220000000000001},"max":{"1min":3.3069999999999999,"5min":856.87599999999998,"15min":856.87599999999998},"last":1.363},{"interface":"front","average":{"1min":39.381999999999998,"5min":15.183,"15min":9.7669999999999995},"min":{"1min":2.1720000000000002,"5min":1.6970000000000001,"15min":1.6970000000000001},"max":{"1min":730.24000000000001,"5min":730.24000000000001,"15min":893.66300000000001},"last":2.9119999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":3.032,"5min":3.347,"15min":31.992999999999999},"min":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"max":{"1min":4.0289999999999999,"5min":4.8769999999999998,"15min":965.67499999999995},"last":2.0459999999999998},{"interface":"front","average":{"1min":3.242,"5min":10.368,"15min":11.821},"min":{"1min":2.2040000000000002,"5min":2.073,"15min":1.978},"max":{"1min":4.0890000000000004,"5min":603.04399999999998,"15min":946.12400000000002},"last":3.1539999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":50.793999999999997,"5min":13.048,"15min":6.7569999999999997},"min":{"1min":2.6499999999999999,"5min":2.444,"15min":2.444},"max":{"1min":1000.6799999999999,"5min":1000.6799999999999,"15min":1000.6799999999999},"last":2.5590000000000002},{"interface":"front","average":{"1min":3.4630000000000001,"5min":3.464,"15min":3.6360000000000001},"min":{"1min":2.6379999999999999,"5min":2.109,"15min":2.109},"max":{"1min":4.1539999999999999,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":3.327}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1055808,"kb_used_data":7224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93316032,"statfs":{"total":96636764160,"available":95555616768,"internally_reserved":1073741824,"allocated":7397376,"data_stored":5889551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":9.0969999999999995,"15min":7.7830000000000004},"min":{"1min":1.1359999999999999,"5min":1.101,"15min":0.432},"max":{"1min":2.5449999999999999,"5min":616.86699999999996,"15min":706.45299999999997},"last":1.885},{"interface":"front","average":{"1min":15.257999999999999,"5min":4.9610000000000003,"15min":9.9320000000000004},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.56799999999999995},"max":{"1min":276.80900000000003,"5min":276.80900000000003,"15min":677.94000000000005},"last":2.25}]},{"osd":2,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":30.193999999999999,"15min":11.397},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":0.58499999999999996},"max":{"1min":3.4630000000000001,"5min":982.75900000000001,"15min":982.75900000000001},"last":1.9419999999999999},{"interface":"front","average":{"1min":2.4199999999999999,"5min":2.9350000000000001,"15min":7.585},"min":{"1min":1.216,"5min":1.216,"15min":0.66000000000000003},"max":{"1min":4.1660000000000004,"5min":4.5119999999999996,"15min":644.53200000000004},"last":2.4649999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:25 2020","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":2.9710000000000001,"15min":2.6459999999999999},"min":{"1min":1.7629999999999999,"5min":1.4690000000000001,"15min":0.78800000000000003},"max":{"1min":3.6890000000000001,"5min":6.7229999999999999,"15min":11.039999999999999},"last":2.1520000000000001},{"interface":"front","average":{"1min":2.5990000000000002,"5min":5.6310000000000002,"15min":6.9279999999999999},"min":{"1min":1.8700000000000001,"5min":1.093,"15min":0.71099999999999997},"max":{"1min":3.9319999999999999,"5min":266.06799999999998,"15min":874.19399999999996},"last":2.5350000000000001}]},{"osd":4,"last update":"Sat Nov 21 01:56:58 2020","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":3.375,"15min":5.4790000000000001},"min":{"1min":1.724,"5min":1.724,"15min":1.0149999999999999},"max":{"1min":4.117,"5min":5.758,"15min":503.79599999999999},"last":2.4209999999999998},{"interface":"front","average":{"1min":2.867,"5min":3.355,"15min":12.294},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":0.81200000000000006},"max":{"1min":4.1660000000000004,"5min":4.7089999999999996,"15min":921.67100000000005},"last":2.589}]},{"osd":5,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":11.9,"15min":6.1130000000000004},"min":{"1min":1.413,"5min":1.413,"15min":0.75700000000000001},"max":{"1min":3.9849999999999999,"5min":825.02099999999996,"15min":825.02099999999996},"last":2.3380000000000001},{"interface":"front","average":{"1min":2.8250000000000002,"5min":3.0579999999999998,"15min":2.903},"min":{"1min":1.573,"5min":1.4239999999999999,"15min":0.97899999999999998},"max":{"1min":4.0350000000000001,"5min":5.8789999999999996,"15min":41.399999999999999},"last":2.6280000000000001}]},{"osd":6,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":57.990000000000002,"5min":14.18,"15min":6.6859999999999999},"min":{"1min":2.5169999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"max":{"1min":543.01700000000005,"5min":543.01700000000005,"15min":543.01700000000005},"last":3.4340000000000002},{"interface":"front","average":{"1min":30.597999999999999,"5min":19.466999999999999,"15min":9.2479999999999993},"min":{"1min":2.3980000000000001,"5min":1.6659999999999999,"15min":1.6659999999999999},"max":{"1min":603.42200000000003,"5min":603.42200000000003,"15min":603.42200000000003},"last":173.56899999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":3.0350000000000001,"5min":11.760999999999999,"15min":6.6390000000000002},"min":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":1.008},"max":{"1min":3.996,"5min":819.81200000000001,"15min":819.81200000000001},"last":2.673},{"interface":"front","average":{"1min":3.3130000000000002,"5min":8.6189999999999998,"15min":7.4299999999999997},"min":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":0.94799999999999995},"max":{"1min":4.0330000000000004,"5min":511.72800000000001,"15min":659.43100000000004},"last":3.1320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1054756,"kb_used_data":6172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93317084,"statfs":{"total":96636764160,"available":95556694016,"internally_reserved":1073741824,"allocated":6320128,"data_stored":4813443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":8.3879999999999999,"15min":4.0549999999999997},"min":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":0.66700000000000004},"max":{"1min":3.8220000000000001,"5min":358.28899999999999,"15min":358.28899999999999},"last":2.4390000000000001},{"interface":"front","average":{"1min":2.6120000000000001,"5min":8.5660000000000007,"15min":4.6230000000000002},"min":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":0.68200000000000005},"max":{"1min":3.8730000000000002,"5min":605.75599999999997,"15min":605.75599999999997},"last":2.5139999999999998}]},{"osd":2,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":7.7549999999999999,"15min":6.8250000000000002},"min":{"1min":1.5700000000000001,"5min":1.379,"15min":0.745},"max":{"1min":3.4300000000000002,"5min":630.73199999999997,"15min":630.73199999999997},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.7880000000000003,"5min":3.601,"15min":7.6429999999999998},"min":{"1min":1.714,"5min":1.6839999999999999,"15min":0.76700000000000002},"max":{"1min":44.380000000000003,"5min":44.380000000000003,"15min":666.09299999999996},"last":1.5269999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:24 2020","interfaces":[{"interface":"back","average":{"1min":2.476,"5min":11.656000000000001,"15min":11.058},"min":{"1min":1.7010000000000001,"5min":0.81200000000000006,"15min":0.75900000000000001},"max":{"1min":3.3650000000000002,"5min":856.28300000000002,"15min":863.24900000000002},"last":2.4769999999999999},{"interface":"front","average":{"1min":3.2480000000000002,"5min":10.92,"15min":5.2859999999999996},"min":{"1min":2.1099999999999999,"5min":1.5049999999999999,"15min":0.56699999999999995},"max":{"1min":4.3689999999999998,"5min":843.16800000000001,"15min":843.16800000000001},"last":2.726}]},{"osd":4,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":10.308999999999999,"15min":5.1589999999999998},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.01},"max":{"1min":3.6680000000000001,"5min":582.78499999999997,"15min":582.78499999999997},"last":2.5739999999999998},{"interface":"front","average":{"1min":2.6440000000000001,"5min":3.202,"15min":2.879},"min":{"1min":1.353,"5min":1.353,"15min":0.84499999999999997},"max":{"1min":3.7730000000000001,"5min":5.6589999999999998,"15min":18.436},"last":3.1429999999999998}]},{"osd":5,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":17.994,"5min":9.7539999999999996,"15min":8.3599999999999994},"min":{"1min":1.26,"5min":1.26,"15min":0.85799999999999998},"max":{"1min":291.95100000000002,"5min":291.95100000000002,"15min":440.05900000000003},"last":3.2000000000000002},{"interface":"front","average":{"1min":2.948,"5min":7.3259999999999996,"15min":4.1189999999999998},"min":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":0.77900000000000003},"max":{"1min":4.3230000000000004,"5min":487.197,"15min":487.197},"last":2.6309999999999998}]},{"osd":6,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":10.468,"15min":10.647},"min":{"1min":1.8149999999999999,"5min":1.5940000000000001,"15min":1.538},"max":{"1min":4.5460000000000003,"5min":838.65700000000004,"15min":838.65700000000004},"last":3.242},{"interface":"front","average":{"1min":3.7810000000000001,"5min":3.5939999999999999,"15min":6.4880000000000004},"min":{"1min":2.8780000000000001,"5min":1.722,"15min":1.722},"max":{"1min":4.8159999999999998,"5min":5.7830000000000004,"15min":505.416},"last":2.6800000000000002}]},{"osd":7,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.504,"5min":2.7149999999999999,"15min":3.371},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":0.93500000000000005},"max":{"1min":3.504,"5min":4.2069999999999999,"15min":143.36500000000001},"last":2.1800000000000002},{"interface":"front","average":{"1min":6.0060000000000002,"5min":14.949999999999999,"15min":7.1509999999999998},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.2769999999999999},"max":{"1min":58.357999999999997,"5min":536.05999999999995,"15min":536.05999999999995},"last":3.423}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056080,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315760,"statfs":{"total":96636764160,"available":95555338240,"internally_reserved":1073741824,"allocated":7675904,"data_stored":6170596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":2.2610000000000001,"5min":12.776,"15min":11.308},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.55000000000000004},"max":{"1min":3.1459999999999999,"5min":962.596,"15min":962.596},"last":2.0600000000000001},{"interface":"front","average":{"1min":35.854999999999997,"5min":30.399999999999999,"15min":13.113},"min":{"1min":1.21,"5min":1.21,"15min":0.627},"max":{"1min":684.34799999999996,"5min":838.06299999999999,"15min":838.06299999999999},"last":1.974}]},{"osd":1,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":18.277999999999999,"5min":12.526,"15min":8.0730000000000004},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.66800000000000004},"max":{"1min":318.74400000000003,"5min":505.46699999999998,"15min":909.34000000000003},"last":2.23},{"interface":"front","average":{"1min":2.653,"5min":11.750999999999999,"15min":5.3399999999999999},"min":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":0.81000000000000005},"max":{"1min":3.367,"5min":505.87799999999999,"15min":505.87799999999999},"last":2.3450000000000002}]},{"osd":3,"last update":"Sat Nov 21 01:57:19 2020","interfaces":[{"interface":"back","average":{"1min":2.456,"5min":3.0379999999999998,"15min":2.4830000000000001},"min":{"1min":1.7989999999999999,"5min":1.403,"15min":0.66600000000000004},"max":{"1min":3.653,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":2.1349999999999998},{"interface":"front","average":{"1min":2.601,"5min":7.1600000000000001,"15min":12.487},"min":{"1min":1.8640000000000001,"5min":1.476,"15min":0.81999999999999995},"max":{"1min":3.8039999999999998,"5min":395.85399999999998,"15min":998.50900000000001},"last":2.2690000000000001}]},{"osd":4,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":2.6859999999999999,"5min":3.1099999999999999,"15min":4.9180000000000001},"min":{"1min":1.427,"5min":1.427,"15min":0.83399999999999996},"max":{"1min":4.0119999999999996,"5min":5.1289999999999996,"15min":503.00799999999998},"last":3.7709999999999999},{"interface":"front","average":{"1min":3.0150000000000001,"5min":3.6659999999999999,"15min":10.271000000000001},"min":{"1min":1.9970000000000001,"5min":1.9630000000000001,"15min":0.88},"max":{"1min":3.8650000000000002,"5min":7.7069999999999999,"15min":532.94000000000005},"last":3.8759999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:56:54 2020","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":16.928999999999998,"15min":9.0150000000000006},"min":{"1min":1.843,"5min":1.843,"15min":0.82599999999999996},"max":{"1min":3.6779999999999999,"5min":503.97500000000002,"15min":503.97500000000002},"last":3.9430000000000001},{"interface":"front","average":{"1min":2.7509999999999999,"5min":12.058,"15min":10.577},"min":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.002},"max":{"1min":3.742,"5min":832.74400000000003,"15min":846.91800000000001},"last":3.3119999999999998}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":3.1179999999999999,"5min":8.718,"15min":5.9109999999999996},"min":{"1min":2.3180000000000001,"5min":1.8,"15min":1.46},"max":{"1min":3.9199999999999999,"5min":540.46500000000003,"15min":540.46500000000003},"last":3.8050000000000002},{"interface":"front","average":{"1min":3.141,"5min":12.093,"15min":7.8090000000000002},"min":{"1min":2.2130000000000001,"5min":2.21,"15min":1.885},"max":{"1min":4.7889999999999997,"5min":956.26999999999998,"15min":956.26999999999998},"last":2.9969999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":13.583,"15min":14.641},"min":{"1min":2.5529999999999999,"5min":2.3849999999999998,"15min":1.024},"max":{"1min":4.3319999999999999,"5min":817.15499999999997,"15min":884.05799999999999},"last":4.516},{"interface":"front","average":{"1min":3.286,"5min":13.715999999999999,"15min":6.6319999999999997},"min":{"1min":2.4350000000000001,"5min":2.4060000000000001,"15min":1.222},"max":{"1min":4.2880000000000003,"5min":794.65300000000002,"15min":794.65300000000002},"last":4.4480000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1054020,"kb_used_data":5436,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":93317820,"statfs":{"total":96636764160,"available":95557447680,"internally_reserved":1073741824,"allocated":5566464,"data_stored":4057102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8283,"internal_metadata":1073733541},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":2.6389999999999998,"5min":2.415,"15min":3.5590000000000002},"min":{"1min":1.8360000000000001,"5min":1.2270000000000001,"15min":0.51300000000000001},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":409.524},"last":2.819},{"interface":"front","average":{"1min":2.786,"5min":2.5470000000000002,"15min":9.0559999999999992},"min":{"1min":1.958,"5min":1.274,"15min":0.57299999999999995},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":819.28899999999999},"last":2.9529999999999998}]},{"osd":1,"last update":"Sat Nov 21 01:57:15 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":11.744,"15min":12.388},"min":{"1min":1.4930000000000001,"5min":1.1180000000000001,"15min":0.63},"max":{"1min":3.1019999999999999,"5min":889.19299999999998,"15min":889.19299999999998},"last":2.0760000000000001},{"interface":"front","average":{"1min":10.907999999999999,"5min":4.6059999999999999,"15min":7.1790000000000003},"min":{"1min":1.2490000000000001,"5min":0.85099999999999998,"15min":0.57699999999999996},"max":{"1min":180.934,"5min":180.934,"15min":715.11300000000006},"last":2.109}]},{"osd":2,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":25.577000000000002,"5min":19.806999999999999,"15min":8.0739999999999998},"min":{"1min":1.804,"5min":1.196,"15min":0.72699999999999998},"max":{"1min":513.471,"5min":663.274,"15min":663.274},"last":3.2210000000000001},{"interface":"front","average":{"1min":2.8140000000000001,"5min":13.693,"15min":5.944},"min":{"1min":1.411,"5min":1.411,"15min":0.78700000000000003},"max":{"1min":4.492,"5min":959.93799999999999,"15min":959.93799999999999},"last":3.024}]},{"osd":4,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":46.642000000000003,"5min":11.228999999999999,"15min":7.5069999999999997},"min":{"1min":1.8109999999999999,"5min":1.4079999999999999,"15min":0.76800000000000002},"max":{"1min":973.91499999999996,"5min":973.91499999999996,"15min":973.91499999999996},"last":2.4780000000000002},{"interface":"front","average":{"1min":2.7650000000000001,"5min":9.4930000000000003,"15min":4.8380000000000001},"min":{"1min":1.8500000000000001,"5min":1.542,"15min":0.81599999999999995},"max":{"1min":4.0030000000000001,"5min":500.58100000000002,"15min":500.58100000000002},"last":2.2589999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":3.04,"5min":5.7800000000000002,"15min":9.2769999999999992},"min":{"1min":1.9299999999999999,"5min":1.6220000000000001,"15min":0.95799999999999996},"max":{"1min":4.0910000000000002,"5min":222.786,"15min":916.59299999999996},"last":3.0609999999999999},{"interface":"front","average":{"1min":3.1869999999999998,"5min":5.2370000000000001,"15min":3.6019999999999999},"min":{"1min":2.3959999999999999,"5min":2.2010000000000001,"15min":0.98899999999999999},"max":{"1min":4.2210000000000001,"5min":156.923,"15min":156.923},"last":3.1080000000000001}]},{"osd":6,"last update":"Sat Nov 21 01:57:29 2020","interfaces":[{"interface":"back","average":{"1min":3.2919999999999998,"5min":7.827,"15min":4.8920000000000003},"min":{"1min":2.391,"5min":1.837,"15min":1.6539999999999999},"max":{"1min":4.9379999999999997,"5min":504.084,"15min":504.084},"last":739.15800000000002},{"interface":"front","average":{"1min":3.3839999999999999,"5min":10.037000000000001,"15min":5.3570000000000002},"min":{"1min":2.2999999999999998,"5min":1.8819999999999999,"15min":1.8819999999999999},"max":{"1min":4.9779999999999998,"5min":504.26600000000002,"15min":504.26600000000002},"last":3.2650000000000001}]},{"osd":7,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":2.8570000000000002,"5min":2.6930000000000001,"15min":5.8550000000000004},"min":{"1min":2.2400000000000002,"5min":1.73,"15min":0.96999999999999997},"max":{"1min":4.1900000000000004,"5min":4.1900000000000004,"15min":503.988},"last":2.8700000000000001},{"interface":"front","average":{"1min":3.339,"5min":9.3759999999999994,"15min":7.1280000000000001},"min":{"1min":2.5779999999999998,"5min":1.9279999999999999,"15min":1.113},"max":{"1min":3.9830000000000001,"5min":516.32899999999995,"15min":516.32899999999995},"last":3.1699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056128,"kb_used_data":6472,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315712,"statfs":{"total":96636764160,"available":95555289088,"internally_reserved":1073741824,"allocated":6627328,"data_stored":5123134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":3.0630000000000002,"5min":16.297999999999998,"15min":8.9179999999999993},"min":{"1min":1.698,"5min":1.2370000000000001,"15min":0.64100000000000001},"max":{"1min":4.4429999999999996,"5min":916.29999999999995,"15min":916.29999999999995},"last":1.5269999999999999},{"interface":"front","average":{"1min":3.3239999999999998,"5min":2.8959999999999999,"15min":11.291},"min":{"1min":2.1280000000000001,"5min":1.526,"15min":0.75700000000000001},"max":{"1min":4.5730000000000004,"5min":4.7320000000000002,"15min":767.30399999999997},"last":2.2450000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":8.4600000000000009,"5min":3.7269999999999999,"15min":4.6539999999999999},"min":{"1min":1.458,"5min":1.458,"15min":0.624},"max":{"1min":138.65600000000001,"5min":138.65600000000001,"15min":504.04599999999999},"last":3.298},{"interface":"front","average":{"1min":2.819,"5min":8.0690000000000008,"15min":6.1840000000000002},"min":{"1min":1.7270000000000001,"5min":1.6930000000000001,"15min":0.78300000000000003},"max":{"1min":4.2889999999999997,"5min":461.66300000000001,"15min":554.63400000000001},"last":3.056}]},{"osd":2,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.7120000000000002,"15min":7.6619999999999999},"min":{"1min":1.7470000000000001,"5min":1.647,"15min":0.74199999999999999},"max":{"1min":3.5099999999999998,"5min":4.2409999999999997,"15min":778.90099999999995},"last":1.613},{"interface":"front","average":{"1min":3.3420000000000001,"5min":3.1680000000000001,"15min":3.4500000000000002},"min":{"1min":1.746,"5min":1.746,"15min":0.85099999999999998},"max":{"1min":4.641,"5min":4.7939999999999996,"15min":152.31399999999999},"last":3.1259999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":8.468,"5min":4.0129999999999999,"15min":5.6299999999999999},"min":{"1min":2.0569999999999999,"5min":1.5680000000000001,"15min":0.76100000000000001},"max":{"1min":118.27800000000001,"5min":118.27800000000001,"15min":729.13999999999999},"last":3.1840000000000002},{"interface":"front","average":{"1min":2.7759999999999998,"5min":3.992,"15min":7.5700000000000003},"min":{"1min":1.8400000000000001,"5min":1.5600000000000001,"15min":0.89000000000000001},"max":{"1min":3.9550000000000001,"5min":89.834999999999994,"15min":488.00200000000001},"last":3.2519999999999998}]},{"osd":5,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":2.9849999999999999,"15min":4.9100000000000001},"min":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":0.98699999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":694.28700000000003},"last":3.3959999999999999},{"interface":"front","average":{"1min":3.7309999999999999,"5min":11.435,"15min":10.186999999999999},"min":{"1min":1.851,"5min":1.851,"15min":0.83599999999999997},"max":{"1min":5.6459999999999999,"5min":756.149,"15min":863.53899999999999},"last":3.0169999999999999}]},{"osd":6,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.8959999999999999,"5min":2.9790000000000001,"15min":3.5070000000000001},"min":{"1min":2.0219999999999998,"5min":1.9530000000000001,"15min":1.903},"max":{"1min":3.6680000000000001,"5min":4.3010000000000002,"15min":87.953999999999994},"last":2.4329999999999998},{"interface":"front","average":{"1min":3.448,"5min":3.7450000000000001,"15min":3.5470000000000002},"min":{"1min":2.7679999999999998,"5min":2.5590000000000002,"15min":2.218},"max":{"1min":4.2779999999999996,"5min":6.0259999999999998,"15min":10.332000000000001},"last":3.3570000000000002}]},{"osd":7,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":3.2519999999999998,"5min":3.2850000000000001,"15min":4.1920000000000002},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":1.046},"max":{"1min":4.3099999999999996,"5min":4.9260000000000002,"15min":370.06999999999999},"last":2.0070000000000001},{"interface":"front","average":{"1min":11.036,"5min":4.8630000000000004,"15min":5.4720000000000004},"min":{"1min":2.472,"5min":2.3010000000000002,"15min":1.0760000000000001},"max":{"1min":180.90000000000001,"5min":180.90000000000001,"15min":250.59200000000001},"last":3.4820000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056532,"kb_used_data":7948,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315308,"statfs":{"total":96636764160,"available":95554875392,"internally_reserved":1073741824,"allocated":8138752,"data_stored":6614360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:54 2020","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":13.654999999999999,"15min":12.284000000000001},"min":{"1min":1.591,"5min":1.3560000000000001,"15min":0.69699999999999995},"max":{"1min":3.8239999999999998,"5min":503.875,"15min":837.21299999999997},"last":1.659},{"interface":"front","average":{"1min":2.2930000000000001,"5min":19.245999999999999,"15min":10.851000000000001},"min":{"1min":1.7390000000000001,"5min":1.347,"15min":0.59199999999999997},"max":{"1min":2.9550000000000001,"5min":909.01099999999997,"15min":909.01099999999997},"last":2.4630000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:56:44 2020","interfaces":[{"interface":"back","average":{"1min":2.605,"5min":3.0219999999999998,"15min":5.0220000000000002},"min":{"1min":1.405,"5min":1.405,"15min":0.88},"max":{"1min":3.6669999999999998,"5min":5.9749999999999996,"15min":614.09100000000001},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.8769999999999998,"5min":3.0950000000000002,"15min":2.8250000000000002},"min":{"1min":2.0030000000000001,"5min":1.4910000000000001,"15min":1.046},"max":{"1min":3.714,"5min":6.0250000000000004,"15min":10.260999999999999},"last":2.0779999999999998}]},{"osd":2,"last update":"Sat Nov 21 01:56:45 2020","interfaces":[{"interface":"back","average":{"1min":53.997,"5min":13.462,"15min":6.2039999999999997},"min":{"1min":2.2389999999999999,"5min":1.6439999999999999,"15min":0.76600000000000001},"max":{"1min":945.43200000000002,"5min":945.43200000000002,"15min":945.43200000000002},"last":2.1320000000000001},{"interface":"front","average":{"1min":2.9220000000000002,"5min":3.9180000000000001,"15min":4.9720000000000004},"min":{"1min":1.8129999999999999,"5min":1.4119999999999999,"15min":0.70599999999999996},"max":{"1min":4.1580000000000004,"5min":109.07299999999999,"15min":250.98699999999999},"last":1.7689999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:15 2020","interfaces":[{"interface":"back","average":{"1min":3.0979999999999999,"5min":11.407,"15min":10.769},"min":{"1min":2.1429999999999998,"5min":2.0539999999999998,"15min":0.93700000000000006},"max":{"1min":4.1870000000000003,"5min":644.36800000000005,"15min":904.99900000000002},"last":2.7629999999999999},{"interface":"front","average":{"1min":3.1779999999999999,"5min":11.866,"15min":7.7140000000000004},"min":{"1min":2.226,"5min":2.226,"15min":0.876},"max":{"1min":4.1139999999999999,"5min":606.54700000000003,"15min":606.54700000000003},"last":2.2349999999999999}]},{"osd":4,"last update":"Sat Nov 21 01:56:44 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":2.9790000000000001,"15min":3.3769999999999998},"min":{"1min":2.2189999999999999,"5min":1.601,"15min":0.97899999999999998},"max":{"1min":4.2859999999999996,"5min":4.8339999999999996,"15min":99.460999999999999},"last":2.4039999999999999},{"interface":"front","average":{"1min":2.4550000000000001,"5min":9.4819999999999993,"15min":9.0380000000000003},"min":{"1min":1.988,"5min":1.423,"15min":0.78300000000000003},"max":{"1min":3.165,"5min":504.702,"15min":996.00300000000004},"last":3.0209999999999999}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":2.8919999999999999,"5min":9.9299999999999997,"15min":5.3129999999999997},"min":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":1.825},"max":{"1min":3.3370000000000002,"5min":665.43399999999997,"15min":665.43399999999997},"last":2.548},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.8719999999999999,"15min":2.8279999999999998},"min":{"1min":2.0720000000000001,"5min":1.8620000000000001,"15min":1.8320000000000001},"max":{"1min":3.3380000000000001,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":2.8799999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:52 2020","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":3.9660000000000002,"15min":8.8460000000000001},"min":{"1min":2.8220000000000001,"5min":2.379,"15min":0.73099999999999998},"max":{"1min":5.1079999999999997,"5min":6.7999999999999998,"15min":713.923},"last":2.823},{"interface":"front","average":{"1min":3.7999999999999998,"5min":11.068,"15min":9.0869999999999997},"min":{"1min":2.8599999999999999,"5min":2.766,"15min":0.85899999999999999},"max":{"1min":5.1580000000000004,"5min":471.07400000000001,"15min":520.44500000000005},"last":2.9380000000000002}]}]}]}}
, 2020-11-21T01:57:42.073 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:57:42.073 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: instructing pg 2.4s0 on osd.5 to deep-scrub
, 2020-11-21T01:58:10.939 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed.
, 2020-11-21T01:58:30.941 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json

Ignoring malparsed backtrace: 2020-11-21T01:59:33.038 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:59:33.038 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-21 01:43:35.218295 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=43, tm_sec=35, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:59:33.039 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T02:00:18.649 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.0
, instructing pg 2.0s0 on osd.3 to deep-scrub
, 2020-11-21T02:00:19.003 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.2

Ignoring malparsed backtrace: 2020-11-21T02:01:23.814 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T02:01:23.814 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T02:01:23.815 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2020-11-21 01:46:15.310508 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T02:02:26.228 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.c
, instructing pg 2.cs0 on osd.6 to deep-scrub
, 2020-11-21T02:02:26.575 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b

Ignoring malparsed backtrace: 2020-11-21T02:03:34.465 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json
, dumped all
, 2020-11-21T02:03:34.891 INFO:teuthology.orchestra.run.smithi018.stdout:

Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_nautilus-testing-162/qa/tasks/rados.py", line 260, in thread
,     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait

Ignoring malparsed backtrace: 2020-11-21T02:04:19.436 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.ifJG5wR5oD is 1MB
, 2020-11-21T02:04:19.504 INFO:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.ifJG5wR5oD
, 2020-11-21T02:04:19.512 INFO:tasks.ceph:Cleaning ceph cluster...

Ignoring malparsed backtrace: 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:==============================================================================
, 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 216.240.36.24    3 u    4   64  377    0.075   -2.292   0.370
, 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:*hv02.front.sepi 163.237.218.18   2 u    6   64  377    0.074   -2.202   0.360

Ignoring malparsed backtrace:  ceph version 14.2.11-113-g5c0b894435 (5c0b894435c8a34e4ce6446e264581811994cca3) nautilus (stable)
,  1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string<char, std::char_traits<char>, std::allocator<char> > const&)+0xdf) [0x7fe4bc08f59c]
,  2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x5eb) [0x423adb]

Ignoring malparsed backtrace: 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:11.499929",
, 2020-11-21T01:49:09.291 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.311 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.312 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:35.306506",

Ignoring malparsed backtrace: 2020-11-21T01:49:09.331 INFO:teuthology.orchestra.run.smithi059.stdout:                    "client_addr": "172.21.15.18:0/3425446096",
, 2020-11-21T01:49:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:                    "tid": 5662
, 2020-11-21T01:49:09.332 INFO:teuthology.orchestra.run.smithi059.stdout:                },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.257616",
, 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "started"
, 2020-11-21T01:49:09.352 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "commit_sent"
, 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.372 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.391 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.392 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.392 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.244887",

Ignoring malparsed backtrace: 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:01.173631",
, 2020-11-21T01:49:09.412 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "commit_sent"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:00.265179",
, 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"
, 2020-11-21T01:49:09.432 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:09.452 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"
, 2020-11-21T01:49:09.453 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.453 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:45:44.827457",
, 2020-11-21T01:49:09.473 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.493 INFO:teuthology.orchestra.run.smithi059.stdout:            }
, 2020-11-21T01:49:09.493 INFO:teuthology.orchestra.run.smithi059.stdout:        },
, 2020-11-21T01:49:09.494 INFO:teuthology.orchestra.run.smithi059.stdout:        {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "queued_for_pg"
, 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.514 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:46:03.096418",
, 2020-11-21T01:49:09.535 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"

Ignoring malparsed backtrace: 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "sub_op_committed"
, 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:09.996 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.017 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:32.306018",
, 2020-11-21T01:49:10.018 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "sub_op_started"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.038 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:32.297480",
, 2020-11-21T01:49:10.038 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "header_read"
, 2020-11-21T01:49:10.039 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.060 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.061 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:43:49.577772",
, 2020-11-21T01:49:10.061 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "throttled"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "initiated_at": "2020-11-21 01:44:09.765184",
, 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "age": 300.21945402799997,
, 2020-11-21T01:49:10.082 INFO:teuthology.orchestra.run.smithi059.stdout:            "duration": 1.0039103819999999,

Ignoring malparsed backtrace: 2020-11-21T01:49:10.103 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"
, 2020-11-21T01:49:10.104 INFO:teuthology.orchestra.run.smithi059.stdout:                    },
, 2020-11-21T01:49:10.104 INFO:teuthology.orchestra.run.smithi059.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:44:09.844709",
, 2020-11-21T01:49:10.124 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "reached_pg"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:46:43.935210",
, 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                        "event": "all_read"
, 2020-11-21T01:49:10.145 INFO:teuthology.orchestra.run.smithi059.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.165 INFO:teuthology.orchestra.run.smithi059.stdout:        },
, 2020-11-21T01:49:10.166 INFO:teuthology.orchestra.run.smithi059.stdout:        {
, 2020-11-21T01:49:10.166 INFO:teuthology.orchestra.run.smithi059.stdout:            "description": "osd_op(client.4353.0:9502 2.1s0 2:805fb934:::smithi01816282-13:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected e149)",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:                ]
, 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:            }
, 2020-11-21T01:49:10.187 INFO:teuthology.orchestra.run.smithi059.stdout:        },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                "events": [
, 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                    {
, 2020-11-21T01:49:10.208 INFO:teuthology.orchestra.run.smithi059.stdout:                        "time": "2020-11-21 01:47:56.729375",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:44:54.345299",
, 2020-11-21T01:49:10.587 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "started"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:44:54.335963",
, 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"
, 2020-11-21T01:49:10.609 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                "events": [
, 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.634 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:20.445942",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:20.446277",
, 2020-11-21T01:49:10.655 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "waiting for peered"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "initiated_at": "2020-11-21 01:45:20.563415",
, 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "age": 230.0142993,
, 2020-11-21T01:49:10.677 INFO:teuthology.orchestra.run.smithi018.stdout:            "duration": 0.86483692599999995,

Ignoring malparsed backtrace: 2020-11-21T01:49:10.697 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "dispatched"
, 2020-11-21T01:49:10.697 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.698 INFO:teuthology.orchestra.run.smithi018.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.719 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:45:21.540535",

Ignoring malparsed backtrace: 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:46:04.939266",
, 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "started"
, 2020-11-21T01:49:10.740 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"
, 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.762 INFO:teuthology.orchestra.run.smithi018.stdout:                    {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.783 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.783 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:46:04.947451",
, 2020-11-21T01:49:10.784 INFO:teuthology.orchestra.run.smithi018.stdout:                        "event": "initiated"

Ignoring malparsed backtrace: 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:            }
, 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:        },
, 2020-11-21T01:49:10.806 INFO:teuthology.orchestra.run.smithi018.stdout:        {

Ignoring malparsed backtrace: 2020-11-21T01:49:10.826 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:10.827 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:10.827 INFO:teuthology.orchestra.run.smithi018.stdout:                        "time": "2020-11-21 01:48:00.734910",

Ignoring malparsed backtrace: command deprecated
, 2020-11-21T01:49:27.933 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd reweight 6 1
, reweighted osd.6 to 1 (10000)

Ignoring malparsed backtrace: 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:                "osdmap-prune",
, 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:                "nautilus"
, 2020-11-21T01:49:36.358 INFO:teuthology.orchestra.run.smithi018.stdout:            ],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:    "mgrmap": {
, 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:        "epoch": 3,
, 2020-11-21T01:49:36.380 INFO:teuthology.orchestra.run.smithi018.stdout:        "active_gid": 4108,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.406 INFO:teuthology.orchestra.run.smithi018.stdout:                            "smtp_port": {
, 2020-11-21T01:49:36.406 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "smtp_port",
, 2020-11-21T01:49:36.407 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.426 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.427 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []

Ignoring malparsed backtrace: 2020-11-21T01:49:36.447 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "0.001",
, 2020-11-21T01:49:36.447 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "0.999",
, 2020-11-21T01:49:36.448 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "5",
, 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "1",
, 2020-11-21T01:49:36.467 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.487 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.506 INFO:teuthology.orchestra.run.smithi018.stdout:                            },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                            "REST_REQUESTS_TIMEOUT": {
, 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "REST_REQUESTS_TIMEOUT",
, 2020-11-21T01:49:36.526 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "level": "advanced",
, 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "flags": 0,
, 2020-11-21T01:49:36.546 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "True",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.565 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.565 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",
, 2020-11-21T01:49:36.566 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",
, 2020-11-21T01:49:36.585 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "automatically mark OSD if it may fail before this long",
, 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.604 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "",
, 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.624 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.643 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.644 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],
, 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.663 INFO:teuthology.orchestra.run.smithi018.stdout:                            },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.682 INFO:teuthology.orchestra.run.smithi018.stdout:                            "username": {
, 2020-11-21T01:49:36.682 INFO:teuthology.orchestra.run.smithi018.stdout:                                "name": "username",
, 2020-11-21T01:49:36.683 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "str",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                            },
, 2020-11-21T01:49:36.702 INFO:teuthology.orchestra.run.smithi018.stdout:                            "prefix": {

Ignoring malparsed backtrace: 2020-11-21T01:49:36.721 INFO:teuthology.orchestra.run.smithi018.stdout:                                "enum_allowed": [],
, 2020-11-21T01:49:36.721 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "how frequently to persist completed events",
, 2020-11-21T01:49:36.722 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "can_run": true,
, 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "error_string": "",
, 2020-11-21T01:49:36.741 INFO:teuthology.orchestra.run.smithi018.stdout:                        "module_options": {}

Ignoring malparsed backtrace: 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "desc": "",
, 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "long_desc": "",
, 2020-11-21T01:49:36.760 INFO:teuthology.orchestra.run.smithi018.stdout:                                "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                                "see_also": []
, 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                            },
, 2020-11-21T01:49:36.780 INFO:teuthology.orchestra.run.smithi018.stdout:                            "testnewline": {

Ignoring malparsed backtrace: 2020-11-21T01:49:36.799 INFO:teuthology.orchestra.run.smithi018.stdout:                                "type": "bool",
, 2020-11-21T01:49:36.799 INFO:teuthology.orchestra.run.smithi018.stdout:                                "level": "advanced",
, 2020-11-21T01:49:36.800 INFO:teuthology.orchestra.run.smithi018.stdout:                                "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "default_value": "False",
, 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "min": "",
, 2020-11-21T01:49:36.819 INFO:teuthology.orchestra.run.smithi018.stdout:                                "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                    {
, 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "volumes",
, 2020-11-21T01:49:36.840 INFO:teuthology.orchestra.run.smithi018.stdout:                        "can_run": true,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "60",
, 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.859 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "Use SSL to connect to SMTP server",
, 2020-11-21T01:49:36.879 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.898 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:36.898 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:36.899 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                    "min_score": {
, 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "min_score",
, 2020-11-21T01:49:36.918 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "float",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.937 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.937 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",
, 2020-11-21T01:49:36.938 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:36.956 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "bool",
, 2020-11-21T01:49:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:36.957 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "",
, 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:36.976 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",
, 2020-11-21T01:49:36.996 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.015 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:37.016 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                    "ssl_server_port": {
, 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "ssl_server_port",
, 2020-11-21T01:49:37.035 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "int",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.054 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",
, 2020-11-21T01:49:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:                        "enum_allowed": [],
, 2020-11-21T01:49:37.055 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 1,
, 2020-11-21T01:49:37.074 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "86400",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                    "diskprediction_port": {
, 2020-11-21T01:49:37.094 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "diskprediction_port",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:                        "type": "str",
, 2020-11-21T01:49:37.113 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.114 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,

Ignoring malparsed backtrace: 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "30",
, 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "min": "",
, 2020-11-21T01:49:37.133 INFO:teuthology.orchestra.run.smithi018.stdout:                        "max": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.152 INFO:teuthology.orchestra.run.smithi018.stdout:            {
, 2020-11-21T01:49:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:                "name": "iostat",
, 2020-11-21T01:49:37.153 INFO:teuthology.orchestra.run.smithi018.stdout:                "can_run": true,

Ignoring malparsed backtrace: 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                "module_options": {
, 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                    "orchestrator": {
, 2020-11-21T01:49:37.172 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "orchestrator",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "desc": "",
, 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",
, 2020-11-21T01:49:37.192 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],

Ignoring malparsed backtrace: 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                    "server_port": {
, 2020-11-21T01:49:37.211 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "server_port",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "level": "advanced",
, 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "flags": 0,
, 2020-11-21T01:49:37.231 INFO:teuthology.orchestra.run.smithi018.stdout:                        "default_value": "",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.250 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.250 INFO:teuthology.orchestra.run.smithi018.stdout:                    "ssh_config_file": {
, 2020-11-21T01:49:37.251 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "ssh_config_file",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "long_desc": "",
, 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.270 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []

Ignoring malparsed backtrace: 2020-11-21T01:49:37.289 INFO:teuthology.orchestra.run.smithi018.stdout:                    },
, 2020-11-21T01:49:37.289 INFO:teuthology.orchestra.run.smithi018.stdout:                    "leaderboard": {
, 2020-11-21T01:49:37.290 INFO:teuthology.orchestra.run.smithi018.stdout:                        "name": "leaderboard",

Ignoring malparsed backtrace: 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                        "tags": [],
, 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                        "see_also": []
, 2020-11-21T01:49:37.309 INFO:teuthology.orchestra.run.smithi018.stdout:                    },

Ignoring malparsed backtrace: Set osd_debug_deep_scrub_sleep to 0
, 2020-11-21T01:49:41.868 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph osd deep-scrub 3
, instructed osd(s) 3 to deep-scrub

Ignoring malparsed backtrace: 2020-11-21T01:50:25.617 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:50:25.617 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:50:25.618 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2020-11-21 01:46:15.310508 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:51:28.158 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.c
, instructing pg 2.cs0 on osd.6 to deep-scrub
, 2020-11-21T01:51:28.506 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b

Ignoring malparsed backtrace: 2020-11-21T01:52:37.520 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json
, 2020-11-21T01:52:37.956 INFO:teuthology.orchestra.run.smithi018.stdout:
, dumped all

Ignoring malparsed backtrace: 2020-11-21T01:53:39.356 INFO:tasks.ceph:pgid 1.4 last_scrub_stamp 2020-11-21 01:45:59.251426 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=45, tm_sec=59, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:53:39.356 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:53:39.357 INFO:tasks.ceph:pgid 1.3 last_scrub_stamp 2020-11-21 01:46:01.028764 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=1, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:54:29.240 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:54:29.241 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:54:29.241 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:55:30.645 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:55:30.646 INFO:tasks.ceph:pgid 1.6 last_scrub_stamp 2020-11-21 01:45:15.118160 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=45, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:55:30.646 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:56:20.265 INFO:tasks.ceph:pgid 1.2 last_scrub_stamp 2020-11-21 01:46:15.622973 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:56:20.266 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:56:20.266 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T01:57:42.070 INFO:teuthology.orchestra.run.smithi018.stdout:{"pg_ready":true,"pg_map":{"version":693,"stamp":"2020-11-21 01:57:40.423329","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":9694619,"num_objects":9,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4863,"num_read_kb":2628,"num_write":11063,"num_write_kb":3124134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":120576433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14547,"ondisk_log_size":14547,"up":112,"acting":112,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":112,"num_osds":8,"num_per_pool_osds":8,"kb":754974720,"kb_used":8442452,"kb_used_data":51636,"kb_used_omap":12,"kb_used_meta":8388595,"kb_avail":746532268,"statfs":{"total":773094113280,"available":764449042432,"internally_reserved":8589934592,"allocated":52875264,"data_stored":40791016,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":13029,"internal_metadata":8589921563},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004262"},"pg_stats":[{"pgid":"2.f","version":"218'704","reported_seq":"1316","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.579539","last_change":"2020-11-21 01:48:23.138350","last_active":"2020-11-21 01:49:27.579539","last_peered":"2020-11-21 01:49:27.579539","last_clean":"2020-11-21 01:49:27.579539","last_became_active":"2020-11-21 01:48:23.137013","last_became_peered":"2020-11-21 01:48:23.137013","last_unstale":"2020-11-21 01:49:27.579539","last_undegraded":"2020-11-21 01:49:27.579539","last_fullsized":"2020-11-21 01:49:27.579539","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":704,"ondisk_log_size":704,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2646456,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":228,"num_read_kb":122,"num_write":533,"num_write_kb":161328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":5301007,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,1,4,3],"acting":[0,5,2,1,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.e","version":"218'740","reported_seq":"1328","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802871","last_change":"2020-11-21 01:47:36.346751","last_active":"2020-11-21 01:49:27.802871","last_peered":"2020-11-21 01:49:27.802871","last_clean":"2020-11-21 01:49:27.802871","last_became_active":"2020-11-21 01:47:36.345399","last_became_peered":"2020-11-21 01:47:36.345399","last_unstale":"2020-11-21 01:49:27.802871","last_undegraded":"2020-11-21 01:49:27.802871","last_fullsized":"2020-11-21 01:49:27.802871","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":740,"ondisk_log_size":740,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":246,"num_read_kb":134,"num_write":563,"num_write_kb":153923,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":2507015,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,7,1,2,0],"acting":[4,5,7,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.d","version":"218'1407","reported_seq":"2251","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.804338","last_change":"2020-11-21 01:49:21.461898","last_active":"2020-11-21 01:49:27.804338","last_peered":"2020-11-21 01:49:27.804338","last_clean":"2020-11-21 01:49:27.804338","last_became_active":"2020-11-21 01:49:21.459434","last_became_peered":"2020-11-21 01:49:21.459434","last_unstale":"2020-11-21 01:49:27.804338","last_undegraded":"2020-11-21 01:49:27.804338","last_fullsized":"2020-11-21 01:49:27.804338","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1407,"ondisk_log_size":1407,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4805509,"num_objects":2,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":482,"num_read_kb":262,"num_write":1091,"num_write_kb":308491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":10228125,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,7,3,2,6],"acting":[5,1,7,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.c","version":"218'2049","reported_seq":"3023","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.531234","last_change":"2020-11-21 01:49:21.445018","last_active":"2020-11-21 01:49:27.531234","last_peered":"2020-11-21 01:49:27.531234","last_clean":"2020-11-21 01:49:27.531234","last_became_active":"2020-11-21 01:49:21.441526","last_became_peered":"2020-11-21 01:49:21.441526","last_unstale":"2020-11-21 01:49:27.531234","last_undegraded":"2020-11-21 01:49:27.531234","last_fullsized":"2020-11-21 01:49:27.531234","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":2049,"ondisk_log_size":2049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":56000,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":695,"num_read_kb":386,"num_write":1567,"num_write_kb":447186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":20898718,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5,7,3,1],"acting":[6,0,5,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"218'676","reported_seq":"1253","reported_epoch":"231","state":"active+clean+scrubbing","last_fresh":"2020-11-21 01:49:27.799483","last_change":"2020-11-21 01:49:11.430911","last_active":"2020-11-21 01:49:27.799483","last_peered":"2020-11-21 01:49:27.799483","last_clean":"2020-11-21 01:49:27.799483","last_became_active":"2020-11-21 01:47:42.443530","last_became_peered":"2020-11-21 01:47:42.443530","last_unstale":"2020-11-21 01:49:27.799483","last_undegraded":"2020-11-21 01:49:27.799483","last_fullsized":"2020-11-21 01:49:27.799483","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":676,"ondisk_log_size":676,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":210,"num_read_kb":119,"num_write":495,"num_write_kb":141622,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":6890404,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,5,1,0,4],"acting":[3,2,5,1,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":"432","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.530837","last_change":"2020-11-21 01:49:21.439481","last_active":"2020-11-21 01:49:27.530837","last_peered":"2020-11-21 01:49:27.530837","last_clean":"2020-11-21 01:49:27.530837","last_became_active":"2020-11-21 01:49:21.436946","last_became_peered":"2020-11-21 01:49:21.436946","last_unstale":"2020-11-21 01:49:27.530837","last_undegraded":"2020-11-21 01:49:27.530837","last_fullsized":"2020-11-21 01:49:27.530837","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,0,3,2,4],"acting":[6,5,0,3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.9","version":"218'1492","reported_seq":"2411","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802592","last_change":"2020-11-21 01:49:21.440824","last_active":"2020-11-21 01:49:27.802592","last_peered":"2020-11-21 01:49:27.802592","last_clean":"2020-11-21 01:49:27.802592","last_became_active":"2020-11-21 01:49:21.437802","last_became_peered":"2020-11-21 01:49:21.437802","last_unstale":"2020-11-21 01:49:27.802592","last_undegraded":"2020-11-21 01:49:27.802592","last_fullsized":"2020-11-21 01:49:27.802592","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1492,"ondisk_log_size":1492,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":72807,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":491,"num_read_kb":255,"num_write":1110,"num_write_kb":302366,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":26,"num_bytes_recovered":13025087,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,0,6,5,3],"acting":[4,7,0,6,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"218'1473","reported_seq":"2309","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.578953","last_change":"2020-11-21 01:47:42.447558","last_active":"2020-11-21 01:49:27.578953","last_peered":"2020-11-21 01:49:27.578953","last_clean":"2020-11-21 01:49:27.578953","last_became_active":"2020-11-21 01:47:42.445405","last_became_peered":"2020-11-21 01:47:42.445405","last_unstale":"2020-11-21 01:49:27.578953","last_undegraded":"2020-11-21 01:49:27.578953","last_fullsized":"2020-11-21 01:49:27.578953","mapping_epoch":179,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":180,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1473,"ondisk_log_size":1473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":425754,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":509,"num_read_kb":263,"num_write":1135,"num_write_kb":325611,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26507271,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,7,5,4,3],"acting":[0,2,7,5,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"1.5","version":"0'0","reported_seq":"252","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.532554","last_change":"2020-11-21 01:49:18.495622","last_active":"2020-11-21 01:49:27.532554","last_peered":"2020-11-21 01:49:27.532554","last_clean":"2020-11-21 01:49:27.532554","last_became_active":"2020-11-21 01:49:18.494721","last_became_peered":"2020-11-21 01:49:18.494721","last_unstale":"2020-11-21 01:49:27.532554","last_undegraded":"2020-11-21 01:49:27.532554","last_fullsized":"2020-11-21 01:49:27.532554","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:43:35.218295","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:43:35.218295","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"564","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802891","last_change":"2020-11-21 01:49:21.435350","last_active":"2020-11-21 01:49:27.802891","last_peered":"2020-11-21 01:49:27.802891","last_clean":"2020-11-21 01:49:27.802891","last_became_active":"2020-11-21 01:49:21.433370","last_became_peered":"2020-11-21 01:49:21.433370","last_unstale":"2020-11-21 01:49:27.802891","last_undegraded":"2020-11-21 01:49:27.802891","last_fullsized":"2020-11-21 01:49:27.802891","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6,7,5,3],"acting":[4,0,6,7,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"1.4","version":"0'0","reported_seq":"154","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.533217","last_change":"2020-11-21 01:45:59.251495","last_active":"2020-11-21 01:49:27.533217","last_peered":"2020-11-21 01:49:27.533217","last_clean":"2020-11-21 01:49:27.533217","last_became_active":"2020-11-21 01:45:59.194369","last_became_peered":"2020-11-21 01:45:59.194369","last_unstale":"2020-11-21 01:49:27.533217","last_undegraded":"2020-11-21 01:49:27.533217","last_fullsized":"2020-11-21 01:49:27.533217","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:45:59.251426","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:45:59.251426","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"476","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799676","last_change":"2020-11-21 01:49:21.447000","last_active":"2020-11-21 01:49:27.799676","last_peered":"2020-11-21 01:49:27.799676","last_clean":"2020-11-21 01:49:27.799676","last_became_active":"2020-11-21 01:49:21.443761","last_became_peered":"2020-11-21 01:49:21.443761","last_unstale":"2020-11-21 01:49:27.799676","last_undegraded":"2020-11-21 01:49:27.799676","last_fullsized":"2020-11-21 01:49:27.799676","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6,5,2,1],"acting":[3,0,6,5,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.3","version":"0'0","reported_seq":"227","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.802892","last_change":"2020-11-21 01:46:01.028877","last_active":"2020-11-21 01:49:27.802892","last_peered":"2020-11-21 01:49:27.802892","last_clean":"2020-11-21 01:49:27.802892","last_became_active":"2020-11-21 01:42:26.196186","last_became_peered":"2020-11-21 01:42:26.196186","last_unstale":"2020-11-21 01:49:27.802892","last_undegraded":"2020-11-21 01:49:27.802892","last_fullsized":"2020-11-21 01:49:27.802892","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:01.028764","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:01.028764","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"218'1418","reported_seq":"2127","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799283","last_change":"2020-11-21 01:49:21.450011","last_active":"2020-11-21 01:49:27.799283","last_peered":"2020-11-21 01:49:27.799283","last_clean":"2020-11-21 01:49:27.799283","last_became_active":"2020-11-21 01:49:21.447333","last_became_peered":"2020-11-21 01:49:21.447333","last_unstale":"2020-11-21 01:49:27.799283","last_undegraded":"2020-11-21 01:49:27.799283","last_fullsized":"2020-11-21 01:49:27.799283","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1418,"ondisk_log_size":1418,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":717052,"num_objects":2,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":455,"num_read_kb":245,"num_write":1050,"num_write_kb":293922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":7786358,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6,4,7,2],"acting":[3,5,6,4,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.2","version":"0'0","reported_seq":"122","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.579055","last_change":"2020-11-21 01:46:15.623092","last_active":"2020-11-21 01:49:27.579055","last_peered":"2020-11-21 01:49:27.579055","last_clean":"2020-11-21 01:49:27.579055","last_became_active":"2020-11-21 01:45:59.201470","last_became_peered":"2020-11-21 01:45:59.201470","last_unstale":"2020-11-21 01:49:27.579055","last_undegraded":"2020-11-21 01:49:27.579055","last_fullsized":"2020-11-21 01:49:27.579055","mapping_epoch":120,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":121,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:15.622973","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:15.622973","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"218'1454","reported_seq":"2134","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.533066","last_change":"2020-11-21 01:49:07.494863","last_active":"2020-11-21 01:49:27.533066","last_peered":"2020-11-21 01:49:27.533066","last_clean":"2020-11-21 01:49:27.533066","last_became_active":"2020-11-21 01:47:36.349048","last_became_peered":"2020-11-21 01:47:36.349048","last_unstale":"2020-11-21 01:49:27.533066","last_undegraded":"2020-11-21 01:49:27.533066","last_fullsized":"2020-11-21 01:49:27.533066","mapping_epoch":173,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1454,"ondisk_log_size":1454,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":341719,"num_objects":1,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":473,"num_read_kb":260,"num_write":1090,"num_write_kb":307978,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":8725372,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4,2,1,0],"acting":[7,5,4,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"243","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.798586","last_change":"2020-11-21 01:47:33.321369","last_active":"2020-11-21 01:49:27.798586","last_peered":"2020-11-21 01:49:27.798586","last_clean":"2020-11-21 01:49:27.798586","last_became_active":"2020-11-21 01:47:33.320616","last_became_peered":"2020-11-21 01:47:33.320616","last_unstale":"2020-11-21 01:49:27.798586","last_undegraded":"2020-11-21 01:49:27.798586","last_fullsized":"2020-11-21 01:49:27.798586","mapping_epoch":170,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":171,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:16.763583","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:16.763583","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"406","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799530","last_change":"2020-11-21 01:49:21.445247","last_active":"2020-11-21 01:49:27.799530","last_peered":"2020-11-21 01:49:27.799530","last_clean":"2020-11-21 01:49:27.799530","last_became_active":"2020-11-21 01:49:21.443350","last_became_peered":"2020-11-21 01:49:21.443350","last_unstale":"2020-11-21 01:49:27.799530","last_undegraded":"2020-11-21 01:49:27.799530","last_fullsized":"2020-11-21 01:49:27.799530","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4,1,6,5],"acting":[3,2,4,1,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.1","version":"0'0","reported_seq":"77","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799321","last_change":"2020-11-21 01:49:18.499430","last_active":"2020-11-21 01:49:27.799321","last_peered":"2020-11-21 01:49:27.799321","last_clean":"2020-11-21 01:49:27.799321","last_became_active":"2020-11-21 01:49:18.492869","last_became_peered":"2020-11-21 01:49:18.492869","last_unstale":"2020-11-21 01:49:27.799321","last_undegraded":"2020-11-21 01:49:27.799321","last_fullsized":"2020-11-21 01:49:27.799321","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:46:15.310508","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:46:15.310508","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.2","version":"218'1541","reported_seq":"2368","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799593","last_change":"2020-11-21 01:49:21.446334","last_active":"2020-11-21 01:49:27.799593","last_peered":"2020-11-21 01:49:27.799593","last_clean":"2020-11-21 01:49:27.799593","last_became_active":"2020-11-21 01:49:21.443330","last_became_peered":"2020-11-21 01:49:21.443330","last_unstale":"2020-11-21 01:49:27.799593","last_undegraded":"2020-11-21 01:49:27.799593","last_fullsized":"2020-11-21 01:49:27.799593","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1541,"ondisk_log_size":1541,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":629322,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":524,"num_read_kb":287,"num_write":1198,"num_write_kb":331555,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":14772258,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1,7,4,5],"acting":[3,6,1,7,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.6","version":"0'0","reported_seq":"77","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799637","last_change":"2020-11-21 01:49:18.494641","last_active":"2020-11-21 01:49:27.799637","last_peered":"2020-11-21 01:49:27.799637","last_clean":"2020-11-21 01:49:27.799637","last_became_active":"2020-11-21 01:49:18.492628","last_became_peered":"2020-11-21 01:49:18.492628","last_unstale":"2020-11-21 01:49:27.799637","last_undegraded":"2020-11-21 01:49:27.799637","last_fullsized":"2020-11-21 01:49:27.799637","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:45:15.118160","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:25.168535","last_clean_scrub_stamp":"2020-11-21 01:45:15.118160","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"490","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.799796","last_change":"2020-11-21 01:49:21.449358","last_active":"2020-11-21 01:49:27.799796","last_peered":"2020-11-21 01:49:27.799796","last_clean":"2020-11-21 01:49:27.799796","last_became_active":"2020-11-21 01:49:21.442547","last_became_peered":"2020-11-21 01:49:21.442547","last_unstale":"2020-11-21 01:49:27.799796","last_undegraded":"2020-11-21 01:49:27.799796","last_fullsized":"2020-11-21 01:49:27.799796","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4,6,0,5,7],"acting":[3,4,6,0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.7","version":"0'0","reported_seq":"58","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.798799","last_change":"2020-11-21 01:49:18.489979","last_active":"2020-11-21 01:49:27.798799","last_peered":"2020-11-21 01:49:27.798799","last_clean":"2020-11-21 01:49:27.798799","last_became_active":"2020-11-21 01:49:18.489348","last_became_peered":"2020-11-21 01:49:18.489348","last_unstale":"2020-11-21 01:49:27.798799","last_undegraded":"2020-11-21 01:49:27.798799","last_fullsized":"2020-11-21 01:49:27.798799","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:43:37.944445","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:43:37.944445","last_clean_scrub_stamp":"2020-11-21 01:43:37.944445","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.4","version":"218'1593","reported_seq":"2310","reported_epoch":"231","state":"active+clean","last_fresh":"2020-11-21 01:49:27.803509","last_change":"2020-11-21 01:49:21.450622","last_active":"2020-11-21 01:49:27.803509","last_peered":"2020-11-21 01:49:27.803509","last_clean":"2020-11-21 01:49:27.803509","last_became_active":"2020-11-21 01:49:21.448205","last_became_peered":"2020-11-21 01:49:21.448205","last_unstale":"2020-11-21 01:49:27.803509","last_undegraded":"2020-11-21 01:49:27.803509","last_fullsized":"2020-11-21 01:49:27.803509","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2020-11-21 01:42:42.806772","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2020-11-21 01:42:42.806772","last_clean_scrub_stamp":"2020-11-21 01:42:42.806772","log_size":1593,"ondisk_log_size":1593,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":550,"num_read_kb":295,"num_write":1231,"num_write_kb":350152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":3934818,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2,7,4,1],"acting":[5,6,2,7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":16,"stat_sum":{"num_bytes":9694619,"num_objects":9,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":4863,"num_read_kb":2628,"num_write":11063,"num_write_kb":3124134,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":161,"num_bytes_recovered":120576433,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":30396416,"data_stored":30316440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":14547,"ondisk_log_size":14547,"up":96,"acting":96,"num_store_stats":8},{"poolid":1,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575036,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056272,"kb_used_data":6616,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315568,"statfs":{"total":96636764160,"available":95555141632,"internally_reserved":1073741824,"allocated":6774784,"data_stored":5263069,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":1.4470000000000001,"5min":2.1869999999999998,"15min":2.7029999999999998},"min":{"1min":0.99299999999999999,"5min":0.99299999999999999,"15min":0.505},"max":{"1min":2.0409999999999999,"5min":5.2649999999999997,"15min":176.50299999999999},"last":2.6509999999999998},{"interface":"front","average":{"1min":45.786000000000001,"5min":18.466000000000001,"15min":12.922000000000001},"min":{"1min":1.4890000000000001,"5min":1.407,"15min":0.93999999999999995},"max":{"1min":874.53499999999997,"5min":874.53499999999997,"15min":874.53499999999997},"last":4.6159999999999997}]},{"osd":1,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.8759999999999999,"15min":13.609},"min":{"1min":1.6599999999999999,"5min":1.6499999999999999,"15min":0.68799999999999994},"max":{"1min":3.4870000000000001,"5min":5.5549999999999997,"15min":959.54899999999998},"last":2},{"interface":"front","average":{"1min":2.7330000000000001,"5min":11.808,"15min":8.2910000000000004},"min":{"1min":1.7789999999999999,"5min":1.7789999999999999,"15min":0.61499999999999999},"max":{"1min":3.5329999999999999,"5min":960.101,"15min":960.101},"last":2.1920000000000002}]},{"osd":2,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.3029999999999999,"5min":6.5430000000000001,"15min":9.577},"min":{"1min":1.405,"5min":1.405,"15min":0.72499999999999998},"max":{"1min":2.7469999999999999,"5min":503.74000000000001,"15min":593.19299999999998},"last":2.1070000000000002},{"interface":"front","average":{"1min":2.9239999999999999,"5min":13.635,"15min":8.0709999999999997},"min":{"1min":1.669,"5min":1.669,"15min":0.76500000000000001},"max":{"1min":3.5920000000000001,"5min":503.89499999999998,"15min":504.392},"last":2.593}]},{"osd":3,"last update":"Sat Nov 21 01:57:33 2020","interfaces":[{"interface":"back","average":{"1min":2.5,"5min":8.7430000000000003,"15min":6.375},"min":{"1min":1.4670000000000001,"5min":1.2410000000000001,"15min":0.88200000000000001},"max":{"1min":3.7349999999999999,"5min":576.24300000000005,"15min":607.37800000000004},"last":1.9490000000000001},{"interface":"front","average":{"1min":2.9209999999999998,"5min":10.885999999999999,"15min":10.068},"min":{"1min":2.2879999999999998,"5min":1.746,"15min":1.0549999999999999},"max":{"1min":4.0999999999999996,"5min":503.45699999999999,"15min":707.11599999999999},"last":4.3090000000000002}]},{"osd":4,"last update":"Sat Nov 21 01:56:59 2020","interfaces":[{"interface":"back","average":{"1min":2.605,"5min":3.2730000000000001,"15min":3.044},"min":{"1min":1.883,"5min":1.825,"15min":0.98999999999999999},"max":{"1min":4.1779999999999999,"5min":5.0460000000000003,"15min":29.231999999999999},"last":4.4260000000000002},{"interface":"front","average":{"1min":3.1579999999999999,"5min":3.5760000000000001,"15min":4.7549999999999999},"min":{"1min":2.327,"5min":2.1389999999999998,"15min":0.82799999999999996},"max":{"1min":4.3049999999999997,"5min":5.1609999999999996,"15min":559.48500000000001},"last":4.7960000000000003}]},{"osd":5,"last update":"Sat Nov 21 01:56:53 2020","interfaces":[{"interface":"back","average":{"1min":2.8719999999999999,"5min":10.624000000000001,"15min":9.1129999999999995},"min":{"1min":2.2040000000000002,"5min":1.456,"15min":0.77900000000000003},"max":{"1min":3.661,"5min":805.25800000000004,"15min":805.25800000000004},"last":2.044},{"interface":"front","average":{"1min":3.2469999999999999,"5min":10.907999999999999,"15min":7.7530000000000001},"min":{"1min":2.4300000000000002,"5min":2.097,"15min":0.80600000000000005},"max":{"1min":4.2679999999999998,"5min":791.87900000000002,"15min":791.87900000000002},"last":4.4989999999999997}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":3.625,"5min":3.927,"15min":5.3949999999999996},"min":{"1min":2.984,"5min":2.4849999999999999,"15min":2.4849999999999999},"max":{"1min":4.7210000000000001,"5min":6.2460000000000004,"15min":504.67899999999997},"last":4.7210000000000001},{"interface":"front","average":{"1min":3.6789999999999998,"5min":4.0149999999999997,"15min":5.6100000000000003},"min":{"1min":2.948,"5min":2.7360000000000002,"15min":2.7360000000000002},"max":{"1min":4.8799999999999999,"5min":6.3330000000000002,"15min":504.77300000000002},"last":4.8799999999999999}]}]},{"osd":6,"up_from":221,"seq":949187772519,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1052856,"kb_used_data":4272,"kb_used_omap":4,"kb_used_meta":1048571,"kb_avail":93318984,"statfs":{"total":96636764160,"available":95558639616,"internally_reserved":1073741824,"allocated":4374528,"data_stored":2859761,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":4746,"internal_metadata":1073737078},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":1.9039999999999999,"5min":2.262,"15min":2.605},"min":{"1min":1.006,"5min":1.006,"15min":1.006},"max":{"1min":3.359,"5min":4.3710000000000004,"15min":114.23699999999999},"last":2.641},{"interface":"front","average":{"1min":23.812000000000001,"5min":9.2200000000000006,"15min":4.5650000000000004},"min":{"1min":1.5720000000000001,"5min":1.3740000000000001,"15min":1.3740000000000001},"max":{"1min":447.74700000000001,"5min":447.74700000000001,"15min":447.74700000000001},"last":2.9830000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.4079999999999999,"5min":9.5619999999999994,"15min":4.9370000000000003},"min":{"1min":1.8320000000000001,"5min":1.738,"15min":1.5469999999999999},"max":{"1min":3.633,"5min":718.55799999999999,"15min":718.55799999999999},"last":1.992},{"interface":"front","average":{"1min":2.2210000000000001,"5min":3.9390000000000001,"15min":2.9870000000000001},"min":{"1min":1.6180000000000001,"5min":1.1080000000000001,"15min":1.1080000000000001},"max":{"1min":3.2280000000000002,"5min":149.46799999999999,"15min":149.46799999999999},"last":2.4620000000000002}]},{"osd":2,"last update":"Sat Nov 21 01:57:33 2020","interfaces":[{"interface":"back","average":{"1min":2.528,"5min":5.1630000000000003,"15min":3.5510000000000002},"min":{"1min":1.804,"5min":1.494,"15min":1.494},"max":{"1min":3.7330000000000001,"5min":236.29900000000001,"15min":236.29900000000001},"last":2.0950000000000002},{"interface":"front","average":{"1min":41.996000000000002,"5min":10.558,"15min":5.3739999999999997},"min":{"1min":1.839,"5min":1.516,"15min":1.516},"max":{"1min":832.87699999999995,"5min":832.87699999999995,"15min":832.87699999999995},"last":2.3199999999999998}]},{"osd":3,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.6160000000000001,"5min":2.9630000000000001,"15min":2.8679999999999999},"min":{"1min":1.899,"5min":1.859,"15min":1.8220000000000001},"max":{"1min":3.6930000000000001,"5min":4.8310000000000004,"15min":4.8310000000000004},"last":2.7000000000000002},{"interface":"front","average":{"1min":2.7759999999999998,"5min":2.8130000000000002,"15min":2.9540000000000002},"min":{"1min":2.1179999999999999,"5min":1.7509999999999999,"15min":1.7509999999999999},"max":{"1min":3.835,"5min":4.9169999999999998,"15min":4.9409999999999998},"last":2.8069999999999999}]},{"osd":4,"last update":"Sat Nov 21 01:57:30 2020","interfaces":[{"interface":"back","average":{"1min":2.5529999999999999,"5min":11.363,"15min":5.8449999999999998},"min":{"1min":1.931,"5min":1.6220000000000001,"15min":1.6220000000000001},"max":{"1min":3.3069999999999999,"5min":856.87599999999998,"15min":856.87599999999998},"last":1.363},{"interface":"front","average":{"1min":39.381999999999998,"5min":15.183,"15min":9.7669999999999995},"min":{"1min":2.1720000000000002,"5min":1.6970000000000001,"15min":1.6970000000000001},"max":{"1min":730.24000000000001,"5min":730.24000000000001,"15min":893.66300000000001},"last":2.9119999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":3.032,"5min":3.347,"15min":31.992999999999999},"min":{"1min":2.1120000000000001,"5min":2.1120000000000001,"15min":2.1120000000000001},"max":{"1min":4.0289999999999999,"5min":4.8769999999999998,"15min":965.67499999999995},"last":2.0459999999999998},{"interface":"front","average":{"1min":3.242,"5min":10.368,"15min":11.821},"min":{"1min":2.2040000000000002,"5min":2.073,"15min":1.978},"max":{"1min":4.0890000000000004,"5min":603.04399999999998,"15min":946.12400000000002},"last":3.1539999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":50.793999999999997,"5min":13.048,"15min":6.7569999999999997},"min":{"1min":2.6499999999999999,"5min":2.444,"15min":2.444},"max":{"1min":1000.6799999999999,"5min":1000.6799999999999,"15min":1000.6799999999999},"last":2.5590000000000002},{"interface":"front","average":{"1min":3.4630000000000001,"5min":3.464,"15min":3.6360000000000001},"min":{"1min":2.6379999999999999,"5min":2.109,"15min":2.109},"max":{"1min":4.1539999999999999,"5min":4.9989999999999997,"15min":4.9989999999999997},"last":3.327}]}]},{"osd":1,"up_from":13,"seq":55834575035,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1055808,"kb_used_data":7224,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93316032,"statfs":{"total":96636764160,"available":95555616768,"internally_reserved":1073741824,"allocated":7397376,"data_stored":5889551,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":1.829,"5min":9.0969999999999995,"15min":7.7830000000000004},"min":{"1min":1.1359999999999999,"5min":1.101,"15min":0.432},"max":{"1min":2.5449999999999999,"5min":616.86699999999996,"15min":706.45299999999997},"last":1.885},{"interface":"front","average":{"1min":15.257999999999999,"5min":4.9610000000000003,"15min":9.9320000000000004},"min":{"1min":0.77600000000000002,"5min":0.77600000000000002,"15min":0.56799999999999995},"max":{"1min":276.80900000000003,"5min":276.80900000000003,"15min":677.94000000000005},"last":2.25}]},{"osd":2,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":2.274,"5min":30.193999999999999,"15min":11.397},"min":{"1min":1.1899999999999999,"5min":1.1899999999999999,"15min":0.58499999999999996},"max":{"1min":3.4630000000000001,"5min":982.75900000000001,"15min":982.75900000000001},"last":1.9419999999999999},{"interface":"front","average":{"1min":2.4199999999999999,"5min":2.9350000000000001,"15min":7.585},"min":{"1min":1.216,"5min":1.216,"15min":0.66000000000000003},"max":{"1min":4.1660000000000004,"5min":4.5119999999999996,"15min":644.53200000000004},"last":2.4649999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:25 2020","interfaces":[{"interface":"back","average":{"1min":2.4860000000000002,"5min":2.9710000000000001,"15min":2.6459999999999999},"min":{"1min":1.7629999999999999,"5min":1.4690000000000001,"15min":0.78800000000000003},"max":{"1min":3.6890000000000001,"5min":6.7229999999999999,"15min":11.039999999999999},"last":2.1520000000000001},{"interface":"front","average":{"1min":2.5990000000000002,"5min":5.6310000000000002,"15min":6.9279999999999999},"min":{"1min":1.8700000000000001,"5min":1.093,"15min":0.71099999999999997},"max":{"1min":3.9319999999999999,"5min":266.06799999999998,"15min":874.19399999999996},"last":2.5350000000000001}]},{"osd":4,"last update":"Sat Nov 21 01:56:58 2020","interfaces":[{"interface":"back","average":{"1min":2.863,"5min":3.375,"15min":5.4790000000000001},"min":{"1min":1.724,"5min":1.724,"15min":1.0149999999999999},"max":{"1min":4.117,"5min":5.758,"15min":503.79599999999999},"last":2.4209999999999998},{"interface":"front","average":{"1min":2.867,"5min":3.355,"15min":12.294},"min":{"1min":1.1140000000000001,"5min":1.1140000000000001,"15min":0.81200000000000006},"max":{"1min":4.1660000000000004,"5min":4.7089999999999996,"15min":921.67100000000005},"last":2.589}]},{"osd":5,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":2.6600000000000001,"5min":11.9,"15min":6.1130000000000004},"min":{"1min":1.413,"5min":1.413,"15min":0.75700000000000001},"max":{"1min":3.9849999999999999,"5min":825.02099999999996,"15min":825.02099999999996},"last":2.3380000000000001},{"interface":"front","average":{"1min":2.8250000000000002,"5min":3.0579999999999998,"15min":2.903},"min":{"1min":1.573,"5min":1.4239999999999999,"15min":0.97899999999999998},"max":{"1min":4.0350000000000001,"5min":5.8789999999999996,"15min":41.399999999999999},"last":2.6280000000000001}]},{"osd":6,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":57.990000000000002,"5min":14.18,"15min":6.6859999999999999},"min":{"1min":2.5169999999999999,"5min":1.4730000000000001,"15min":1.4730000000000001},"max":{"1min":543.01700000000005,"5min":543.01700000000005,"15min":543.01700000000005},"last":3.4340000000000002},{"interface":"front","average":{"1min":30.597999999999999,"5min":19.466999999999999,"15min":9.2479999999999993},"min":{"1min":2.3980000000000001,"5min":1.6659999999999999,"15min":1.6659999999999999},"max":{"1min":603.42200000000003,"5min":603.42200000000003,"15min":603.42200000000003},"last":173.56899999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:46 2020","interfaces":[{"interface":"back","average":{"1min":3.0350000000000001,"5min":11.760999999999999,"15min":6.6390000000000002},"min":{"1min":2.0209999999999999,"5min":2.0209999999999999,"15min":1.008},"max":{"1min":3.996,"5min":819.81200000000001,"15min":819.81200000000001},"last":2.673},{"interface":"front","average":{"1min":3.3130000000000002,"5min":8.6189999999999998,"15min":7.4299999999999997},"min":{"1min":1.9199999999999999,"5min":1.9199999999999999,"15min":0.94799999999999995},"max":{"1min":4.0330000000000004,"5min":511.72800000000001,"15min":659.43100000000004},"last":3.1320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834575034,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1054756,"kb_used_data":6172,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93317084,"statfs":{"total":96636764160,"available":95556694016,"internally_reserved":1073741824,"allocated":6320128,"data_stored":4813443,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.3889999999999998,"5min":8.3879999999999999,"15min":4.0549999999999997},"min":{"1min":1.4370000000000001,"5min":1.4370000000000001,"15min":0.66700000000000004},"max":{"1min":3.8220000000000001,"5min":358.28899999999999,"15min":358.28899999999999},"last":2.4390000000000001},{"interface":"front","average":{"1min":2.6120000000000001,"5min":8.5660000000000007,"15min":4.6230000000000002},"min":{"1min":1.4990000000000001,"5min":1.4990000000000001,"15min":0.68200000000000005},"max":{"1min":3.8730000000000002,"5min":605.75599999999997,"15min":605.75599999999997},"last":2.5139999999999998}]},{"osd":2,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.2879999999999998,"5min":7.7549999999999999,"15min":6.8250000000000002},"min":{"1min":1.5700000000000001,"5min":1.379,"15min":0.745},"max":{"1min":3.4300000000000002,"5min":630.73199999999997,"15min":630.73199999999997},"last":1.4590000000000001},{"interface":"front","average":{"1min":4.7880000000000003,"5min":3.601,"15min":7.6429999999999998},"min":{"1min":1.714,"5min":1.6839999999999999,"15min":0.76700000000000002},"max":{"1min":44.380000000000003,"5min":44.380000000000003,"15min":666.09299999999996},"last":1.5269999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:24 2020","interfaces":[{"interface":"back","average":{"1min":2.476,"5min":11.656000000000001,"15min":11.058},"min":{"1min":1.7010000000000001,"5min":0.81200000000000006,"15min":0.75900000000000001},"max":{"1min":3.3650000000000002,"5min":856.28300000000002,"15min":863.24900000000002},"last":2.4769999999999999},{"interface":"front","average":{"1min":3.2480000000000002,"5min":10.92,"15min":5.2859999999999996},"min":{"1min":2.1099999999999999,"5min":1.5049999999999999,"15min":0.56699999999999995},"max":{"1min":4.3689999999999998,"5min":843.16800000000001,"15min":843.16800000000001},"last":2.726}]},{"osd":4,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.4780000000000002,"5min":10.308999999999999,"15min":5.1589999999999998},"min":{"1min":1.1200000000000001,"5min":1.1200000000000001,"15min":1.01},"max":{"1min":3.6680000000000001,"5min":582.78499999999997,"15min":582.78499999999997},"last":2.5739999999999998},{"interface":"front","average":{"1min":2.6440000000000001,"5min":3.202,"15min":2.879},"min":{"1min":1.353,"5min":1.353,"15min":0.84499999999999997},"max":{"1min":3.7730000000000001,"5min":5.6589999999999998,"15min":18.436},"last":3.1429999999999998}]},{"osd":5,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":17.994,"5min":9.7539999999999996,"15min":8.3599999999999994},"min":{"1min":1.26,"5min":1.26,"15min":0.85799999999999998},"max":{"1min":291.95100000000002,"5min":291.95100000000002,"15min":440.05900000000003},"last":3.2000000000000002},{"interface":"front","average":{"1min":2.948,"5min":7.3259999999999996,"15min":4.1189999999999998},"min":{"1min":1.9630000000000001,"5min":1.9630000000000001,"15min":0.77900000000000003},"max":{"1min":4.3230000000000004,"5min":487.197,"15min":487.197},"last":2.6309999999999998}]},{"osd":6,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.944,"5min":10.468,"15min":10.647},"min":{"1min":1.8149999999999999,"5min":1.5940000000000001,"15min":1.538},"max":{"1min":4.5460000000000003,"5min":838.65700000000004,"15min":838.65700000000004},"last":3.242},{"interface":"front","average":{"1min":3.7810000000000001,"5min":3.5939999999999999,"15min":6.4880000000000004},"min":{"1min":2.8780000000000001,"5min":1.722,"15min":1.722},"max":{"1min":4.8159999999999998,"5min":5.7830000000000004,"15min":505.416},"last":2.6800000000000002}]},{"osd":7,"last update":"Sat Nov 21 01:56:50 2020","interfaces":[{"interface":"back","average":{"1min":2.504,"5min":2.7149999999999999,"15min":3.371},"min":{"1min":1.7889999999999999,"5min":1.7889999999999999,"15min":0.93500000000000005},"max":{"1min":3.504,"5min":4.2069999999999999,"15min":143.36500000000001},"last":2.1800000000000002},{"interface":"front","average":{"1min":6.0060000000000002,"5min":14.949999999999999,"15min":7.1509999999999998},"min":{"1min":1.5429999999999999,"5min":1.5429999999999999,"15min":1.2769999999999999},"max":{"1min":58.357999999999997,"5min":536.05999999999995,"15min":536.05999999999995},"last":3.423}]}]},{"osd":2,"up_from":13,"seq":55834575037,"num_pgs":12,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056080,"kb_used_data":7496,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315760,"statfs":{"total":96636764160,"available":95555338240,"internally_reserved":1073741824,"allocated":7675904,"data_stored":6170596,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":2.2610000000000001,"5min":12.776,"15min":11.308},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.55000000000000004},"max":{"1min":3.1459999999999999,"5min":962.596,"15min":962.596},"last":2.0600000000000001},{"interface":"front","average":{"1min":35.854999999999997,"5min":30.399999999999999,"15min":13.113},"min":{"1min":1.21,"5min":1.21,"15min":0.627},"max":{"1min":684.34799999999996,"5min":838.06299999999999,"15min":838.06299999999999},"last":1.974}]},{"osd":1,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":18.277999999999999,"5min":12.526,"15min":8.0730000000000004},"min":{"1min":0.88700000000000001,"5min":0.88700000000000001,"15min":0.66800000000000004},"max":{"1min":318.74400000000003,"5min":505.46699999999998,"15min":909.34000000000003},"last":2.23},{"interface":"front","average":{"1min":2.653,"5min":11.750999999999999,"15min":5.3399999999999999},"min":{"1min":1.4379999999999999,"5min":1.4379999999999999,"15min":0.81000000000000005},"max":{"1min":3.367,"5min":505.87799999999999,"15min":505.87799999999999},"last":2.3450000000000002}]},{"osd":3,"last update":"Sat Nov 21 01:57:19 2020","interfaces":[{"interface":"back","average":{"1min":2.456,"5min":3.0379999999999998,"15min":2.4830000000000001},"min":{"1min":1.7989999999999999,"5min":1.403,"15min":0.66600000000000004},"max":{"1min":3.653,"5min":7.1500000000000004,"15min":7.1500000000000004},"last":2.1349999999999998},{"interface":"front","average":{"1min":2.601,"5min":7.1600000000000001,"15min":12.487},"min":{"1min":1.8640000000000001,"5min":1.476,"15min":0.81999999999999995},"max":{"1min":3.8039999999999998,"5min":395.85399999999998,"15min":998.50900000000001},"last":2.2690000000000001}]},{"osd":4,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":2.6859999999999999,"5min":3.1099999999999999,"15min":4.9180000000000001},"min":{"1min":1.427,"5min":1.427,"15min":0.83399999999999996},"max":{"1min":4.0119999999999996,"5min":5.1289999999999996,"15min":503.00799999999998},"last":3.7709999999999999},{"interface":"front","average":{"1min":3.0150000000000001,"5min":3.6659999999999999,"15min":10.271000000000001},"min":{"1min":1.9970000000000001,"5min":1.9630000000000001,"15min":0.88},"max":{"1min":3.8650000000000002,"5min":7.7069999999999999,"15min":532.94000000000005},"last":3.8759999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:56:54 2020","interfaces":[{"interface":"back","average":{"1min":2.8530000000000002,"5min":16.928999999999998,"15min":9.0150000000000006},"min":{"1min":1.843,"5min":1.843,"15min":0.82599999999999996},"max":{"1min":3.6779999999999999,"5min":503.97500000000002,"15min":503.97500000000002},"last":3.9430000000000001},{"interface":"front","average":{"1min":2.7509999999999999,"5min":12.058,"15min":10.577},"min":{"1min":1.9830000000000001,"5min":1.9830000000000001,"15min":1.002},"max":{"1min":3.742,"5min":832.74400000000003,"15min":846.91800000000001},"last":3.3119999999999998}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":3.1179999999999999,"5min":8.718,"15min":5.9109999999999996},"min":{"1min":2.3180000000000001,"5min":1.8,"15min":1.46},"max":{"1min":3.9199999999999999,"5min":540.46500000000003,"15min":540.46500000000003},"last":3.8050000000000002},{"interface":"front","average":{"1min":3.141,"5min":12.093,"15min":7.8090000000000002},"min":{"1min":2.2130000000000001,"5min":2.21,"15min":1.885},"max":{"1min":4.7889999999999997,"5min":956.26999999999998,"15min":956.26999999999998},"last":2.9969999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:57 2020","interfaces":[{"interface":"back","average":{"1min":3.3090000000000002,"5min":13.583,"15min":14.641},"min":{"1min":2.5529999999999999,"5min":2.3849999999999998,"15min":1.024},"max":{"1min":4.3319999999999999,"5min":817.15499999999997,"15min":884.05799999999999},"last":4.516},{"interface":"front","average":{"1min":3.286,"5min":13.715999999999999,"15min":6.6319999999999997},"min":{"1min":2.4350000000000001,"5min":2.4060000000000001,"15min":1.222},"max":{"1min":4.2880000000000003,"5min":794.65300000000002,"15min":794.65300000000002},"last":4.4480000000000004}]}]},{"osd":3,"up_from":26,"seq":111669149876,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1054020,"kb_used_data":5436,"kb_used_omap":8,"kb_used_meta":1048567,"kb_avail":93317820,"statfs":{"total":96636764160,"available":95557447680,"internally_reserved":1073741824,"allocated":5566464,"data_stored":4057102,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":8283,"internal_metadata":1073733541},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":2.6389999999999998,"5min":2.415,"15min":3.5590000000000002},"min":{"1min":1.8360000000000001,"5min":1.2270000000000001,"15min":0.51300000000000001},"max":{"1min":4.3940000000000001,"5min":4.3940000000000001,"15min":409.524},"last":2.819},{"interface":"front","average":{"1min":2.786,"5min":2.5470000000000002,"15min":9.0559999999999992},"min":{"1min":1.958,"5min":1.274,"15min":0.57299999999999995},"max":{"1min":4.4409999999999998,"5min":4.4409999999999998,"15min":819.28899999999999},"last":2.9529999999999998}]},{"osd":1,"last update":"Sat Nov 21 01:57:15 2020","interfaces":[{"interface":"back","average":{"1min":2.1640000000000001,"5min":11.744,"15min":12.388},"min":{"1min":1.4930000000000001,"5min":1.1180000000000001,"15min":0.63},"max":{"1min":3.1019999999999999,"5min":889.19299999999998,"15min":889.19299999999998},"last":2.0760000000000001},{"interface":"front","average":{"1min":10.907999999999999,"5min":4.6059999999999999,"15min":7.1790000000000003},"min":{"1min":1.2490000000000001,"5min":0.85099999999999998,"15min":0.57699999999999996},"max":{"1min":180.934,"5min":180.934,"15min":715.11300000000006},"last":2.109}]},{"osd":2,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":25.577000000000002,"5min":19.806999999999999,"15min":8.0739999999999998},"min":{"1min":1.804,"5min":1.196,"15min":0.72699999999999998},"max":{"1min":513.471,"5min":663.274,"15min":663.274},"last":3.2210000000000001},{"interface":"front","average":{"1min":2.8140000000000001,"5min":13.693,"15min":5.944},"min":{"1min":1.411,"5min":1.411,"15min":0.78700000000000003},"max":{"1min":4.492,"5min":959.93799999999999,"15min":959.93799999999999},"last":3.024}]},{"osd":4,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":46.642000000000003,"5min":11.228999999999999,"15min":7.5069999999999997},"min":{"1min":1.8109999999999999,"5min":1.4079999999999999,"15min":0.76800000000000002},"max":{"1min":973.91499999999996,"5min":973.91499999999996,"15min":973.91499999999996},"last":2.4780000000000002},{"interface":"front","average":{"1min":2.7650000000000001,"5min":9.4930000000000003,"15min":4.8380000000000001},"min":{"1min":1.8500000000000001,"5min":1.542,"15min":0.81599999999999995},"max":{"1min":4.0030000000000001,"5min":500.58100000000002,"15min":500.58100000000002},"last":2.2589999999999999}]},{"osd":5,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":3.04,"5min":5.7800000000000002,"15min":9.2769999999999992},"min":{"1min":1.9299999999999999,"5min":1.6220000000000001,"15min":0.95799999999999996},"max":{"1min":4.0910000000000002,"5min":222.786,"15min":916.59299999999996},"last":3.0609999999999999},{"interface":"front","average":{"1min":3.1869999999999998,"5min":5.2370000000000001,"15min":3.6019999999999999},"min":{"1min":2.3959999999999999,"5min":2.2010000000000001,"15min":0.98899999999999999},"max":{"1min":4.2210000000000001,"5min":156.923,"15min":156.923},"last":3.1080000000000001}]},{"osd":6,"last update":"Sat Nov 21 01:57:29 2020","interfaces":[{"interface":"back","average":{"1min":3.2919999999999998,"5min":7.827,"15min":4.8920000000000003},"min":{"1min":2.391,"5min":1.837,"15min":1.6539999999999999},"max":{"1min":4.9379999999999997,"5min":504.084,"15min":504.084},"last":739.15800000000002},{"interface":"front","average":{"1min":3.3839999999999999,"5min":10.037000000000001,"15min":5.3570000000000002},"min":{"1min":2.2999999999999998,"5min":1.8819999999999999,"15min":1.8819999999999999},"max":{"1min":4.9779999999999998,"5min":504.26600000000002,"15min":504.26600000000002},"last":3.2650000000000001}]},{"osd":7,"last update":"Sat Nov 21 01:57:26 2020","interfaces":[{"interface":"back","average":{"1min":2.8570000000000002,"5min":2.6930000000000001,"15min":5.8550000000000004},"min":{"1min":2.2400000000000002,"5min":1.73,"15min":0.96999999999999997},"max":{"1min":4.1900000000000004,"5min":4.1900000000000004,"15min":503.988},"last":2.8700000000000001},{"interface":"front","average":{"1min":3.339,"5min":9.3759999999999994,"15min":7.1280000000000001},"min":{"1min":2.5779999999999998,"5min":1.9279999999999999,"15min":1.113},"max":{"1min":3.9830000000000001,"5min":516.32899999999995,"15min":516.32899999999995},"last":3.1699999999999999}]}]},{"osd":4,"up_from":13,"seq":55834575036,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056128,"kb_used_data":6472,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315712,"statfs":{"total":96636764160,"available":95555289088,"internally_reserved":1073741824,"allocated":6627328,"data_stored":5123134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":3.0630000000000002,"5min":16.297999999999998,"15min":8.9179999999999993},"min":{"1min":1.698,"5min":1.2370000000000001,"15min":0.64100000000000001},"max":{"1min":4.4429999999999996,"5min":916.29999999999995,"15min":916.29999999999995},"last":1.5269999999999999},{"interface":"front","average":{"1min":3.3239999999999998,"5min":2.8959999999999999,"15min":11.291},"min":{"1min":2.1280000000000001,"5min":1.526,"15min":0.75700000000000001},"max":{"1min":4.5730000000000004,"5min":4.7320000000000002,"15min":767.30399999999997},"last":2.2450000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":8.4600000000000009,"5min":3.7269999999999999,"15min":4.6539999999999999},"min":{"1min":1.458,"5min":1.458,"15min":0.624},"max":{"1min":138.65600000000001,"5min":138.65600000000001,"15min":504.04599999999999},"last":3.298},{"interface":"front","average":{"1min":2.819,"5min":8.0690000000000008,"15min":6.1840000000000002},"min":{"1min":1.7270000000000001,"5min":1.6930000000000001,"15min":0.78300000000000003},"max":{"1min":4.2889999999999997,"5min":461.66300000000001,"15min":554.63400000000001},"last":3.056}]},{"osd":2,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":2.597,"5min":2.7120000000000002,"15min":7.6619999999999999},"min":{"1min":1.7470000000000001,"5min":1.647,"15min":0.74199999999999999},"max":{"1min":3.5099999999999998,"5min":4.2409999999999997,"15min":778.90099999999995},"last":1.613},{"interface":"front","average":{"1min":3.3420000000000001,"5min":3.1680000000000001,"15min":3.4500000000000002},"min":{"1min":1.746,"5min":1.746,"15min":0.85099999999999998},"max":{"1min":4.641,"5min":4.7939999999999996,"15min":152.31399999999999},"last":3.1259999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":8.468,"5min":4.0129999999999999,"15min":5.6299999999999999},"min":{"1min":2.0569999999999999,"5min":1.5680000000000001,"15min":0.76100000000000001},"max":{"1min":118.27800000000001,"5min":118.27800000000001,"15min":729.13999999999999},"last":3.1840000000000002},{"interface":"front","average":{"1min":2.7759999999999998,"5min":3.992,"15min":7.5700000000000003},"min":{"1min":1.8400000000000001,"5min":1.5600000000000001,"15min":0.89000000000000001},"max":{"1min":3.9550000000000001,"5min":89.834999999999994,"15min":488.00200000000001},"last":3.2519999999999998}]},{"osd":5,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":2.9649999999999999,"5min":2.9849999999999999,"15min":4.9100000000000001},"min":{"1min":1.6399999999999999,"5min":1.6399999999999999,"15min":0.98699999999999999},"max":{"1min":4.2050000000000001,"5min":4.2050000000000001,"15min":694.28700000000003},"last":3.3959999999999999},{"interface":"front","average":{"1min":3.7309999999999999,"5min":11.435,"15min":10.186999999999999},"min":{"1min":1.851,"5min":1.851,"15min":0.83599999999999997},"max":{"1min":5.6459999999999999,"5min":756.149,"15min":863.53899999999999},"last":3.0169999999999999}]},{"osd":6,"last update":"Sat Nov 21 01:57:32 2020","interfaces":[{"interface":"back","average":{"1min":2.8959999999999999,"5min":2.9790000000000001,"15min":3.5070000000000001},"min":{"1min":2.0219999999999998,"5min":1.9530000000000001,"15min":1.903},"max":{"1min":3.6680000000000001,"5min":4.3010000000000002,"15min":87.953999999999994},"last":2.4329999999999998},{"interface":"front","average":{"1min":3.448,"5min":3.7450000000000001,"15min":3.5470000000000002},"min":{"1min":2.7679999999999998,"5min":2.5590000000000002,"15min":2.218},"max":{"1min":4.2779999999999996,"5min":6.0259999999999998,"15min":10.332000000000001},"last":3.3570000000000002}]},{"osd":7,"last update":"Sat Nov 21 01:56:49 2020","interfaces":[{"interface":"back","average":{"1min":3.2519999999999998,"5min":3.2850000000000001,"15min":4.1920000000000002},"min":{"1min":2.1760000000000002,"5min":2.1760000000000002,"15min":1.046},"max":{"1min":4.3099999999999996,"5min":4.9260000000000002,"15min":370.06999999999999},"last":2.0070000000000001},{"interface":"front","average":{"1min":11.036,"5min":4.8630000000000004,"15min":5.4720000000000004},"min":{"1min":2.472,"5min":2.3010000000000002,"15min":1.0760000000000001},"max":{"1min":180.90000000000001,"5min":180.90000000000001,"15min":250.59200000000001},"last":3.4820000000000002}]}]},{"osd":5,"up_from":13,"seq":55834575036,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"kb":94371840,"kb_used":1056532,"kb_used_data":7948,"kb_used_omap":0,"kb_used_meta":1048576,"kb_avail":93315308,"statfs":{"total":96636764160,"available":95554875392,"internally_reserved":1073741824,"allocated":8138752,"data_stored":6614360,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1073741824},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Nov 21 01:56:54 2020","interfaces":[{"interface":"back","average":{"1min":2.6760000000000002,"5min":13.654999999999999,"15min":12.284000000000001},"min":{"1min":1.591,"5min":1.3560000000000001,"15min":0.69699999999999995},"max":{"1min":3.8239999999999998,"5min":503.875,"15min":837.21299999999997},"last":1.659},{"interface":"front","average":{"1min":2.2930000000000001,"5min":19.245999999999999,"15min":10.851000000000001},"min":{"1min":1.7390000000000001,"5min":1.347,"15min":0.59199999999999997},"max":{"1min":2.9550000000000001,"5min":909.01099999999997,"15min":909.01099999999997},"last":2.4630000000000001}]},{"osd":1,"last update":"Sat Nov 21 01:56:44 2020","interfaces":[{"interface":"back","average":{"1min":2.605,"5min":3.0219999999999998,"15min":5.0220000000000002},"min":{"1min":1.405,"5min":1.405,"15min":0.88},"max":{"1min":3.6669999999999998,"5min":5.9749999999999996,"15min":614.09100000000001},"last":2.0369999999999999},{"interface":"front","average":{"1min":2.8769999999999998,"5min":3.0950000000000002,"15min":2.8250000000000002},"min":{"1min":2.0030000000000001,"5min":1.4910000000000001,"15min":1.046},"max":{"1min":3.714,"5min":6.0250000000000004,"15min":10.260999999999999},"last":2.0779999999999998}]},{"osd":2,"last update":"Sat Nov 21 01:56:45 2020","interfaces":[{"interface":"back","average":{"1min":53.997,"5min":13.462,"15min":6.2039999999999997},"min":{"1min":2.2389999999999999,"5min":1.6439999999999999,"15min":0.76600000000000001},"max":{"1min":945.43200000000002,"5min":945.43200000000002,"15min":945.43200000000002},"last":2.1320000000000001},{"interface":"front","average":{"1min":2.9220000000000002,"5min":3.9180000000000001,"15min":4.9720000000000004},"min":{"1min":1.8129999999999999,"5min":1.4119999999999999,"15min":0.70599999999999996},"max":{"1min":4.1580000000000004,"5min":109.07299999999999,"15min":250.98699999999999},"last":1.7689999999999999}]},{"osd":3,"last update":"Sat Nov 21 01:57:15 2020","interfaces":[{"interface":"back","average":{"1min":3.0979999999999999,"5min":11.407,"15min":10.769},"min":{"1min":2.1429999999999998,"5min":2.0539999999999998,"15min":0.93700000000000006},"max":{"1min":4.1870000000000003,"5min":644.36800000000005,"15min":904.99900000000002},"last":2.7629999999999999},{"interface":"front","average":{"1min":3.1779999999999999,"5min":11.866,"15min":7.7140000000000004},"min":{"1min":2.226,"5min":2.226,"15min":0.876},"max":{"1min":4.1139999999999999,"5min":606.54700000000003,"15min":606.54700000000003},"last":2.2349999999999999}]},{"osd":4,"last update":"Sat Nov 21 01:56:44 2020","interfaces":[{"interface":"back","average":{"1min":3.1629999999999998,"5min":2.9790000000000001,"15min":3.3769999999999998},"min":{"1min":2.2189999999999999,"5min":1.601,"15min":0.97899999999999998},"max":{"1min":4.2859999999999996,"5min":4.8339999999999996,"15min":99.460999999999999},"last":2.4039999999999999},{"interface":"front","average":{"1min":2.4550000000000001,"5min":9.4819999999999993,"15min":9.0380000000000003},"min":{"1min":1.988,"5min":1.423,"15min":0.78300000000000003},"max":{"1min":3.165,"5min":504.702,"15min":996.00300000000004},"last":3.0209999999999999}]},{"osd":6,"last update":"Sat Nov 21 01:57:35 2020","interfaces":[{"interface":"back","average":{"1min":2.8919999999999999,"5min":9.9299999999999997,"15min":5.3129999999999997},"min":{"1min":2.2189999999999999,"5min":2.2189999999999999,"15min":1.825},"max":{"1min":3.3370000000000002,"5min":665.43399999999997,"15min":665.43399999999997},"last":2.548},{"interface":"front","average":{"1min":2.7959999999999998,"5min":2.8719999999999999,"15min":2.8279999999999998},"min":{"1min":2.0720000000000001,"5min":1.8620000000000001,"15min":1.8320000000000001},"max":{"1min":3.3380000000000001,"5min":4.4500000000000002,"15min":4.4500000000000002},"last":2.8799999999999999}]},{"osd":7,"last update":"Sat Nov 21 01:56:52 2020","interfaces":[{"interface":"back","average":{"1min":3.7010000000000001,"5min":3.9660000000000002,"15min":8.8460000000000001},"min":{"1min":2.8220000000000001,"5min":2.379,"15min":0.73099999999999998},"max":{"1min":5.1079999999999997,"5min":6.7999999999999998,"15min":713.923},"last":2.823},{"interface":"front","average":{"1min":3.7999999999999998,"5min":11.068,"15min":9.0869999999999997},"min":{"1min":2.8599999999999999,"5min":2.766,"15min":0.85899999999999999},"max":{"1min":5.1580000000000004,"5min":471.07400000000001,"15min":520.44500000000005},"last":2.9380000000000002}]}]}]}}
, 2020-11-21T01:57:42.073 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:57:42.073 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: instructing pg 2.4s0 on osd.5 to deep-scrub
, 2020-11-21T01:58:10.939 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed.
, 2020-11-21T01:58:30.941 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json

Ignoring malparsed backtrace: 2020-11-21T01:59:33.038 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:59:33.038 INFO:tasks.ceph:pgid 1.5 last_scrub_stamp 2020-11-21 01:43:35.218295 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=43, tm_sec=35, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T01:59:33.039 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T02:00:18.649 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.0
, instructing pg 2.0s0 on osd.3 to deep-scrub
, 2020-11-21T02:00:19.003 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 1.2

Ignoring malparsed backtrace: 2020-11-21T02:01:23.814 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2020-11-21 01:46:16.763583 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=16, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T02:01:23.814 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2020-11-21 01:42:42.806772 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=42, tm_sec=42, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)
, 2020-11-21T02:01:23.815 INFO:tasks.ceph:pgid 1.1 last_scrub_stamp 2020-11-21 01:46:15.310508 time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=46, tm_sec=15, tm_wday=5, tm_yday=326, tm_isdst=-1) <= time.struct_time(tm_year=2020, tm_mon=11, tm_mday=21, tm_hour=1, tm_min=49, tm_sec=38, tm_wday=5, tm_yday=326, tm_isdst=0)

Ignoring malparsed backtrace: 2020-11-21T02:02:26.228 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.c
, instructing pg 2.cs0 on osd.6 to deep-scrub
, 2020-11-21T02:02:26.575 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg deep-scrub 2.b

Ignoring malparsed backtrace: 2020-11-21T02:03:34.465 INFO:teuthology.orchestra.run.smithi018:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 900 ceph --cluster ceph pg dump --format=json
, dumped all
, 2020-11-21T02:03:34.891 INFO:teuthology.orchestra.run.smithi018.stdout:

Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_nautilus-testing-162/qa/tasks/rados.py", line 260, in thread
,     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 470, in wait

Ignoring malparsed backtrace: 2020-11-21T02:04:19.436 DEBUG:teuthology.orchestra.remote:smithi059:/tmp/tmp.ifJG5wR5oD is 1MB
, 2020-11-21T02:04:19.504 INFO:teuthology.orchestra.run.smithi059:> rm -fr /tmp/tmp.ifJG5wR5oD
, 2020-11-21T02:04:19.512 INFO:tasks.ceph:Cleaning ceph cluster...

Ignoring malparsed backtrace: 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:==============================================================================
, 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:+hv01.front.sepi 216.240.36.24    3 u    4   64  377    0.075   -2.292   0.370
, 2020-11-21T02:05:25.342 INFO:teuthology.orchestra.run.smithi059.stdout:*hv02.front.sepi 163.237.218.18   2 u    6   64  377    0.074   -2.202   0.360

Found 2 distinct failure reasons
Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --no-omap --ec-pool --max-ops 400000 --objects 20 --max-in-flight 8 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 0 --op write 0 --op delete 20 --op append 5 --op write_excl 0 --op append_excl 5 --pool unique_pool_0'
1 jobs: ['5641319']
suites: ['clusters/{fixed-2.yaml', 'fast/normal.yaml', 'msgr-failures/osd-delay.yaml', 'objectstore/bluestore-comp-zlib.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{default.yaml}', 'supported-random-distro$/{ubuntu_16.04.yaml}', 'thrashers/pggrow.yaml', 'thrashosds-health.yaml', 'workloads/ec-small-objects-many-deletes.yaml}']

Dead: b'2020-11-21T05:03:03.564 DEBUG:teuthology.exit:Finished running handlers'
1 jobs: ['5641318']
suites: ['clusters/{fixed-2.yaml', 'fast/fast.yaml', 'msgr-failures/few.yaml', 'objectstore/bluestore-comp-snappy.yaml', 'openstack.yaml}', 'rados.yaml', 'rados:thrash-erasure-code/{ceph.yaml', 'recovery-overrides/{more-partial-recovery.yaml}', 'supported-random-distro$/{centos_latest.yaml}', 'thrashers/morepggrow.yaml', 'thrashosds-health.yaml', 'workloads/ec-small-objects-fast-read.yaml}']