2021-02-25T20:48:38.854 INFO:root:teuthology version: 1.1.0-9a6b849c
2021-02-25T20:48:38.857 INFO:teuthology.results:subset: '0/999'
2021-02-25T20:48:38.858 INFO:teuthology.results:seed: '9951'
2021-02-28T04:49:29.526 INFO:root:teuthology version: 1.1.0-3082387b
2021-02-28T04:49:29.587 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish...
2021-02-28T06:27:37.901 INFO:teuthology.results:Tests finished! gathering results...
2021-02-28T06:28:08.994 INFO:scrape:Found 220 jobs
2021-02-28T06:28:09.937 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fe7aa9e379d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe7aa9e3978]

2021-02-28T06:28:09.940 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.022 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.3176000000000001e-05
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:09.941 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.048 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.21491492100000001
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:09.941 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 2.0526e-05
, 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.070 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:09.942 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                    "tid": 2953
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                },
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                "events": [

2021-02-28T06:28:09.943 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.069197+0000",
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.2026e-05
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:09.944 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.071279+0000",
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.61522775500000004
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:09.945 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.728481+0000",
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 5.3695e-05
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:09.945 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.359953+0000",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 4294967295.9999657

2021-02-28T06:28:09.946 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.193 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "waiting for blocked object",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.360220+0000",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.36811692800000001

2021-02-28T06:28:09.946 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.214 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        },
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        {

2021-02-28T06:28:09.947 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.975915+0000",

2021-02-28T06:28:09.948 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.256 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.064774+0000",

2021-02-28T06:28:09.948 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.275 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.120989+0000",

2021-02-28T06:28:09.949 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:                ]
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:        },

2021-02-28T06:28:09.950 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.317 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",

2021-02-28T06:28:09.950 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:09.951 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.763882+0000",

2021-02-28T06:28:09.952 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.769 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.883437+0000",

2021-02-28T06:28:09.952 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:04:58.794 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:09.953 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "throttled",

2021-02-28T06:28:09.953 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:09.954 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",

2021-02-28T06:28:09.955 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:09.955 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.956 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.0293999999999999e-05
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.956 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.943 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.019597676000000001
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.957 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.073339273999999996
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:09.958 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.983 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.148015+0000",
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.958 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.164473+0000",
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.9017000000000001e-05
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.959 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.196162+0000",
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.012392344
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.959 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.358273+0000",
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.090501506999999995
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                    }

2021-02-28T06:28:09.960 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.360495+0000",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0

2021-02-28T06:28:09.961 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.522 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.545990+0000",

2021-02-28T06:28:09.961 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.547612+0000",

2021-02-28T06:28:09.962 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.831534+0000",

2021-02-28T06:28:09.962 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:43.924907+0000",

2021-02-28T06:28:09.963 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:09.964 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:04:59.630 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.964 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.649 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.023286626000000001
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.965 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:47.148942+0000",
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.7983e-05
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.966 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.692 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.021042162,
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:09.966 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "started",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.092439+0000",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.014591379999999999

2021-02-28T06:28:09.967 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.736 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.172662+0000",

2021-02-28T06:28:09.967 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:53.674346+0000",
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 5.841906206,
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.024810262,

2021-02-28T06:28:09.968 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:09.969 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 13.430062507000001,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.014920882999999999,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {

2021-02-28T06:28:09.969 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:05:00.219 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.183737+0000",

2021-02-28T06:28:09.970 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:09.970 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                },
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.971 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.0149000000000001e-05
, 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.280 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.972 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:52.317834+0000",
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.9385000000000001e-05
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.972 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "tid": 5227
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                },

2021-02-28T06:28:09.973 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "commit_sent",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.630108+0000",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 3.129e-06

2021-02-28T06:28:09.973 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.619465+0000",

2021-02-28T06:28:09.974 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:                "client_info": {
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client": "client.4487",
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",

2021-02-28T06:28:09.974 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:09.975 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000137904
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.976 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.834 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:515 4.0 e25/22 4:01276a87:::smithi08621581-115:head v 25'29, mlcod=25'26)",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:36.445489+0000",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 24.385942058000001,

2021-02-28T06:28:09.977 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.5524000000000002e-05
, 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.862 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.977 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:37.643452+0000",
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.00054766500000000002
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.978 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        },
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        {
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:997 4.0 e26/22 4:0a8a178b:::smithi08621581-223:head v 26'61, mlcod=26'59)",

2021-02-28T06:28:09.978 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:38.437727+0000",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4.6418000000000002e-05

2021-02-28T06:28:09.979 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.113710+0000",

2021-02-28T06:28:09.979 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:09.980 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.991 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:09.981 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4294967295.9999142
, 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:01.012 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:09.981 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.032 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.011212854
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:09.982 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:54.258789+0000",
, 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000110642
, 2021-02-27T14:05:01.056 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:09.982 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:57.150050+0000",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.6055999999999999e-05

2021-02-28T06:28:09.983 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub
, 2021-02-27T14:05:01.828+0000 7fda23465700 -1 osd.7 37 handle_osd_map injecting map crc failure
, 2021-02-27T14:05:02.435+0000 7f8583d6e700 -1 osd.1 38 handle_osd_map injecting map crc failure

2021-02-28T06:28:09.985 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:23.581 INFO:teuthology.orchestra.run.smithi086.stdout:60129542161
, 2021-02-27T14:05:23.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.4
, 2021-02-27T14:05:23.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5

2021-02-28T06:28:09.987 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-02-27T14:04:16.342478+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:09.987 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:13.327 INFO:tasks.ceph:Checking cluster log for badness...
, 2021-02-27T14:06:13.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v 'failed to encode map' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1
, 2021-02-27T14:06:13.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com

2021-02-28T06:28:09.988 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:==============================================================================
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 216.240.36.24    3 u   35   64   37    0.096   -1.177   0.927

2021-02-28T06:28:10.038 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fe7aa9e379d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe7aa9e3978]

2021-02-28T06:28:10.039 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.022 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.3176000000000001e-05
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.040 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.048 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.21491492100000001
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.041 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 2.0526e-05
, 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.070 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.041 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                    "tid": 2953
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                },
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                "events": [

2021-02-28T06:28:10.042 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.069197+0000",
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.2026e-05
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.042 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.071279+0000",
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.61522775500000004
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.043 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.728481+0000",
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 5.3695e-05
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.044 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.359953+0000",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 4294967295.9999657

2021-02-28T06:28:10.044 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.193 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "waiting for blocked object",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.360220+0000",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.36811692800000001

2021-02-28T06:28:10.045 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.214 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        },
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        {

2021-02-28T06:28:10.045 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.975915+0000",

2021-02-28T06:28:10.046 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.256 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.064774+0000",

2021-02-28T06:28:10.047 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.275 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.120989+0000",

2021-02-28T06:28:10.047 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:                ]
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:        },

2021-02-28T06:28:10.048 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.317 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",

2021-02-28T06:28:10.048 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.049 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.763882+0000",

2021-02-28T06:28:10.050 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.769 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.883437+0000",

2021-02-28T06:28:10.069 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:04:58.794 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.070 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "throttled",

2021-02-28T06:28:10.071 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.071 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",

2021-02-28T06:28:10.072 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.072 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.073 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.0293999999999999e-05
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.074 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.943 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.019597676000000001
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.074 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.073339273999999996
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.075 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.983 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.148015+0000",
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.076 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.164473+0000",
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.9017000000000001e-05
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.076 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.196162+0000",
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.012392344
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.077 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.358273+0000",
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.090501506999999995
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                    }

2021-02-28T06:28:10.077 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.360495+0000",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0

2021-02-28T06:28:10.078 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.522 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.545990+0000",

2021-02-28T06:28:10.079 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.547612+0000",

2021-02-28T06:28:10.079 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.831534+0000",

2021-02-28T06:28:10.080 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:43.924907+0000",

2021-02-28T06:28:10.081 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.081 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:04:59.630 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.082 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.649 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.023286626000000001
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.083 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:47.148942+0000",
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.7983e-05
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.083 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.692 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.021042162,
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:10.084 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "started",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.092439+0000",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.014591379999999999

2021-02-28T06:28:10.084 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.736 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.172662+0000",

2021-02-28T06:28:10.085 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:53.674346+0000",
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 5.841906206,
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.024810262,

2021-02-28T06:28:10.085 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.086 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 13.430062507000001,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.014920882999999999,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {

2021-02-28T06:28:10.087 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:05:00.219 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.183737+0000",

2021-02-28T06:28:10.089 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                },
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.091 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.0149000000000001e-05
, 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.280 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.091 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:52.317834+0000",
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.9385000000000001e-05
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.092 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "tid": 5227
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                },

2021-02-28T06:28:10.092 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "commit_sent",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.630108+0000",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 3.129e-06

2021-02-28T06:28:10.093 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.619465+0000",

2021-02-28T06:28:10.094 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:                "client_info": {
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client": "client.4487",
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",

2021-02-28T06:28:10.094 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.095 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000137904
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.095 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.834 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:515 4.0 e25/22 4:01276a87:::smithi08621581-115:head v 25'29, mlcod=25'26)",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:36.445489+0000",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 24.385942058000001,

2021-02-28T06:28:10.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.5524000000000002e-05
, 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.862 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.097 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:37.643452+0000",
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.00054766500000000002
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.097 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        },
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        {
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:997 4.0 e26/22 4:0a8a178b:::smithi08621581-223:head v 26'61, mlcod=26'59)",

2021-02-28T06:28:10.098 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:38.437727+0000",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4.6418000000000002e-05

2021-02-28T06:28:10.098 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.113710+0000",

2021-02-28T06:28:10.099 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.991 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4294967295.9999142
, 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:01.012 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.032 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.011212854
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:54.258789+0000",
, 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000110642
, 2021-02-27T14:05:01.056 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.102 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:57.150050+0000",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.6055999999999999e-05

2021-02-28T06:28:10.103 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub
, 2021-02-27T14:05:01.828+0000 7fda23465700 -1 osd.7 37 handle_osd_map injecting map crc failure
, 2021-02-27T14:05:02.435+0000 7f8583d6e700 -1 osd.1 38 handle_osd_map injecting map crc failure

2021-02-28T06:28:10.105 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:23.581 INFO:teuthology.orchestra.run.smithi086.stdout:60129542161
, 2021-02-27T14:05:23.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.4
, 2021-02-27T14:05:23.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5

2021-02-28T06:28:10.106 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-02-27T14:04:16.342478+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:10.107 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:13.327 INFO:tasks.ceph:Checking cluster log for badness...
, 2021-02-27T14:06:13.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v 'failed to encode map' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1
, 2021-02-27T14:06:13.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com

2021-02-28T06:28:10.107 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:==============================================================================
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 216.240.36.24    3 u   35   64   37    0.096   -1.177   0.927

2021-02-28T06:28:10.174 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fe7aa9e379d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe7aa9e3978]

2021-02-28T06:28:10.175 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.022 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.3176000000000001e-05
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.176 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.048 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.21491492100000001
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.176 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 2.0526e-05
, 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.070 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.177 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                    "tid": 2953
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                },
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                "events": [

2021-02-28T06:28:10.177 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.069197+0000",
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.2026e-05
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.178 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.071279+0000",
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.61522775500000004
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.179 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.728481+0000",
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 5.3695e-05
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.179 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.359953+0000",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 4294967295.9999657

2021-02-28T06:28:10.180 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.193 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "waiting for blocked object",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.360220+0000",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.36811692800000001

2021-02-28T06:28:10.180 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.214 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        },
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        {

2021-02-28T06:28:10.181 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.975915+0000",

2021-02-28T06:28:10.182 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.256 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.064774+0000",

2021-02-28T06:28:10.182 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.275 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.120989+0000",

2021-02-28T06:28:10.183 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:                ]
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:        },

2021-02-28T06:28:10.184 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.317 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",

2021-02-28T06:28:10.184 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.185 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.763882+0000",

2021-02-28T06:28:10.185 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.769 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.883437+0000",

2021-02-28T06:28:10.186 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:04:58.794 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.187 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "throttled",

2021-02-28T06:28:10.187 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.188 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",

2021-02-28T06:28:10.188 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.189 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.190 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.0293999999999999e-05
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.190 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.943 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.019597676000000001
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.191 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.073339273999999996
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.191 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.983 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.148015+0000",
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.192 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.164473+0000",
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.9017000000000001e-05
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.193 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.196162+0000",
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.012392344
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.193 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.358273+0000",
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.090501506999999995
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                    }

2021-02-28T06:28:10.194 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.360495+0000",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0

2021-02-28T06:28:10.195 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.522 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.545990+0000",

2021-02-28T06:28:10.195 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.547612+0000",

2021-02-28T06:28:10.196 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.831534+0000",

2021-02-28T06:28:10.197 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:43.924907+0000",

2021-02-28T06:28:10.197 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.198 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:04:59.630 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.199 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.649 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.023286626000000001
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.199 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:47.148942+0000",
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.7983e-05
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.200 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.692 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.021042162,
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:10.200 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "started",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.092439+0000",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.014591379999999999

2021-02-28T06:28:10.201 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.736 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.172662+0000",

2021-02-28T06:28:10.202 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:53.674346+0000",
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 5.841906206,
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.024810262,

2021-02-28T06:28:10.202 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.203 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 13.430062507000001,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.014920882999999999,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {

2021-02-28T06:28:10.204 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:05:00.219 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.183737+0000",

2021-02-28T06:28:10.204 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.205 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                },
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.205 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.0149000000000001e-05
, 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.280 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.206 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:52.317834+0000",
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.9385000000000001e-05
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.207 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "tid": 5227
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                },

2021-02-28T06:28:10.208 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "commit_sent",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.630108+0000",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 3.129e-06

2021-02-28T06:28:10.208 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.619465+0000",

2021-02-28T06:28:10.209 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:                "client_info": {
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client": "client.4487",
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",

2021-02-28T06:28:10.210 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.210 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000137904
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.211 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.834 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:515 4.0 e25/22 4:01276a87:::smithi08621581-115:head v 25'29, mlcod=25'26)",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:36.445489+0000",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 24.385942058000001,

2021-02-28T06:28:10.211 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.5524000000000002e-05
, 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.862 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.212 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:37.643452+0000",
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.00054766500000000002
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.213 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        },
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        {
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:997 4.0 e26/22 4:0a8a178b:::smithi08621581-223:head v 26'61, mlcod=26'59)",

2021-02-28T06:28:10.213 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:38.437727+0000",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4.6418000000000002e-05

2021-02-28T06:28:10.214 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.113710+0000",

2021-02-28T06:28:10.215 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.215 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.991 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.216 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4294967295.9999142
, 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:01.012 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.217 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.032 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.011212854
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.217 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:54.258789+0000",
, 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000110642
, 2021-02-27T14:05:01.056 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.218 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:57.150050+0000",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.6055999999999999e-05

2021-02-28T06:28:10.219 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub
, 2021-02-27T14:05:01.828+0000 7fda23465700 -1 osd.7 37 handle_osd_map injecting map crc failure
, 2021-02-27T14:05:02.435+0000 7f8583d6e700 -1 osd.1 38 handle_osd_map injecting map crc failure

2021-02-28T06:28:10.221 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:23.581 INFO:teuthology.orchestra.run.smithi086.stdout:60129542161
, 2021-02-27T14:05:23.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.4
, 2021-02-27T14:05:23.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5

2021-02-28T06:28:10.222 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-02-27T14:04:16.342478+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:10.223 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:13.327 INFO:tasks.ceph:Checking cluster log for badness...
, 2021-02-27T14:06:13.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v 'failed to encode map' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1
, 2021-02-27T14:06:13.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com

2021-02-28T06:28:10.223 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:==============================================================================
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 216.240.36.24    3 u   35   64   37    0.096   -1.177   0.927

2021-02-28T06:28:10.282 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fe7aa9e379d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe7aa9e3978]

2021-02-28T06:28:10.283 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.022 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.3176000000000001e-05
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.284 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.048 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.21491492100000001
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.285 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 2.0526e-05
, 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.070 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.285 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                    "tid": 2953
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                },
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                "events": [

2021-02-28T06:28:10.286 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.069197+0000",
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.2026e-05
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.287 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.071279+0000",
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.61522775500000004
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.287 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.728481+0000",
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 5.3695e-05
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.288 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.359953+0000",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 4294967295.9999657

2021-02-28T06:28:10.288 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.193 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "waiting for blocked object",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.360220+0000",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.36811692800000001

2021-02-28T06:28:10.289 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.214 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        },
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        {

2021-02-28T06:28:10.289 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.975915+0000",

2021-02-28T06:28:10.290 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.256 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.064774+0000",

2021-02-28T06:28:10.291 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.275 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.120989+0000",

2021-02-28T06:28:10.291 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:                ]
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:        },

2021-02-28T06:28:10.292 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.317 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",

2021-02-28T06:28:10.292 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.293 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.763882+0000",

2021-02-28T06:28:10.294 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.769 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.883437+0000",

2021-02-28T06:28:10.294 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:04:58.794 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.295 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "throttled",

2021-02-28T06:28:10.295 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.296 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",

2021-02-28T06:28:10.297 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.297 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.298 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.0293999999999999e-05
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.299 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.943 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.019597676000000001
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.299 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.073339273999999996
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.300 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.983 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.148015+0000",
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.300 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.164473+0000",
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.9017000000000001e-05
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.301 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.196162+0000",
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.012392344
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.301 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.358273+0000",
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.090501506999999995
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                    }

2021-02-28T06:28:10.302 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.360495+0000",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0

2021-02-28T06:28:10.303 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.522 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.545990+0000",

2021-02-28T06:28:10.303 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.547612+0000",

2021-02-28T06:28:10.304 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.831534+0000",

2021-02-28T06:28:10.305 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:43.924907+0000",

2021-02-28T06:28:10.305 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.306 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:04:59.630 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.306 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.649 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.023286626000000001
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.307 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:47.148942+0000",
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.7983e-05
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.308 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.692 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.021042162,
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:10.308 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "started",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.092439+0000",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.014591379999999999

2021-02-28T06:28:10.309 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.736 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.172662+0000",

2021-02-28T06:28:10.309 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:53.674346+0000",
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 5.841906206,
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.024810262,

2021-02-28T06:28:10.310 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.311 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 13.430062507000001,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.014920882999999999,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {

2021-02-28T06:28:10.311 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:05:00.219 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.183737+0000",

2021-02-28T06:28:10.312 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.314 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                },
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.314 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.0149000000000001e-05
, 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.280 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.315 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:52.317834+0000",
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.9385000000000001e-05
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.315 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "tid": 5227
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                },

2021-02-28T06:28:10.316 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "commit_sent",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.630108+0000",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 3.129e-06

2021-02-28T06:28:10.317 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.619465+0000",

2021-02-28T06:28:10.317 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:                "client_info": {
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client": "client.4487",
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",

2021-02-28T06:28:10.318 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.319 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000137904
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.320 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.834 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:515 4.0 e25/22 4:01276a87:::smithi08621581-115:head v 25'29, mlcod=25'26)",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:36.445489+0000",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 24.385942058000001,

2021-02-28T06:28:10.320 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.5524000000000002e-05
, 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.862 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.321 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:37.643452+0000",
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.00054766500000000002
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.321 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        },
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        {
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:997 4.0 e26/22 4:0a8a178b:::smithi08621581-223:head v 26'61, mlcod=26'59)",

2021-02-28T06:28:10.322 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:38.437727+0000",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4.6418000000000002e-05

2021-02-28T06:28:10.323 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.113710+0000",

2021-02-28T06:28:10.323 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.324 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.991 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.324 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4294967295.9999142
, 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:01.012 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.325 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.032 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.011212854
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.325 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:54.258789+0000",
, 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000110642
, 2021-02-27T14:05:01.056 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.326 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:57.150050+0000",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.6055999999999999e-05

2021-02-28T06:28:10.327 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub
, 2021-02-27T14:05:01.828+0000 7fda23465700 -1 osd.7 37 handle_osd_map injecting map crc failure
, 2021-02-27T14:05:02.435+0000 7f8583d6e700 -1 osd.1 38 handle_osd_map injecting map crc failure

2021-02-28T06:28:10.329 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:23.581 INFO:teuthology.orchestra.run.smithi086.stdout:60129542161
, 2021-02-27T14:05:23.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.4
, 2021-02-27T14:05:23.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5

2021-02-28T06:28:10.330 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-02-27T14:04:16.342478+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:10.331 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:13.327 INFO:tasks.ceph:Checking cluster log for badness...
, 2021-02-27T14:06:13.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v 'failed to encode map' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1
, 2021-02-27T14:06:13.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com

2021-02-28T06:28:10.331 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:==============================================================================
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 216.240.36.24    3 u   35   64   37    0.096   -1.177   0.927

2021-02-28T06:28:10.382 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fe7aa9e379d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fe7aa9e3978]

2021-02-28T06:28:10.383 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.022 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.3176000000000001e-05
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.023 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.384 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.048 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.21491492100000001
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.049 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.384 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 2.0526e-05
, 2021-02-27T14:04:58.069 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.070 INFO:teuthology.orchestra.run.smithi086.stdout:                    {

2021-02-28T06:28:10.385 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                    "tid": 2953
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                },
, 2021-02-27T14:04:58.090 INFO:teuthology.orchestra.run.smithi086.stdout:                "events": [

2021-02-28T06:28:10.386 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.069197+0000",
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 1.2026e-05
, 2021-02-27T14:04:58.111 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.386 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.071279+0000",
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.61522775500000004
, 2021-02-27T14:04:58.132 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.387 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.728481+0000",
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 5.3695e-05
, 2021-02-27T14:04:58.153 INFO:teuthology.orchestra.run.smithi086.stdout:                    },

2021-02-28T06:28:10.387 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.359953+0000",
, 2021-02-27T14:04:58.173 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 4294967295.9999657

2021-02-28T06:28:10.388 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.193 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "waiting for blocked object",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.360220+0000",
, 2021-02-27T14:04:58.194 INFO:teuthology.orchestra.run.smithi086.stdout:                        "duration": 0.36811692800000001

2021-02-28T06:28:10.389 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.214 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        },
, 2021-02-27T14:04:58.215 INFO:teuthology.orchestra.run.smithi086.stdout:        {

2021-02-28T06:28:10.389 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",
, 2021-02-27T14:04:58.235 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:47.975915+0000",

2021-02-28T06:28:10.390 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.255 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.256 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.064774+0000",

2021-02-28T06:28:10.390 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.275 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:04:58.276 INFO:teuthology.orchestra.run.smithi086.stdout:                        "time": "2021-02-27T14:04:48.120989+0000",

2021-02-28T06:28:10.391 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:                ]
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:            }
, 2021-02-27T14:04:58.296 INFO:teuthology.orchestra.run.smithi086.stdout:        },

2021-02-28T06:28:10.392 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.316 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.317 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "throttled",

2021-02-28T06:28:10.392 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    },
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                    {
, 2021-02-27T14:04:58.337 INFO:teuthology.orchestra.run.smithi086.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.393 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:04:58.746 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.763882+0000",

2021-02-28T06:28:10.393 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.769 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",
, 2021-02-27T14:04:58.770 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:46.883437+0000",

2021-02-28T06:28:10.394 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.793 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:04:58.794 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.395 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.817 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.818 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "throttled",

2021-02-28T06:28:10.395 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.839 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:10.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:58.860 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "op_commit",

2021-02-28T06:28:10.396 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:04:58.881 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.397 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.902 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.398 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.0293999999999999e-05
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.923 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.399 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.943 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.019597676000000001
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:58.944 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.399 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.963 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.073339273999999996
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:04:58.964 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.400 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:58.983 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.148015+0000",
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0
, 2021-02-27T14:04:58.984 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.400 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.164473+0000",
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.9017000000000001e-05
, 2021-02-27T14:04:59.004 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.401 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.196162+0000",
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.012392344
, 2021-02-27T14:04:59.024 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.402 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.358273+0000",
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.090501506999999995
, 2021-02-27T14:04:59.044 INFO:teuthology.orchestra.run.smithi153.stdout:                    }

2021-02-28T06:28:10.402 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.360495+0000",
, 2021-02-27T14:04:59.064 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0

2021-02-28T06:28:10.403 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.522 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "initiated",
, 2021-02-27T14:04:59.523 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.545990+0000",

2021-02-28T06:28:10.408 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:04:59.545 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.547612+0000",

2021-02-28T06:28:10.409 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.566 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.831534+0000",

2021-02-28T06:28:10.409 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:04:59.588 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:43.924907+0000",

2021-02-28T06:28:10.410 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.609 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.411 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:04:59.629 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:04:59.630 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.411 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.649 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.023286626000000001
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.650 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.412 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:47.148942+0000",
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.7983e-05
, 2021-02-27T14:04:59.671 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.413 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.692 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.021042162,
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {
, 2021-02-27T14:04:59.693 INFO:teuthology.orchestra.run.smithi153.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:10.415 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "started",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.092439+0000",
, 2021-02-27T14:04:59.714 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.014591379999999999

2021-02-28T06:28:10.415 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.735 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:04:59.736 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.172662+0000",

2021-02-28T06:28:10.416 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:53.674346+0000",
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 5.841906206,
, 2021-02-27T14:04:59.757 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.024810262,

2021-02-28T06:28:10.417 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:04:59.779 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.417 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 13.430062507000001,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "duration": 0.014920882999999999,
, 2021-02-27T14:05:00.198 INFO:teuthology.orchestra.run.smithi153.stdout:            "type_data": {

2021-02-28T06:28:10.418 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.218 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "done",
, 2021-02-27T14:05:00.219 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:48.183737+0000",

2021-02-28T06:28:10.419 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.239 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "dispatched",

2021-02-28T06:28:10.420 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                },
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                "events": [
, 2021-02-27T14:05:00.259 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.420 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 1.0149000000000001e-05
, 2021-02-27T14:05:00.279 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.280 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.421 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:52.317834+0000",
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.9385000000000001e-05
, 2021-02-27T14:05:00.300 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.423 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                    "tid": 5227
, 2021-02-27T14:05:00.321 INFO:teuthology.orchestra.run.smithi153.stdout:                },

2021-02-28T06:28:10.423 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "commit_sent",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.630108+0000",
, 2021-02-27T14:05:00.341 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 3.129e-06

2021-02-28T06:28:10.424 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:00.362 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:53.619465+0000",

2021-02-28T06:28:10.424 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.382 INFO:teuthology.orchestra.run.smithi153.stdout:                "client_info": {
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client": "client.4487",
, 2021-02-27T14:05:00.383 INFO:teuthology.orchestra.run.smithi153.stdout:                    "client_addr": "v1:172.21.15.86:0/1087643084",

2021-02-28T06:28:10.425 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.403 INFO:teuthology.orchestra.run.smithi153.stdout:            }

2021-02-28T06:28:10.426 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000137904
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.424 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.426 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.834 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:515 4.0 e25/22 4:01276a87:::smithi08621581-115:head v 25'29, mlcod=25'26)",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "initiated_at": "2021-02-27T14:04:36.445489+0000",
, 2021-02-27T14:05:00.835 INFO:teuthology.orchestra.run.smithi153.stdout:            "age": 24.385942058000001,

2021-02-28T06:28:10.427 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.5524000000000002e-05
, 2021-02-27T14:05:00.861 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.862 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.427 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.884 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:37.643452+0000",
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.00054766500000000002
, 2021-02-27T14:05:00.885 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.428 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        },
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:        {
, 2021-02-27T14:05:00.906 INFO:teuthology.orchestra.run.smithi153.stdout:            "description": "osd_repop(client.4487.0:997 4.0 e26/22 4:0a8a178b:::smithi08621581-223:head v 26'61, mlcod=26'59)",

2021-02-28T06:28:10.429 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:38.437727+0000",
, 2021-02-27T14:05:00.927 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4.6418000000000002e-05

2021-02-28T06:28:10.429 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "header_read",
, 2021-02-27T14:05:00.948 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:42.113710+0000",

2021-02-28T06:28:10.430 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:                ]
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:            }
, 2021-02-27T14:05:00.969 INFO:teuthology.orchestra.run.smithi153.stdout:        },

2021-02-28T06:28:10.431 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:00.990 INFO:teuthology.orchestra.run.smithi153.stdout:                    {
, 2021-02-27T14:05:00.991 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "reached_pg",

2021-02-28T06:28:10.431 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 4294967295.9999142
, 2021-02-27T14:05:01.011 INFO:teuthology.orchestra.run.smithi153.stdout:                    },
, 2021-02-27T14:05:01.012 INFO:teuthology.orchestra.run.smithi153.stdout:                    {

2021-02-28T06:28:10.432 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.032 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.011212854
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                    }
, 2021-02-27T14:05:01.033 INFO:teuthology.orchestra.run.smithi153.stdout:                ]

2021-02-28T06:28:10.432 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:54.258789+0000",
, 2021-02-27T14:05:01.055 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 0.000110642
, 2021-02-27T14:05:01.056 INFO:teuthology.orchestra.run.smithi153.stdout:                    },

2021-02-28T06:28:10.433 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "event": "all_read",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "time": "2021-02-27T14:04:57.150050+0000",
, 2021-02-27T14:05:01.077 INFO:teuthology.orchestra.run.smithi153.stdout:                        "duration": 2.6055999999999999e-05

2021-02-28T06:28:10.434 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:01.447 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub
, 2021-02-27T14:05:01.828+0000 7fda23465700 -1 osd.7 37 handle_osd_map injecting map crc failure
, 2021-02-27T14:05:02.435+0000 7f8583d6e700 -1 osd.1 38 handle_osd_map injecting map crc failure

2021-02-28T06:28:10.436 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:23.581 INFO:teuthology.orchestra.run.smithi086.stdout:60129542161
, 2021-02-27T14:05:23.595 INFO:tasks.ceph.ceph_manager.ceph:need seq 60129542160 got 60129542161 for osd.4
, 2021-02-27T14:05:23.596 DEBUG:teuthology.orchestra.run.smithi086:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5

2021-02-28T06:28:10.437 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.460 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2021-02-27T14:04:31.445307+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=31, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:05:31.461 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2021-02-27T14:04:16.342478+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=4, tm_sec=16, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=5, tm_sec=26, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:10.438 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:13.327 INFO:tasks.ceph:Checking cluster log for badness...
, 2021-02-27T14:06:13.328 DEBUG:teuthology.orchestra.run.smithi086:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(REQUEST_STUCK\)' | egrep -v 'failed to encode map' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v 'but it is still running' | egrep -v 'objects unfound and apparently lost' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | head -n 1
, 2021-02-27T14:06:13.347 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi086.front.sepia.ceph.com

2021-02-28T06:28:10.438 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:     remote           refid      st t when poll reach   delay   offset  jitter
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:==============================================================================
, 2021-02-27T14:06:26.495 INFO:teuthology.orchestra.run.smithi153.stdout:+hv01.front.sepi 216.240.36.24    3 u   35   64   37    0.096   -1.177   0.927

2021-02-28T06:28:10.853 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fd33d37979d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fd33d379978]

2021-02-28T06:28:10.855 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:36:08.748 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops
, 2021-02-27T13:36:08.867 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument
, 2021-02-27T13:36:08.868 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.

2021-02-28T06:28:10.856 WARNING:scrape:Ignoring malparsed backtrace: Read #3:433b2356:::smithi10421618-992 low_tier:head#
, Read #3:442152bc:::smithi10421618-329 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, Read #3:443b2bee:::smithi10421618-131 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:10.857 WARNING:scrape:Ignoring malparsed backtrace: Read #3:5d09b600:::smithi10421618-386 low_tier:head#
, Read #3:5d2a6689:::smithi10421618-977 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, Read #3:5d7a85e6:::smithi10421618-351 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:10.857 WARNING:scrape:Ignoring malparsed backtrace: Read #3:79a02ed8:::smithi10421618-320 low_tier:head#
, Read #3:79ae1d02:::smithi10421618-626 low_tier:head#
, Read #3:79b43ce3:::smithi10421618-768 low_tier:head#

2021-02-28T06:28:10.858 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:07.893 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:07.896 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:495f97ab:::smithi10421618-427 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:07.897 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:10.859 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.196 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:55b57ad7:::smithi10421618-899 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:08.197 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.202 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:561cc092:::smithi10421618-767 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:10.860 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.484 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.489 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:626ee599:::smithi10421618-576 low_tier:head#
, 2021-02-27T13:37:08.490 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:10.861 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.764 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:701d7a43:::smithi10421618-147 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:08.765 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.768 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:706f02e8:::smithi10421618-401 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:10.862 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:09.066 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:09.069 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:7dee5112:::smithi10421618-717 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:09.070 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:10.863 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:11.262 INFO:tasks.thrashosds.thrasher:Added osd 5
, 2021-02-27T13:38:11.263 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0
, 2021-02-27T13:38:11.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pgp_num 26

2021-02-28T06:28:10.866 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:32.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6
, 2021-02-27T13:38:33.208 INFO:teuthology.orchestra.run.smithi104.stdout:55834574903
, 2021-02-27T13:38:33.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574903 for osd.6

2021-02-28T06:28:10.867 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:41.289 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2021-02-27T13:38:20.772129+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T13:38:41.290 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-02-27T13:37:25.746820+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=37, tm_sec=25, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T13:38:41.290 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-27T13:38:04.311602+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=4, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:10.868 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:39:22.994 INFO:tasks.ceph.osd.7:Stopped
, 2021-02-27T13:39:22.995 INFO:teuthology.misc:Shutting down mgr daemons...
, 2021-02-27T13:39:22.995 DEBUG:tasks.ceph.mgr.y:waiting for process to exit

2021-02-28T06:28:10.869 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 161, in wait
,     self._raise_for_status()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 179, in _raise_for_status

2021-02-28T06:28:10.995 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fd33d37979d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fd33d379978]

2021-02-28T06:28:10.997 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:36:08.748 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops
, 2021-02-27T13:36:08.867 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument
, 2021-02-27T13:36:08.868 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.

2021-02-28T06:28:10.998 WARNING:scrape:Ignoring malparsed backtrace: Read #3:433b2356:::smithi10421618-992 low_tier:head#
, Read #3:442152bc:::smithi10421618-329 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, Read #3:443b2bee:::smithi10421618-131 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:10.999 WARNING:scrape:Ignoring malparsed backtrace: Read #3:5d09b600:::smithi10421618-386 low_tier:head#
, Read #3:5d2a6689:::smithi10421618-977 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, Read #3:5d7a85e6:::smithi10421618-351 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:10.999 WARNING:scrape:Ignoring malparsed backtrace: Read #3:79a02ed8:::smithi10421618-320 low_tier:head#
, Read #3:79ae1d02:::smithi10421618-626 low_tier:head#
, Read #3:79b43ce3:::smithi10421618-768 low_tier:head#

2021-02-28T06:28:11.000 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:07.893 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:07.896 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:495f97ab:::smithi10421618-427 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:07.897 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:11.001 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.196 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:55b57ad7:::smithi10421618-899 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:08.197 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.202 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:561cc092:::smithi10421618-767 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:11.001 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.484 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.489 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:626ee599:::smithi10421618-576 low_tier:head#
, 2021-02-27T13:37:08.490 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:11.002 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.764 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:701d7a43:::smithi10421618-147 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:08.765 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.768 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:706f02e8:::smithi10421618-401 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:11.004 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:09.066 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:09.069 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:7dee5112:::smithi10421618-717 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:09.070 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:11.004 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:11.262 INFO:tasks.thrashosds.thrasher:Added osd 5
, 2021-02-27T13:38:11.263 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0
, 2021-02-27T13:38:11.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pgp_num 26

2021-02-28T06:28:11.007 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:32.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6
, 2021-02-27T13:38:33.208 INFO:teuthology.orchestra.run.smithi104.stdout:55834574903
, 2021-02-27T13:38:33.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574903 for osd.6

2021-02-28T06:28:11.009 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:41.289 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2021-02-27T13:38:20.772129+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T13:38:41.290 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-02-27T13:37:25.746820+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=37, tm_sec=25, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T13:38:41.290 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-27T13:38:04.311602+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=4, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:11.009 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:39:22.994 INFO:tasks.ceph.osd.7:Stopped
, 2021-02-27T13:39:22.995 INFO:teuthology.misc:Shutting down mgr daemons...
, 2021-02-27T13:39:22.995 DEBUG:tasks.ceph.mgr.y:waiting for process to exit

2021-02-28T06:28:11.010 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 161, in wait
,     self._raise_for_status()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 179, in _raise_for_status

2021-02-28T06:28:11.129 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fd33d37979d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fd33d379978]

2021-02-28T06:28:11.130 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:36:08.748 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops
, 2021-02-27T13:36:08.867 INFO:teuthology.orchestra.run.smithi104.stdout:ERROR: (22) Invalid argument
, 2021-02-27T13:36:08.868 INFO:teuthology.orchestra.run.smithi104.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.

2021-02-28T06:28:11.131 WARNING:scrape:Ignoring malparsed backtrace: Read #3:433b2356:::smithi10421618-992 low_tier:head#
, Read #3:442152bc:::smithi10421618-329 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, Read #3:443b2bee:::smithi10421618-131 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:11.132 WARNING:scrape:Ignoring malparsed backtrace: Read #3:5d09b600:::smithi10421618-386 low_tier:head#
, Read #3:5d2a6689:::smithi10421618-977 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, Read #3:5d7a85e6:::smithi10421618-351 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:11.132 WARNING:scrape:Ignoring malparsed backtrace: Read #3:79a02ed8:::smithi10421618-320 low_tier:head#
, Read #3:79ae1d02:::smithi10421618-626 low_tier:head#
, Read #3:79b43ce3:::smithi10421618-768 low_tier:head#

2021-02-28T06:28:11.133 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:07.893 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:07.896 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:495f97ab:::smithi10421618-427 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:07.897 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:11.134 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.196 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:55b57ad7:::smithi10421618-899 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:08.197 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.202 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:561cc092:::smithi10421618-767 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:11.134 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.484 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.489 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:626ee599:::smithi10421618-576 low_tier:head#
, 2021-02-27T13:37:08.490 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:11.135 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:08.764 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:701d7a43:::smithi10421618-147 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:08.765 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:08.768 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:706f02e8:::smithi10421618-401 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#

2021-02-28T06:28:11.137 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:37:09.066 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}
, 2021-02-27T13:37:09.069 INFO:teuthology.orchestra.run.smithi166.stdout:Write #3:7dee5112:::smithi10421618-717 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head#
, 2021-02-27T13:37:09.070 INFO:teuthology.orchestra.run.smithi166.stdout:snapset 0=[]:{}

2021-02-28T06:28:11.137 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:11.262 INFO:tasks.thrashosds.thrasher:Added osd 5
, 2021-02-27T13:38:11.263 INFO:tasks.thrashosds.thrasher:fixing pg num pool unique_pool_0
, 2021-02-27T13:38:11.263 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set unique_pool_0 pgp_num 26

2021-02-28T06:28:11.140 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:32.899 DEBUG:teuthology.orchestra.run.smithi104:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6
, 2021-02-27T13:38:33.208 INFO:teuthology.orchestra.run.smithi104.stdout:55834574903
, 2021-02-27T13:38:33.228 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574903 got 55834574903 for osd.6

2021-02-28T06:28:11.144 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:38:41.289 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2021-02-27T13:38:20.772129+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=20, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T13:38:41.290 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-02-27T13:37:25.746820+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=37, tm_sec=25, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T13:38:41.290 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-27T13:38:04.311602+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=4, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=13, tm_min=38, tm_sec=35, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:11.145 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:39:22.994 INFO:tasks.ceph.osd.7:Stopped
, 2021-02-27T13:39:22.995 INFO:teuthology.misc:Shutting down mgr daemons...
, 2021-02-27T13:39:22.995 DEBUG:tasks.ceph.mgr.y:waiting for process to exit

2021-02-28T06:28:11.145 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 161, in wait
,     self._raise_for_status()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 179, in _raise_for_status

2021-02-28T06:28:12.405 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f48cda7679d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f48cda76978]

2021-02-28T06:28:12.435 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:57:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument
, 2021-02-28T04:57:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.
, 2021-02-28T04:57:49.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops

2021-02-28T06:28:12.440 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:58:33.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
, 2021-02-28T04:58:33.413 INFO:teuthology.orchestra.run.smithi132.stdout:
, dumped all

2021-02-28T06:28:12.444 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:59:50.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1
, reweighted osd.6 to 1 (10000)
, 2021-02-28T04:59:51.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1

2021-02-28T06:28:12.446 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T05:00:02.416 INFO:teuthology.orchestra.run.smithi132.stdout:}
, 2021-02-28T05:00:02.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2
, instructed osd(s) 2 to deep-scrub

2021-02-28T06:28:12.447 WARNING:scrape:Ignoring malparsed backtrace:   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 274, in thread
,     run.wait(tests.values())

2021-02-28T06:28:12.448 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T05:00:50.241 INFO:tasks.ceph:Archiving crash dumps...
, 2021-02-28T05:00:50.244 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/myoungwon-2021-02-23_10:10:24-rados-wip-manifest-dedup-test-distro-basic-smithi/5907356/remote/smithi132/crash
, 2021-02-28T05:00:50.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2021-02-28T06:28:12.449 WARNING:scrape:Ignoring malparsed backtrace:   File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
,     next(self.gen)
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 286, in task

2021-02-28T06:28:12.530 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f48cda7679d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f48cda76978]

2021-02-28T06:28:12.532 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:57:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument
, 2021-02-28T04:57:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.
, 2021-02-28T04:57:49.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops

2021-02-28T06:28:12.535 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:58:33.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
, 2021-02-28T04:58:33.413 INFO:teuthology.orchestra.run.smithi132.stdout:
, dumped all

2021-02-28T06:28:12.536 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:59:50.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1
, reweighted osd.6 to 1 (10000)
, 2021-02-28T04:59:51.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1

2021-02-28T06:28:12.538 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T05:00:02.416 INFO:teuthology.orchestra.run.smithi132.stdout:}
, 2021-02-28T05:00:02.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2
, instructed osd(s) 2 to deep-scrub

2021-02-28T06:28:12.538 WARNING:scrape:Ignoring malparsed backtrace:   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 274, in thread
,     run.wait(tests.values())

2021-02-28T06:28:12.539 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T05:00:50.241 INFO:tasks.ceph:Archiving crash dumps...
, 2021-02-28T05:00:50.244 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/myoungwon-2021-02-23_10:10:24-rados-wip-manifest-dedup-test-distro-basic-smithi/5907356/remote/smithi132/crash
, 2021-02-28T05:00:50.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2021-02-28T06:28:12.540 WARNING:scrape:Ignoring malparsed backtrace:   File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
,     next(self.gen)
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 286, in task

2021-02-28T06:28:12.590 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f48cda7679d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f48cda76978]

2021-02-28T06:28:12.593 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:57:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:ERROR: (22) Invalid argument
, 2021-02-28T04:57:49.775 INFO:teuthology.orchestra.run.smithi170.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards.
, 2021-02-28T04:57:49.785 DEBUG:teuthology.orchestra.run.smithi170:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops

2021-02-28T06:28:12.595 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:58:33.106 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json
, 2021-02-28T04:58:33.413 INFO:teuthology.orchestra.run.smithi132.stdout:
, dumped all

2021-02-28T06:28:12.597 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T04:59:50.227 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1
, reweighted osd.6 to 1 (10000)
, 2021-02-28T04:59:51.237 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1

2021-02-28T06:28:12.598 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T05:00:02.416 INFO:teuthology.orchestra.run.smithi132.stdout:}
, 2021-02-28T05:00:02.430 DEBUG:teuthology.orchestra.run.smithi132:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2
, instructed osd(s) 2 to deep-scrub

2021-02-28T06:28:12.599 WARNING:scrape:Ignoring malparsed backtrace:   File "src/gevent/greenlet.py", line 766, in gevent._greenlet.Greenlet.run
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 274, in thread
,     run.wait(tests.values())

2021-02-28T06:28:12.599 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-28T05:00:50.241 INFO:tasks.ceph:Archiving crash dumps...
, 2021-02-28T05:00:50.244 DEBUG:teuthology.misc:Transferring archived files from smithi132:/var/lib/ceph/crash to /home/teuthworker/archive/myoungwon-2021-02-23_10:10:24-rados-wip-manifest-dedup-test-distro-basic-smithi/5907356/remote/smithi132/crash
, 2021-02-28T05:00:50.246 DEBUG:teuthology.orchestra.run.smithi132:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2021-02-28T06:28:12.600 WARNING:scrape:Ignoring malparsed backtrace:   File "/usr/lib/python3.6/contextlib.py", line 88, in __exit__
,     next(self.gen)
,   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 286, in task

2021-02-28T06:28:14.080 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7feef7faf79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7feef7faf978]

2021-02-28T06:28:14.082 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.695 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:10.373169+0000",
, 2021-02-27T14:26:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 6.3250000000000006e-05

2021-02-28T06:28:14.082 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "age": 17.958649700999999,
, 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.15429325599999999,
, 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {

2021-02-28T06:28:14.083 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.762 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.763 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "throttled",
, 2021-02-27T14:26:31.763 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.681551+0000",

2021-02-28T06:28:14.084 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.797 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.797 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:31.798 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.688773+0000",

2021-02-28T06:28:14.084 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.837 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.838 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:31.838 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.829044+0000",

2021-02-28T06:28:14.085 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.877 INFO:teuthology.orchestra.run.smithi119.stdout:            "initiated_at": "2021-02-27T14:26:13.693999+0000",
, 2021-02-27T14:26:31.877 INFO:teuthology.orchestra.run.smithi119.stdout:            "age": 17.934994554999999,
, 2021-02-27T14:26:31.878 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.134263781,

2021-02-28T06:28:14.085 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.903 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:31.904 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.904 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.086 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.934 INFO:teuthology.orchestra.run.smithi119.stdout:                    }
, 2021-02-27T14:26:31.935 INFO:teuthology.orchestra.run.smithi119.stdout:                ]
, 2021-02-27T14:26:31.935 INFO:teuthology.orchestra.run.smithi119.stdout:            }

2021-02-28T06:28:14.087 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.978 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 8.3229999999999998e-06
, 2021-02-27T14:26:31.979 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:31.979 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.087 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.032 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 3.4638000000000003e-05
, 2021-02-27T14:26:32.033 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.033 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.088 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.844478+0000",
, 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.666e-05
, 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.088 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.226890+0000",
, 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00028260299999999998
, 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.089 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.159 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.326699+0000",
, 2021-02-27T14:26:32.159 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.008482669
, 2021-02-27T14:26:32.160 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.457702+0000",
, 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00012408100000000001
, 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.090 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.12518553299999999,
, 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {
, 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:14.091 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 479, in wait
,     proc.wait()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 161, in wait

2021-02-28T06:28:14.091 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.699 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.700 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "done",
, 2021-02-27T14:26:32.700 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.672717+0000",

2021-02-28T06:28:14.092 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:14.093 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.756 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0
, 2021-02-27T14:26:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.093 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.789 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.000113101
, 2021-02-27T14:26:32.790 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.790 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.094 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.692336+0000",
, 2021-02-27T14:26:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.0087e-05
, 2021-02-27T14:26:32.825 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.094 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "initiated",
, 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.714193+0000",
, 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0

2021-02-28T06:28:14.095 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.882 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:32.883 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.836489+0000",
, 2021-02-27T14:26:32.883 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00010335700000000001

2021-02-28T06:28:14.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.911 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.912 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "dispatched",
, 2021-02-27T14:26:32.912 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.866924+0000",

2021-02-28T06:28:14.096 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.936 INFO:teuthology.orchestra.run.smithi119.stdout:                "events": [
, 2021-02-27T14:26:32.937 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.937 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "initiated",

2021-02-28T06:28:14.097 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.960 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.961 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.961 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.097 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.985 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.8258e-05
, 2021-02-27T14:26:32.986 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.986 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.098 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {
, 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:                "events": [

2021-02-28T06:28:14.099 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.844 INFO:teuthology.orchestra.run.smithi184.stdout:            "duration": 0.43877463,
, 2021-02-27T14:26:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:            "type_data": {
, 2021-02-27T14:26:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:14.099 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.875 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",
, 2021-02-27T14:26:33.876 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.451200+0000",
, 2021-02-27T14:26:33.876 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999461

2021-02-28T06:28:14.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "dispatched",
, 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.513806+0000",
, 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.0450000000000001e-06

2021-02-28T06:28:14.100 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "started",
, 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.683468+0000",
, 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.011857326

2021-02-28T06:28:14.101 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "op_commit",
, 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.727028+0000",
, 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.103888732

2021-02-28T06:28:14.102 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",
, 2021-02-27T14:26:34.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.966617+0000",
, 2021-02-27T14:26:34.004 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.134253861

2021-02-28T06:28:14.102 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.031 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client": "client.4472",
, 2021-02-27T14:26:34.031 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",
, 2021-02-27T14:26:34.032 INFO:teuthology.orchestra.run.smithi184.stdout:                    "tid": 2731

2021-02-28T06:28:14.103 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.062 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.063 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "header_read",
, 2021-02-27T14:26:34.063 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.337296+0000",

2021-02-28T06:28:14.103 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.338540+0000",

2021-02-28T06:28:14.104 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for subops from 2,7",
, 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.372046+0000",

2021-02-28T06:28:14.105 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.462711+0000",

2021-02-28T06:28:14.105 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.205 INFO:teuthology.orchestra.run.smithi184.stdout:                ]
, 2021-02-27T14:26:34.208 INFO:teuthology.orchestra.run.smithi184.stdout:            }
, 2021-02-27T14:26:34.208 INFO:teuthology.orchestra.run.smithi184.stdout:        },

2021-02-28T06:28:14.106 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.241 INFO:teuthology.orchestra.run.smithi184.stdout:                "events": [
, 2021-02-27T14:26:34.242 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.242 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "initiated",

2021-02-28T06:28:14.106 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.265 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "all_read",

2021-02-28T06:28:14.107 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.108 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "op_commit",

2021-02-28T06:28:14.108 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.109 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.372 INFO:teuthology.orchestra.run.smithi184.stdout:}
, 2021-02-27T14:26:34.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight
, marked in osd.4.

2021-02-28T06:28:14.109 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                "client_info": {
, 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client": "client.4472",
, 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",

2021-02-28T06:28:14.110 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for peered",

2021-02-28T06:28:14.111 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.837 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.837 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.838 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.111 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.862 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.5663999999999998e-05
, 2021-02-27T14:26:34.862 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.863 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.113 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.041298841000000003
, 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.113 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.079475975000000004
, 2021-02-27T14:26:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.909 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.114 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 1.3969e-05
, 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.115 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.955 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 1.0544368580000001
, 2021-02-27T14:26:34.956 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.956 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.116 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:            "type_data": {
, 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:                "flag_point": "reached pg",
, 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:                "client_info": {

2021-02-28T06:28:14.116 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.671657+0000",
, 2021-02-27T14:26:35.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.000100437
, 2021-02-27T14:26:35.004 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.117 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",
, 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                    "tid": 2853
, 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                },

2021-02-28T06:28:14.117 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",
, 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.708811+0000",
, 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.7909999999999993e-06

2021-02-28T06:28:14.118 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.072 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.073 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "initiated",
, 2021-02-27T14:26:35.073 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.808525+0000",

2021-02-28T06:28:14.119 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for peered",
, 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.809491+0000",

2021-02-28T06:28:14.119 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.514 INFO:teuthology.orchestra.run.smithi184.stdout:    "size": 20,
, 2021-02-27T14:26:35.515 INFO:teuthology.orchestra.run.smithi184.stdout:    "duration": 600,
, 2021-02-27T14:26:35.515 INFO:teuthology.orchestra.run.smithi184.stdout:    "ops": [

2021-02-28T06:28:14.120 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.587 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.588 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.588 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.120 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.627 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999681
, 2021-02-27T14:26:35.628 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.628 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.121 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.672 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.035520544000000001
, 2021-02-27T14:26:35.672 INFO:teuthology.orchestra.run.smithi184.stdout:                    }
, 2021-02-27T14:26:35.673 INFO:teuthology.orchestra.run.smithi184.stdout:                ]

2021-02-28T06:28:14.122 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.585295+0000",
, 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.0040886719999999998
, 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.122 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",
, 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.170647+0000",
, 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999375

2021-02-28T06:28:14.123 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.795 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",
, 2021-02-27T14:26:35.796 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.219423+0000",
, 2021-02-27T14:26:35.797 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.041800245999999999

2021-02-28T06:28:14.124 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.853 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.854 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:35.854 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.183462+0000",

2021-02-28T06:28:14.124 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",

2021-02-28T06:28:14.125 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",

2021-02-28T06:28:14.125 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.949 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 9.3360000000000001e-06
, 2021-02-27T14:26:35.950 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.950 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.126 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.972 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.484131+0000",
, 2021-02-27T14:26:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0
, 2021-02-27T14:26:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.127 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.999 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.525757+0000",
, 2021-02-27T14:26:35.999 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 5.6601000000000002e-05
, 2021-02-27T14:26:36.000 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.129 WARNING:scrape:Ignoring malparsed backtrace: dumped all
, 2021-02-27T14:26:56.738 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2021-02-27T14:26:55.619324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3076258358,"num_objects":1488,"num_object_clones":0,"num_object_copies":4464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1488,"num_whiteouts":0,"num_read":3184,"num_read_kb":1171322,"num_write":4739,"num_write_kb":5271446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1204,"num_bytes_recovered":2859443415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":449,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":87,"acting":87,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10094172,"kb_used_data":9910684,"kb_used_omap":0,"kb_used_meta":183424,"kb_avail":744880548,"statfs":{"total":773094113280,"available":762757681152,"internally_reserved":0,"allocated":10148540416,"data_stored":10137639078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187826176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139010"},"pg_stats":[{"pgid":"4.f","version":"38'109","reported_seq":"321","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.929471+0000","last_change":"2021-02-27T14:26:39.420528+0000","last_active":"2021-02-27T14:26:49.929471+0000","last_peered":"2021-02-27T14:26:49.929471+0000","last_clean":"2021-02-27T14:26:49.929471+0000","last_became_active":"2021-02-27T14:26:39.420082+0000","last_became_peered":"2021-02-27T14:26:39.420082+0000","last_unstale":"2021-02-27T14:26:49.929471+0000","last_undegraded":"2021-02-27T14:26:49.929471+0000","last_fullsized":"2021-02-27T14:26:49.929471+0000","mapping_epoch":45,"log_start":"35'106","ondisk_log_start":"35'106","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3798481,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":72,"num_read_kb":24,"num_write":131,"num_write_kb":99470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":3798481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":23,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'203","reported_seq":"423","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.277085+0000","last_change":"2021-02-27T14:25:58.360562+0000","last_active":"2021-02-27T14:26:50.277085+0000","last_peered":"2021-02-27T14:26:50.277085+0000","last_clean":"2021-02-27T14:26:50.277085+0000","last_became_active":"2021-02-27T14:25:58.359615+0000","last_became_peered":"2021-02-27T14:25:58.359615+0000","last_unstale":"2021-02-27T14:26:50.277085+0000","last_undegraded":"2021-02-27T14:26:50.277085+0000","last_fullsized":"2021-02-27T14:26:50.277085+0000","mapping_epoch":20,"log_start":"37'200","ondisk_log_start":"37'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11260855,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":138,"num_read_kb":16691,"num_write":238,"num_write_kb":184324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":38,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'135","reported_seq":"294","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239249+0000","last_change":"2021-02-27T14:25:58.358332+0000","last_active":"2021-02-27T14:26:50.239249+0000","last_peered":"2021-02-27T14:26:50.239249+0000","last_clean":"2021-02-27T14:26:50.239249+0000","last_became_active":"2021-02-27T14:25:58.356582+0000","last_became_peered":"2021-02-27T14:25:58.356582+0000","last_unstale":"2021-02-27T14:26:50.239249+0000","last_undegraded":"2021-02-27T14:26:50.239249+0000","last_fullsized":"2021-02-27T14:26:50.239249+0000","mapping_epoch":20,"log_start":"38'132","ondisk_log_start":"38'132","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16571801,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":90,"num_read_kb":12047,"num_write":151,"num_write_kb":119395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":22,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"38'146","reported_seq":"397","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495109+0000","last_change":"2021-02-27T14:26:38.418145+0000","last_active":"2021-02-27T14:26:49.495109+0000","last_peered":"2021-02-27T14:26:49.495109+0000","last_clean":"2021-02-27T14:26:49.495109+0000","last_became_active":"2021-02-27T14:26:38.417490+0000","last_became_peered":"2021-02-27T14:26:38.417490+0000","last_unstale":"2021-02-27T14:26:49.495109+0000","last_undegraded":"2021-02-27T14:26:49.495109+0000","last_fullsized":"2021-02-27T14:26:49.495109+0000","mapping_epoch":44,"log_start":"36'143","ondisk_log_start":"36'143","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11462506,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":92,"num_read_kb":32,"num_write":169,"num_write_kb":129234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":11462506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":26,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"38'152","reported_seq":"418","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495750+0000","last_change":"2021-02-27T14:26:38.418219+0000","last_active":"2021-02-27T14:26:49.495750+0000","last_peered":"2021-02-27T14:26:49.495750+0000","last_clean":"2021-02-27T14:26:49.495750+0000","last_became_active":"2021-02-27T14:26:38.417606+0000","last_became_peered":"2021-02-27T14:26:38.417606+0000","last_unstale":"2021-02-27T14:26:49.495750+0000","last_undegraded":"2021-02-27T14:26:49.495750+0000","last_fullsized":"2021-02-27T14:26:49.495750+0000","mapping_epoch":44,"log_start":"38'149","ondisk_log_start":"38'149","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12840680,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":107,"num_read_kb":11857,"num_write":175,"num_write_kb":123916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":12073777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"36'190","reported_seq":"396","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.276884+0000","last_change":"2021-02-27T14:25:58.361631+0000","last_active":"2021-02-27T14:26:50.276884+0000","last_peered":"2021-02-27T14:26:50.276884+0000","last_clean":"2021-02-27T14:26:50.276884+0000","last_became_active":"2021-02-27T14:25:58.359858+0000","last_became_peered":"2021-02-27T14:25:58.359858+0000","last_unstale":"2021-02-27T14:26:50.276884+0000","last_undegraded":"2021-02-27T14:26:50.276884+0000","last_fullsized":"2021-02-27T14:26:50.276884+0000","mapping_epoch":20,"log_start":"36'187","ondisk_log_start":"36'187","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16067657,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":122,"num_read_kb":41,"num_write":221,"num_write_kb":166857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":35,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"38'157","reported_seq":"412","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.494919+0000","last_change":"2021-02-27T14:26:38.420332+0000","last_active":"2021-02-27T14:26:49.494919+0000","last_peered":"2021-02-27T14:26:49.494919+0000","last_clean":"2021-02-27T14:26:49.494919+0000","last_became_active":"2021-02-27T14:26:38.419573+0000","last_became_peered":"2021-02-27T14:26:38.419573+0000","last_unstale":"2021-02-27T14:26:49.494919+0000","last_undegraded":"2021-02-27T14:26:49.494919+0000","last_fullsized":"2021-02-27T14:26:49.494919+0000","mapping_epoch":44,"log_start":"35'154","ondisk_log_start":"35'154","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12454218,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":94,"num_read_kb":32,"num_write":181,"num_write_kb":137358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":12454218,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'118","reported_seq":"260","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239025+0000","last_change":"2021-02-27T14:25:58.359214+0000","last_active":"2021-02-27T14:26:50.239025+0000","last_peered":"2021-02-27T14:26:50.239025+0000","last_clean":"2021-02-27T14:26:50.239025+0000","last_became_active":"2021-02-27T14:25:58.358653+0000","last_became_peered":"2021-02-27T14:25:58.358653+0000","last_unstale":"2021-02-27T14:26:50.239025+0000","last_undegraded":"2021-02-27T14:26:50.239025+0000","last_fullsized":"2021-02-27T14:26:50.239025+0000","mapping_epoch":20,"log_start":"36'115","ondisk_log_start":"36'115","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8638996,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":72,"num_read_kb":24,"num_write":136,"num_write_kb":111476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":21,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"54","reported_epoch":"57","state":"active+clean","last_fresh":"2021-02-27T14:26:51.671230+0000","last_change":"2021-02-27T14:26:51.671230+0000","last_active":"2021-02-27T14:26:51.671230+0000","last_peered":"2021-02-27T14:26:51.671230+0000","last_clean":"2021-02-27T14:26:51.671230+0000","last_became_active":"2021-02-27T14:25:39.885593+0000","last_became_peered":"2021-02-27T14:25:39.885593+0000","last_unstale":"2021-02-27T14:26:51.671230+0000","last_undegraded":"2021-02-27T14:26:51.671230+0000","last_fullsized":"2021-02-27T14:26:51.671230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:51.670955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:26:51.670955+0000","last_clean_scrub_stamp":"2021-02-27T14:26:51.670955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'137","reported_seq":"304","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439030+0000","last_change":"2021-02-27T14:25:58.352218+0000","last_active":"2021-02-27T14:26:50.439030+0000","last_peered":"2021-02-27T14:26:50.439030+0000","last_clean":"2021-02-27T14:26:50.439030+0000","last_became_active":"2021-02-27T14:25:58.351397+0000","last_became_peered":"2021-02-27T14:25:58.351397+0000","last_unstale":"2021-02-27T14:26:50.439030+0000","last_undegraded":"2021-02-27T14:26:50.439030+0000","last_fullsized":"2021-02-27T14:26:50.439030+0000","mapping_epoch":20,"log_start":"35'134","ondisk_log_start":"35'134","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6806967,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":98,"num_read_kb":23476,"num_write":161,"num_write_kb":117745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"39'136","reported_seq":"303","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439197+0000","last_change":"2021-02-27T14:25:58.352355+0000","last_active":"2021-02-27T14:26:50.439197+0000","last_peered":"2021-02-27T14:26:50.439197+0000","last_clean":"2021-02-27T14:26:50.439197+0000","last_became_active":"2021-02-27T14:25:58.351733+0000","last_became_peered":"2021-02-27T14:25:58.351733+0000","last_unstale":"2021-02-27T14:26:50.439197+0000","last_undegraded":"2021-02-27T14:26:50.439197+0000","last_fullsized":"2021-02-27T14:26:50.439197+0000","mapping_epoch":20,"log_start":"36'133","ondisk_log_start":"36'133","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4134786,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":103,"num_read_kb":23378,"num_write":160,"num_write_kb":120410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":26,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239286+0000","last_change":"2021-02-27T14:25:39.886406+0000","last_active":"2021-02-27T14:26:50.239286+0000","last_peered":"2021-02-27T14:26:50.239286+0000","last_clean":"2021-02-27T14:26:50.239286+0000","last_became_active":"2021-02-27T14:25:39.885568+0000","last_became_peered":"2021-02-27T14:25:39.885568+0000","last_unstale":"2021-02-27T14:26:50.239286+0000","last_undegraded":"2021-02-27T14:26:50.239286+0000","last_fullsized":"2021-02-27T14:26:50.239286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'417","reported_seq":"1258","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495177+0000","last_change":"2021-02-27T14:26:45.344017+0000","last_active":"2021-02-27T14:26:49.495177+0000","last_peered":"2021-02-27T14:26:49.495177+0000","last_clean":"2021-02-27T14:26:49.495177+0000","last_became_active":"2021-02-27T14:26:45.343445+0000","last_became_peered":"2021-02-27T14:26:45.343445+0000","last_unstale":"2021-02-27T14:26:49.495177+0000","last_undegraded":"2021-02-27T14:26:49.495177+0000","last_fullsized":"2021-02-27T14:26:49.495177+0000","mapping_epoch":51,"log_start":"39'414","ondisk_log_start":"39'414","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":764896107,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":374,"num_read_kb":246383,"num_write":458,"num_write_kb":814921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":259,"num_bytes_recovered":760041606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'147","reported_seq":"316","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439291+0000","last_change":"2021-02-27T14:25:58.352046+0000","last_active":"2021-02-27T14:26:50.439291+0000","last_peered":"2021-02-27T14:26:50.439291+0000","last_clean":"2021-02-27T14:26:50.439291+0000","last_became_active":"2021-02-27T14:25:58.351588+0000","last_became_peered":"2021-02-27T14:25:58.351588+0000","last_unstale":"2021-02-27T14:26:50.439291+0000","last_undegraded":"2021-02-27T14:26:50.439291+0000","last_fullsized":"2021-02-27T14:26:50.439291+0000","mapping_epoch":20,"log_start":"35'144","ondisk_log_start":"35'144","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3966485,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":93,"num_read_kb":31,"num_write":176,"num_write_kb":135402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":30,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"67","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.929049+0000","last_change":"2021-02-27T14:26:35.328699+0000","last_active":"2021-02-27T14:26:49.929049+0000","last_peered":"2021-02-27T14:26:49.929049+0000","last_clean":"2021-02-27T14:26:49.929049+0000","last_became_active":"2021-02-27T14:26:35.328282+0000","last_became_peered":"2021-02-27T14:26:35.328282+0000","last_unstale":"2021-02-27T14:26:49.929049+0000","last_undegraded":"2021-02-27T14:26:49.929049+0000","last_fullsized":"2021-02-27T14:26:49.929049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'463","reported_seq":"806","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495655+0000","last_change":"2021-02-27T14:25:57.344070+0000","last_active":"2021-02-27T14:26:49.495655+0000","last_peered":"2021-02-27T14:26:49.495655+0000","last_clean":"2021-02-27T14:26:49.495655+0000","last_became_active":"2021-02-27T14:25:57.343539+0000","last_became_peered":"2021-02-27T14:25:57.343539+0000","last_unstale":"2021-02-27T14:26:49.495655+0000","last_undegraded":"2021-02-27T14:26:49.495655+0000","last_fullsized":"2021-02-27T14:26:49.495655+0000","mapping_epoch":19,"log_start":"39'460","ondisk_log_start":"39'460","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":729568321,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":437,"num_read_kb":278382,"num_write":522,"num_write_kb":797260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"36'169","reported_seq":"530","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239129+0000","last_change":"2021-02-27T14:26:47.482864+0000","last_active":"2021-02-27T14:26:50.239129+0000","last_peered":"2021-02-27T14:26:50.239129+0000","last_clean":"2021-02-27T14:26:50.239129+0000","last_became_active":"2021-02-27T14:26:47.482458+0000","last_became_peered":"2021-02-27T14:26:47.482458+0000","last_unstale":"2021-02-27T14:26:50.239129+0000","last_undegraded":"2021-02-27T14:26:50.239129+0000","last_fullsized":"2021-02-27T14:26:50.239129+0000","mapping_epoch":53,"log_start":"36'167","ondisk_log_start":"36'167","created":20,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12386792,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":108,"num_read_kb":35,"num_write":197,"num_write_kb":145986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":59345993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":32,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"72","reported_epoch":"57","state":"active+clean","last_fresh":"2021-02-27T14:26:51.403760+0000","last_change":"2021-02-27T14:26:51.403760+0000","last_active":"2021-02-27T14:26:51.403760+0000","last_peered":"2021-02-27T14:26:51.403760+0000","last_clean":"2021-02-27T14:26:51.403760+0000","last_became_active":"2021-02-27T14:26:35.327288+0000","last_became_peered":"2021-02-27T14:26:35.327288+0000","last_unstale":"2021-02-27T14:26:51.403760+0000","last_undegraded":"2021-02-27T14:26:51.403760+0000","last_fullsized":"2021-02-27T14:26:51.403760+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:51.403609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:26:51.403609+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"60","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495557+0000","last_change":"2021-02-27T14:26:48.910549+0000","last_active":"2021-02-27T14:26:49.495557+0000","last_peered":"2021-02-27T14:26:49.495557+0000","last_clean":"2021-02-27T14:26:49.495557+0000","last_became_active":"2021-02-27T14:25:37.806159+0000","last_became_peered":"2021-02-27T14:25:37.806159+0000","last_unstale":"2021-02-27T14:26:49.495557+0000","last_undegraded":"2021-02-27T14:26:49.495557+0000","last_fullsized":"2021-02-27T14:26:49.495557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:48.910322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:26:48.910322+0000","last_clean_scrub_stamp":"2021-02-27T14:26:48.910322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"38'452","reported_seq":"1276","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490218+0000","last_change":"2021-02-27T14:26:44.349481+0000","last_active":"2021-02-27T14:26:48.490218+0000","last_peered":"2021-02-27T14:26:48.490218+0000","last_clean":"2021-02-27T14:26:48.490218+0000","last_became_active":"2021-02-27T14:26:44.348778+0000","last_became_peered":"2021-02-27T14:26:44.348778+0000","last_unstale":"2021-02-27T14:26:48.490218+0000","last_undegraded":"2021-02-27T14:26:48.490218+0000","last_fullsized":"2021-02-27T14:26:48.490218+0000","mapping_epoch":50,"log_start":"38'450","ondisk_log_start":"38'450","created":19,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":750946429,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":0,"num_read":431,"num_read_kb":309278,"num_write":506,"num_write_kb":818046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":743296267,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"38'168","reported_seq":"359","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495861+0000","last_change":"2021-02-27T14:25:58.345979+0000","last_active":"2021-02-27T14:26:49.495861+0000","last_peered":"2021-02-27T14:26:49.495861+0000","last_clean":"2021-02-27T14:26:49.495861+0000","last_became_active":"2021-02-27T14:25:58.345472+0000","last_became_peered":"2021-02-27T14:25:58.345472+0000","last_unstale":"2021-02-27T14:26:49.495861+0000","last_undegraded":"2021-02-27T14:26:49.495861+0000","last_fullsized":"2021-02-27T14:26:49.495861+0000","mapping_epoch":20,"log_start":"36'165","ondisk_log_start":"36'165","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12554928,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":108,"num_read_kb":36,"num_write":195,"num_write_kb":150294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":32,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.238812+0000","last_change":"2021-02-27T14:25:39.889728+0000","last_active":"2021-02-27T14:26:50.238812+0000","last_peered":"2021-02-27T14:26:50.238812+0000","last_clean":"2021-02-27T14:26:50.238812+0000","last_became_active":"2021-02-27T14:25:39.888095+0000","last_became_peered":"2021-02-27T14:25:39.888095+0000","last_unstale":"2021-02-27T14:26:50.238812+0000","last_undegraded":"2021-02-27T14:26:50.238812+0000","last_fullsized":"2021-02-27T14:26:50.238812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"39'417","reported_seq":"1718","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439010+0000","last_change":"2021-02-27T14:26:48.511335+0000","last_active":"2021-02-27T14:26:50.439010+0000","last_peered":"2021-02-27T14:26:50.439010+0000","last_clean":"2021-02-27T14:26:50.439010+0000","last_became_active":"2021-02-27T14:26:48.509468+0000","last_became_peered":"2021-02-27T14:26:48.509468+0000","last_unstale":"2021-02-27T14:26:50.439010+0000","last_undegraded":"2021-02-27T14:26:50.439010+0000","last_fullsized":"2021-02-27T14:26:50.439010+0000","mapping_epoch":54,"log_start":"39'414","ondisk_log_start":"39'414","created":19,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":678557327,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":371,"num_read_kb":249483,"num_write":468,"num_write_kb":730685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":1201512642,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"38'141","reported_seq":"481","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439150+0000","last_change":"2021-02-27T14:26:43.345466+0000","last_active":"2021-02-27T14:26:50.439150+0000","last_peered":"2021-02-27T14:26:50.439150+0000","last_clean":"2021-02-27T14:26:50.439150+0000","last_became_active":"2021-02-27T14:26:43.344981+0000","last_became_peered":"2021-02-27T14:26:43.344981+0000","last_unstale":"2021-02-27T14:26:50.439150+0000","last_undegraded":"2021-02-27T14:26:50.439150+0000","last_fullsized":"2021-02-27T14:26:50.439150+0000","mapping_epoch":49,"log_start":"36'138","ondisk_log_start":"36'138","created":20,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5663893,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":94,"num_read_kb":31,"num_write":168,"num_write_kb":120553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":44113101,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":29,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"46","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.497042+0000","last_change":"2021-02-27T14:26:18.662588+0000","last_active":"2021-02-27T14:26:49.497042+0000","last_peered":"2021-02-27T14:26:49.497042+0000","last_clean":"2021-02-27T14:26:49.497042+0000","last_became_active":"2021-02-27T14:26:18.662126+0000","last_became_peered":"2021-02-27T14:26:18.662126+0000","last_unstale":"2021-02-27T14:26:49.497042+0000","last_undegraded":"2021-02-27T14:26:49.497042+0000","last_fullsized":"2021-02-27T14:26:49.497042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"24","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490537+0000","last_change":"2021-02-27T14:26:35.327952+0000","last_active":"2021-02-27T14:26:48.490537+0000","last_peered":"2021-02-27T14:26:48.490537+0000","last_clean":"2021-02-27T14:26:48.490537+0000","last_became_active":"2021-02-27T14:26:35.327515+0000","last_became_peered":"2021-02-27T14:26:35.327515+0000","last_unstale":"2021-02-27T14:26:48.490537+0000","last_undegraded":"2021-02-27T14:26:48.490537+0000","last_fullsized":"2021-02-27T14:26:48.490537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'149","reported_seq":"402","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490166+0000","last_change":"2021-02-27T14:26:38.418326+0000","last_active":"2021-02-27T14:26:48.490166+0000","last_peered":"2021-02-27T14:26:48.490166+0000","last_clean":"2021-02-27T14:26:48.490166+0000","last_became_active":"2021-02-27T14:26:38.417842+0000","last_became_peered":"2021-02-27T14:26:38.417842+0000","last_unstale":"2021-02-27T14:26:48.490166+0000","last_undegraded":"2021-02-27T14:26:48.490166+0000","last_fullsized":"2021-02-27T14:26:48.490166+0000","mapping_epoch":44,"log_start":"39'147","ondisk_log_start":"39'147","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11344824,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":96,"num_read_kb":33,"num_write":173,"num_write_kb":132509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":11344824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239305+0000","last_change":"2021-02-27T14:25:39.889476+0000","last_active":"2021-02-27T14:26:50.239305+0000","last_peered":"2021-02-27T14:26:50.239305+0000","last_clean":"2021-02-27T14:26:50.239305+0000","last_became_active":"2021-02-27T14:25:39.887704+0000","last_became_peered":"2021-02-27T14:25:39.887704+0000","last_unstale":"2021-02-27T14:26:50.239305+0000","last_undegraded":"2021-02-27T14:26:50.239305+0000","last_fullsized":"2021-02-27T14:26:50.239305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'127","reported_seq":"286","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.276786+0000","last_change":"2021-02-27T14:25:58.364236+0000","last_active":"2021-02-27T14:26:50.276786+0000","last_peered":"2021-02-27T14:26:50.276786+0000","last_clean":"2021-02-27T14:26:50.276786+0000","last_became_active":"2021-02-27T14:25:58.363827+0000","last_became_peered":"2021-02-27T14:25:58.363827+0000","last_unstale":"2021-02-27T14:26:50.276786+0000","last_undegraded":"2021-02-27T14:26:50.276786+0000","last_fullsized":"2021-02-27T14:26:50.276786+0000","mapping_epoch":20,"log_start":"35'124","ondisk_log_start":"35'124","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2336305,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":84,"num_read_kb":28,"num_write":153,"num_write_kb":115605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":152290174,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":1571,"num_read_kb":87796,"num_write":2785,"num_write_kb":2110534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":282,"num_bytes_recovered":154592900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":449,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":452665344,"data_stored":452336373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":2923968184,"num_objects":988,"num_object_clones":0,"num_object_copies":2964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":988,"num_whiteouts":0,"num_read":1613,"num_read_kb":1083526,"num_write":1954,"num_write_kb":3160912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":922,"num_bytes_recovered":2704850515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9436385280,"data_stored":9429049195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1121388,"kb_used_data":1096548,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":93250452,"statfs":{"total":96636764160,"available":95488462848,"internally_reserved":0,"allocated":1122865152,"data_stored":1121563473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":4.7510000000000003,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":1.266},{"interface":"front","average":{"1min":1.633,"5min":1.633,"15min":1.633},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":1.4399999999999999}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.7749999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":3.1890000000000001},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":1.6599999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":2.161,"15min":2.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":2.1059999999999999},{"interface":"front","average":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"min":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":2.1480000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":2.621}]},{"osd":4,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.2410000000000001,"5min":3.2410000000000001,"15min":3.2410000000000001},"last":2.3879999999999999},{"interface":"front","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.78}]},{"osd":5,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"max":{"1min":5.7290000000000001,"5min":5.7290000000000001,"15min":5.7290000000000001},"last":2.2320000000000002},{"interface":"front","average":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":5.0090000000000003,"5min":5.0090000000000003,"15min":5.0090000000000003},"last":2.8239999999999998}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"min":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":2.609},{"interface":"front","average":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"min":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"max":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"last":3.2770000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704444,"kb_used_data":689332,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":93667396,"statfs":{"total":96636764160,"available":95915413504,"internally_reserved":0,"allocated":705875968,"data_stored":704938802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":2.855},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.599}]},{"osd":1,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.863,"5min":1.863,"15min":1.863},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.7},{"interface":"front","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":1.782}]},{"osd":2,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.294,"15min":2.294},"min":{"1min":1.321,"5min":1.321,"15min":1.321},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":3.4409999999999998},{"interface":"front","average":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":3.0960000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"min":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":3.359},{"interface":"front","average":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"min":{"1min":1.46,"5min":1.46,"15min":1.46},"max":{"1min":3.5139999999999998,"5min":3.5139999999999998,"15min":3.5139999999999998},"last":2.4430000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.581,"5min":2.581,"15min":2.581},"min":{"1min":1.421,"5min":1.421,"15min":1.421},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":2.1059999999999999},{"interface":"front","average":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":2.7679999999999998}]},{"osd":5,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.351,"5min":2.351,"15min":2.351},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":2.1819999999999999},{"interface":"front","average":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"min":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":3.7770000000000001}]},{"osd":7,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":3.097,"15min":3.097},"min":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":2.3380000000000001},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"max":{"1min":4.2249999999999996,"5min":4.2249999999999996,"15min":4.2249999999999996},"last":3.1789999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2206336,"kb_used_data":2176120,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":92165504,"statfs":{"total":96636764160,"available":94377476096,"internally_reserved":0,"allocated":2228346880,"data_stored":2226283422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.032,"5min":3.032,"15min":3.032},"last":10.554}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1},{"interface":"front","average":{"1min":1.76,"5min":1.76,"15min":1.76},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":11.089}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.869,"15min":1.869},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":13.345000000000001},{"interface":"front","average":{"1min":2.278,"5min":2.278,"15min":2.278},"min":{"1min":1.371,"5min":1.371,"15min":1.371},"max":{"1min":3.2869999999999999,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":13.728}]},{"osd":3,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":13.956},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":11.874000000000001}]},{"osd":5,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":12.587},{"interface":"front","average":{"1min":2.544,"5min":2.544,"15min":2.544},"min":{"1min":1.47,"5min":1.47,"15min":1.47},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":14.151}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"min":{"1min":1.343,"5min":1.343,"15min":1.343},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":13.231999999999999},{"interface":"front","average":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"min":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.968,"5min":3.968,"15min":3.968},"last":12.519}]},{"osd":7,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.899,"5min":2.899,"15min":2.899},"min":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"max":{"1min":4.0270000000000001,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":15.246},{"interface":"front","average":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":13.007}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751808,"kb_used_data":726328,"kb_used_omap":0,"kb_used_meta":25472,"kb_avail":93620032,"statfs":{"total":96636764160,"available":95866912768,"internally_reserved":0,"allocated":743759872,"data_stored":742842622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26083328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.26},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.6890000000000001}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.849,"15min":1.849},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.401},{"interface":"front","average":{"1min":1.823,"5min":1.823,"15min":1.823},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.448}]},{"osd":4,"last update":"Sat Feb 27 14:26:35 2021","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.631},{"interface":"front","average":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":10.196999999999999,"5min":10.196999999999999,"15min":10.196999999999999},"last":2.0139999999999998}]},{"osd":5,"last update":"Sat Feb 27 14:26:35 2021","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":2.2490000000000001},{"interface":"front","average":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"min":{"1min":1.181,"5min":1.181,"15min":1.181},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":2.29}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.944},{"interface":"front","average":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"min":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"max":{"1min":9.7490000000000006,"5min":9.7490000000000006,"15min":9.7490000000000006},"last":2.3359999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.784},{"interface":"front","average":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":2.5089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752812,"kb_used_data":737508,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":93619028,"statfs":{"total":96636764160,"available":95865884672,"internally_reserved":0,"allocated":755208192,"data_stored":754170139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":2.669},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.3490000000000002,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.484}]},{"osd":1,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":1.702,"15min":1.702},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.627},{"interface":"front","average":{"1min":1.883,"5min":1.883,"15min":1.883},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":2.036}]},{"osd":2,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.97,"15min":1.97},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":3.0409999999999999},{"interface":"front","average":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":3.2309999999999999}]},{"osd":3,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":1.915,"15min":1.915},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":2.1549999999999998},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":2.2250000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":2.456},{"interface":"front","average":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.6739999999999999,"5min":3.6739999999999999,"15min":3.6739999999999999},"last":1.5489999999999999}]},{"osd":6,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":4.0570000000000004,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":2.9900000000000002},{"interface":"front","average":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":2.5539999999999998}]},{"osd":7,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":6.0410000000000004,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":2.8660000000000001},{"interface":"front","average":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"min":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":3.516}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1508788,"kb_used_data":1490412,"kb_used_omap":0,"kb_used_meta":18368,"kb_avail":92863052,"statfs":{"total":96636764160,"available":95091765248,"internally_reserved":0,"allocated":1526181888,"data_stored":1524684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18808832},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.3959999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.871},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.26}]},{"osd":3,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.3799999999999999},{"interface":"front","average":{"1min":1.901,"5min":1.901,"15min":1.901},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":2.3130000000000002}]},{"osd":4,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.5830000000000002,"5min":3.5830000000000002,"15min":3.5830000000000002},"last":1.831},{"interface":"front","average":{"1min":2.085,"5min":2.085,"15min":2.085},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.984}]},{"osd":5,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":4.1950000000000003,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":2.1259999999999999},{"interface":"front","average":{"1min":2.109,"5min":2.109,"15min":2.109},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":2.218}]},{"osd":6,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"min":{"1min":1.123,"5min":1.123,"15min":1.123},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":2.657},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":1.353,"5min":1.353,"15min":1.353},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":2.4409999999999998}]},{"osd":7,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"min":{"1min":1.542,"5min":1.542,"15min":1.542},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":2.726},{"interface":"front","average":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"min":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":2.6179999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126688,"kb_used_data":109592,"kb_used_omap":0,"kb_used_meta":17088,"kb_avail":94245152,"statfs":{"total":96636764160,"available":96507035648,"internally_reserved":0,"allocated":112222208,"data_stored":111765477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17498112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":1.3200000000000001},{"interface":"front","average":{"1min":2.012,"5min":2.012,"15min":2.012},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":7.3380000000000001,"5min":7.3380000000000001,"15min":7.3380000000000001},"last":1.7729999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":6.8230000000000004,"5min":6.8230000000000004,"15min":6.8230000000000004},"last":1.3979999999999999},{"interface":"front","average":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"min":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"max":{"1min":5.7990000000000004,"5min":5.7990000000000004,"15min":5.7990000000000004},"last":1.827}]},{"osd":3,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.556},{"interface":"front","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":6.4950000000000001,"5min":6.4950000000000001,"15min":6.4950000000000001},"last":1.3600000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.905},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"min":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":2.379}]},{"osd":5,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":5.9550000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"min":{"1min":1.526,"5min":1.526,"15min":1.526},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":2.649}]},{"osd":6,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":2.677,"15min":2.677},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":5.2300000000000004,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":2.4740000000000002},{"interface":"front","average":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"min":{"1min":1.248,"5min":1.248,"15min":1.248},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":2.8679999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.573,"15min":2.573},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":3.573,"5min":3.573,"15min":3.573},"last":2.5670000000000002},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"min":{"1min":1.329,"5min":1.329,"15min":1.329},"max":{"1min":5.4039999999999999,"5min":5.4039999999999999,"15min":5.4039999999999999},"last":2.806}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2921908,"kb_used_data":2884844,"kb_used_omap":0,"kb_used_meta":37056,"kb_avail":91449932,"statfs":{"total":96636764160,"available":93644730368,"internally_reserved":0,"allocated":2954080256,"data_stored":2951390709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37945344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.5680000000000001}]},{"osd":1,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.2010000000000001,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":3.2610000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.905,"5min":1.905,"15min":1.905},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":3.254}]},{"osd":4,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":2.956},{"interface":"front","average":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"min":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":1.7849999999999999}]},{"osd":5,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.907,"15min":1.907},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":2.1970000000000001},{"interface":"front","average":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":3.746,"5min":3.746,"15min":3.746},"last":3.4279999999999999}]},{"osd":6,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"min":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.9850000000000001},{"interface":"front","average":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":2.5169999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"min":{"1min":1.607,"5min":1.607,"15min":1.607},"max":{"1min":3.8660000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":2.258},{"interface":"front","average":{"1min":2.29,"5min":2.29,"15min":2.29},"min":{"1min":1.268,"5min":1.268,"15min":1.268},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":2.879}]}]}]}}
, 2021-02-27T14:26:56.742 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json

2021-02-28T06:28:14.132 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:27:04.554 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2021-02-27T14:25:57.309134+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=57, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:27:04.555 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-27T14:25:38.659383+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=38, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:27:04.555 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-02-27T14:25:56.298657+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=56, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:14.133 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:27:46.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com
, 2021-02-27T14:27:46.994 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1
, 2021-02-27T14:27:47.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com

2021-02-28T06:28:14.134 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:28:11.242 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72      3 u   53   64   37    0.132   -1.851   7.599
, 2021-02-27T14:28:11.242 INFO:teuthology.orchestra.run.smithi184.stdout:*hv04.front.sepi 144.172.126.201  3 u   55   64   37    0.115   -0.691   8.440
, 2021-02-27T14:28:11.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab

2021-02-28T06:28:14.191 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7feef7faf79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7feef7faf978]

2021-02-28T06:28:14.192 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.695 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:10.373169+0000",
, 2021-02-27T14:26:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 6.3250000000000006e-05

2021-02-28T06:28:14.193 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "age": 17.958649700999999,
, 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.15429325599999999,
, 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {

2021-02-28T06:28:14.194 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.762 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.763 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "throttled",
, 2021-02-27T14:26:31.763 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.681551+0000",

2021-02-28T06:28:14.195 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.797 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.797 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:31.798 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.688773+0000",

2021-02-28T06:28:14.195 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.837 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.838 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:31.838 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.829044+0000",

2021-02-28T06:28:14.196 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.877 INFO:teuthology.orchestra.run.smithi119.stdout:            "initiated_at": "2021-02-27T14:26:13.693999+0000",
, 2021-02-27T14:26:31.877 INFO:teuthology.orchestra.run.smithi119.stdout:            "age": 17.934994554999999,
, 2021-02-27T14:26:31.878 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.134263781,

2021-02-28T06:28:14.196 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.903 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:31.904 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.904 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.197 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.934 INFO:teuthology.orchestra.run.smithi119.stdout:                    }
, 2021-02-27T14:26:31.935 INFO:teuthology.orchestra.run.smithi119.stdout:                ]
, 2021-02-27T14:26:31.935 INFO:teuthology.orchestra.run.smithi119.stdout:            }

2021-02-28T06:28:14.198 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.978 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 8.3229999999999998e-06
, 2021-02-27T14:26:31.979 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:31.979 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.198 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.032 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 3.4638000000000003e-05
, 2021-02-27T14:26:32.033 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.033 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.199 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.844478+0000",
, 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.666e-05
, 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.200 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.226890+0000",
, 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00028260299999999998
, 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.200 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.159 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.326699+0000",
, 2021-02-27T14:26:32.159 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.008482669
, 2021-02-27T14:26:32.160 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.201 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.457702+0000",
, 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00012408100000000001
, 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.201 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.12518553299999999,
, 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {
, 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:14.202 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 479, in wait
,     proc.wait()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 161, in wait

2021-02-28T06:28:14.203 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.699 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.700 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "done",
, 2021-02-27T14:26:32.700 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.672717+0000",

2021-02-28T06:28:14.203 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:14.204 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.756 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0
, 2021-02-27T14:26:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.204 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.789 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.000113101
, 2021-02-27T14:26:32.790 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.790 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.205 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.692336+0000",
, 2021-02-27T14:26:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.0087e-05
, 2021-02-27T14:26:32.825 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.206 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "initiated",
, 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.714193+0000",
, 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0

2021-02-28T06:28:14.206 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.882 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:32.883 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.836489+0000",
, 2021-02-27T14:26:32.883 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00010335700000000001

2021-02-28T06:28:14.207 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.911 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.912 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "dispatched",
, 2021-02-27T14:26:32.912 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.866924+0000",

2021-02-28T06:28:14.207 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.936 INFO:teuthology.orchestra.run.smithi119.stdout:                "events": [
, 2021-02-27T14:26:32.937 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.937 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "initiated",

2021-02-28T06:28:14.208 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.960 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.961 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.961 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.209 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.985 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.8258e-05
, 2021-02-27T14:26:32.986 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.986 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.209 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {
, 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:                "events": [

2021-02-28T06:28:14.210 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.844 INFO:teuthology.orchestra.run.smithi184.stdout:            "duration": 0.43877463,
, 2021-02-27T14:26:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:            "type_data": {
, 2021-02-27T14:26:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:14.211 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.875 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",
, 2021-02-27T14:26:33.876 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.451200+0000",
, 2021-02-27T14:26:33.876 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999461

2021-02-28T06:28:14.211 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "dispatched",
, 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.513806+0000",
, 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.0450000000000001e-06

2021-02-28T06:28:14.212 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "started",
, 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.683468+0000",
, 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.011857326

2021-02-28T06:28:14.212 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "op_commit",
, 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.727028+0000",
, 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.103888732

2021-02-28T06:28:14.213 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",
, 2021-02-27T14:26:34.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.966617+0000",
, 2021-02-27T14:26:34.004 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.134253861

2021-02-28T06:28:14.214 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.031 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client": "client.4472",
, 2021-02-27T14:26:34.031 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",
, 2021-02-27T14:26:34.032 INFO:teuthology.orchestra.run.smithi184.stdout:                    "tid": 2731

2021-02-28T06:28:14.214 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.062 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.063 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "header_read",
, 2021-02-27T14:26:34.063 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.337296+0000",

2021-02-28T06:28:14.215 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.338540+0000",

2021-02-28T06:28:14.215 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for subops from 2,7",
, 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.372046+0000",

2021-02-28T06:28:14.216 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.462711+0000",

2021-02-28T06:28:14.216 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.205 INFO:teuthology.orchestra.run.smithi184.stdout:                ]
, 2021-02-27T14:26:34.208 INFO:teuthology.orchestra.run.smithi184.stdout:            }
, 2021-02-27T14:26:34.208 INFO:teuthology.orchestra.run.smithi184.stdout:        },

2021-02-28T06:28:14.217 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.241 INFO:teuthology.orchestra.run.smithi184.stdout:                "events": [
, 2021-02-27T14:26:34.242 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.242 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "initiated",

2021-02-28T06:28:14.218 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.265 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "all_read",

2021-02-28T06:28:14.218 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.219 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "op_commit",

2021-02-28T06:28:14.219 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.220 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.372 INFO:teuthology.orchestra.run.smithi184.stdout:}
, 2021-02-27T14:26:34.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight
, marked in osd.4.

2021-02-28T06:28:14.221 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                "client_info": {
, 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client": "client.4472",
, 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",

2021-02-28T06:28:14.221 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for peered",

2021-02-28T06:28:14.222 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.837 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.837 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.838 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.222 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.862 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.5663999999999998e-05
, 2021-02-27T14:26:34.862 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.863 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.223 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.041298841000000003
, 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.224 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.079475975000000004
, 2021-02-27T14:26:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.909 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.224 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 1.3969e-05
, 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.225 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.955 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 1.0544368580000001
, 2021-02-27T14:26:34.956 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.956 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.226 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:            "type_data": {
, 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:                "flag_point": "reached pg",
, 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:                "client_info": {

2021-02-28T06:28:14.226 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.671657+0000",
, 2021-02-27T14:26:35.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.000100437
, 2021-02-27T14:26:35.004 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.227 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",
, 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                    "tid": 2853
, 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                },

2021-02-28T06:28:14.228 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",
, 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.708811+0000",
, 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.7909999999999993e-06

2021-02-28T06:28:14.228 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.072 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.073 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "initiated",
, 2021-02-27T14:26:35.073 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.808525+0000",

2021-02-28T06:28:14.229 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for peered",
, 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.809491+0000",

2021-02-28T06:28:14.229 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.514 INFO:teuthology.orchestra.run.smithi184.stdout:    "size": 20,
, 2021-02-27T14:26:35.515 INFO:teuthology.orchestra.run.smithi184.stdout:    "duration": 600,
, 2021-02-27T14:26:35.515 INFO:teuthology.orchestra.run.smithi184.stdout:    "ops": [

2021-02-28T06:28:14.230 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.587 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.588 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.588 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.231 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.627 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999681
, 2021-02-27T14:26:35.628 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.628 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.231 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.672 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.035520544000000001
, 2021-02-27T14:26:35.672 INFO:teuthology.orchestra.run.smithi184.stdout:                    }
, 2021-02-27T14:26:35.673 INFO:teuthology.orchestra.run.smithi184.stdout:                ]

2021-02-28T06:28:14.232 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.585295+0000",
, 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.0040886719999999998
, 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.232 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",
, 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.170647+0000",
, 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999375

2021-02-28T06:28:14.233 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.795 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",
, 2021-02-27T14:26:35.796 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.219423+0000",
, 2021-02-27T14:26:35.797 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.041800245999999999

2021-02-28T06:28:14.233 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.853 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.854 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:35.854 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.183462+0000",

2021-02-28T06:28:14.234 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",

2021-02-28T06:28:14.235 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",

2021-02-28T06:28:14.235 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.949 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 9.3360000000000001e-06
, 2021-02-27T14:26:35.950 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.950 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.236 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.972 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.484131+0000",
, 2021-02-27T14:26:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0
, 2021-02-27T14:26:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.236 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.999 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.525757+0000",
, 2021-02-27T14:26:35.999 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 5.6601000000000002e-05
, 2021-02-27T14:26:36.000 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.239 WARNING:scrape:Ignoring malparsed backtrace: dumped all
, 2021-02-27T14:26:56.738 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2021-02-27T14:26:55.619324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3076258358,"num_objects":1488,"num_object_clones":0,"num_object_copies":4464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1488,"num_whiteouts":0,"num_read":3184,"num_read_kb":1171322,"num_write":4739,"num_write_kb":5271446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1204,"num_bytes_recovered":2859443415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":449,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":87,"acting":87,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10094172,"kb_used_data":9910684,"kb_used_omap":0,"kb_used_meta":183424,"kb_avail":744880548,"statfs":{"total":773094113280,"available":762757681152,"internally_reserved":0,"allocated":10148540416,"data_stored":10137639078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187826176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139010"},"pg_stats":[{"pgid":"4.f","version":"38'109","reported_seq":"321","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.929471+0000","last_change":"2021-02-27T14:26:39.420528+0000","last_active":"2021-02-27T14:26:49.929471+0000","last_peered":"2021-02-27T14:26:49.929471+0000","last_clean":"2021-02-27T14:26:49.929471+0000","last_became_active":"2021-02-27T14:26:39.420082+0000","last_became_peered":"2021-02-27T14:26:39.420082+0000","last_unstale":"2021-02-27T14:26:49.929471+0000","last_undegraded":"2021-02-27T14:26:49.929471+0000","last_fullsized":"2021-02-27T14:26:49.929471+0000","mapping_epoch":45,"log_start":"35'106","ondisk_log_start":"35'106","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3798481,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":72,"num_read_kb":24,"num_write":131,"num_write_kb":99470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":3798481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":23,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'203","reported_seq":"423","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.277085+0000","last_change":"2021-02-27T14:25:58.360562+0000","last_active":"2021-02-27T14:26:50.277085+0000","last_peered":"2021-02-27T14:26:50.277085+0000","last_clean":"2021-02-27T14:26:50.277085+0000","last_became_active":"2021-02-27T14:25:58.359615+0000","last_became_peered":"2021-02-27T14:25:58.359615+0000","last_unstale":"2021-02-27T14:26:50.277085+0000","last_undegraded":"2021-02-27T14:26:50.277085+0000","last_fullsized":"2021-02-27T14:26:50.277085+0000","mapping_epoch":20,"log_start":"37'200","ondisk_log_start":"37'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11260855,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":138,"num_read_kb":16691,"num_write":238,"num_write_kb":184324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":38,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'135","reported_seq":"294","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239249+0000","last_change":"2021-02-27T14:25:58.358332+0000","last_active":"2021-02-27T14:26:50.239249+0000","last_peered":"2021-02-27T14:26:50.239249+0000","last_clean":"2021-02-27T14:26:50.239249+0000","last_became_active":"2021-02-27T14:25:58.356582+0000","last_became_peered":"2021-02-27T14:25:58.356582+0000","last_unstale":"2021-02-27T14:26:50.239249+0000","last_undegraded":"2021-02-27T14:26:50.239249+0000","last_fullsized":"2021-02-27T14:26:50.239249+0000","mapping_epoch":20,"log_start":"38'132","ondisk_log_start":"38'132","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16571801,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":90,"num_read_kb":12047,"num_write":151,"num_write_kb":119395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":22,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"38'146","reported_seq":"397","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495109+0000","last_change":"2021-02-27T14:26:38.418145+0000","last_active":"2021-02-27T14:26:49.495109+0000","last_peered":"2021-02-27T14:26:49.495109+0000","last_clean":"2021-02-27T14:26:49.495109+0000","last_became_active":"2021-02-27T14:26:38.417490+0000","last_became_peered":"2021-02-27T14:26:38.417490+0000","last_unstale":"2021-02-27T14:26:49.495109+0000","last_undegraded":"2021-02-27T14:26:49.495109+0000","last_fullsized":"2021-02-27T14:26:49.495109+0000","mapping_epoch":44,"log_start":"36'143","ondisk_log_start":"36'143","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11462506,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":92,"num_read_kb":32,"num_write":169,"num_write_kb":129234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":11462506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":26,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"38'152","reported_seq":"418","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495750+0000","last_change":"2021-02-27T14:26:38.418219+0000","last_active":"2021-02-27T14:26:49.495750+0000","last_peered":"2021-02-27T14:26:49.495750+0000","last_clean":"2021-02-27T14:26:49.495750+0000","last_became_active":"2021-02-27T14:26:38.417606+0000","last_became_peered":"2021-02-27T14:26:38.417606+0000","last_unstale":"2021-02-27T14:26:49.495750+0000","last_undegraded":"2021-02-27T14:26:49.495750+0000","last_fullsized":"2021-02-27T14:26:49.495750+0000","mapping_epoch":44,"log_start":"38'149","ondisk_log_start":"38'149","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12840680,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":107,"num_read_kb":11857,"num_write":175,"num_write_kb":123916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":12073777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"36'190","reported_seq":"396","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.276884+0000","last_change":"2021-02-27T14:25:58.361631+0000","last_active":"2021-02-27T14:26:50.276884+0000","last_peered":"2021-02-27T14:26:50.276884+0000","last_clean":"2021-02-27T14:26:50.276884+0000","last_became_active":"2021-02-27T14:25:58.359858+0000","last_became_peered":"2021-02-27T14:25:58.359858+0000","last_unstale":"2021-02-27T14:26:50.276884+0000","last_undegraded":"2021-02-27T14:26:50.276884+0000","last_fullsized":"2021-02-27T14:26:50.276884+0000","mapping_epoch":20,"log_start":"36'187","ondisk_log_start":"36'187","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16067657,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":122,"num_read_kb":41,"num_write":221,"num_write_kb":166857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":35,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"38'157","reported_seq":"412","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.494919+0000","last_change":"2021-02-27T14:26:38.420332+0000","last_active":"2021-02-27T14:26:49.494919+0000","last_peered":"2021-02-27T14:26:49.494919+0000","last_clean":"2021-02-27T14:26:49.494919+0000","last_became_active":"2021-02-27T14:26:38.419573+0000","last_became_peered":"2021-02-27T14:26:38.419573+0000","last_unstale":"2021-02-27T14:26:49.494919+0000","last_undegraded":"2021-02-27T14:26:49.494919+0000","last_fullsized":"2021-02-27T14:26:49.494919+0000","mapping_epoch":44,"log_start":"35'154","ondisk_log_start":"35'154","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12454218,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":94,"num_read_kb":32,"num_write":181,"num_write_kb":137358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":12454218,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'118","reported_seq":"260","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239025+0000","last_change":"2021-02-27T14:25:58.359214+0000","last_active":"2021-02-27T14:26:50.239025+0000","last_peered":"2021-02-27T14:26:50.239025+0000","last_clean":"2021-02-27T14:26:50.239025+0000","last_became_active":"2021-02-27T14:25:58.358653+0000","last_became_peered":"2021-02-27T14:25:58.358653+0000","last_unstale":"2021-02-27T14:26:50.239025+0000","last_undegraded":"2021-02-27T14:26:50.239025+0000","last_fullsized":"2021-02-27T14:26:50.239025+0000","mapping_epoch":20,"log_start":"36'115","ondisk_log_start":"36'115","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8638996,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":72,"num_read_kb":24,"num_write":136,"num_write_kb":111476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":21,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"54","reported_epoch":"57","state":"active+clean","last_fresh":"2021-02-27T14:26:51.671230+0000","last_change":"2021-02-27T14:26:51.671230+0000","last_active":"2021-02-27T14:26:51.671230+0000","last_peered":"2021-02-27T14:26:51.671230+0000","last_clean":"2021-02-27T14:26:51.671230+0000","last_became_active":"2021-02-27T14:25:39.885593+0000","last_became_peered":"2021-02-27T14:25:39.885593+0000","last_unstale":"2021-02-27T14:26:51.671230+0000","last_undegraded":"2021-02-27T14:26:51.671230+0000","last_fullsized":"2021-02-27T14:26:51.671230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:51.670955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:26:51.670955+0000","last_clean_scrub_stamp":"2021-02-27T14:26:51.670955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'137","reported_seq":"304","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439030+0000","last_change":"2021-02-27T14:25:58.352218+0000","last_active":"2021-02-27T14:26:50.439030+0000","last_peered":"2021-02-27T14:26:50.439030+0000","last_clean":"2021-02-27T14:26:50.439030+0000","last_became_active":"2021-02-27T14:25:58.351397+0000","last_became_peered":"2021-02-27T14:25:58.351397+0000","last_unstale":"2021-02-27T14:26:50.439030+0000","last_undegraded":"2021-02-27T14:26:50.439030+0000","last_fullsized":"2021-02-27T14:26:50.439030+0000","mapping_epoch":20,"log_start":"35'134","ondisk_log_start":"35'134","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6806967,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":98,"num_read_kb":23476,"num_write":161,"num_write_kb":117745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"39'136","reported_seq":"303","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439197+0000","last_change":"2021-02-27T14:25:58.352355+0000","last_active":"2021-02-27T14:26:50.439197+0000","last_peered":"2021-02-27T14:26:50.439197+0000","last_clean":"2021-02-27T14:26:50.439197+0000","last_became_active":"2021-02-27T14:25:58.351733+0000","last_became_peered":"2021-02-27T14:25:58.351733+0000","last_unstale":"2021-02-27T14:26:50.439197+0000","last_undegraded":"2021-02-27T14:26:50.439197+0000","last_fullsized":"2021-02-27T14:26:50.439197+0000","mapping_epoch":20,"log_start":"36'133","ondisk_log_start":"36'133","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4134786,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":103,"num_read_kb":23378,"num_write":160,"num_write_kb":120410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":26,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239286+0000","last_change":"2021-02-27T14:25:39.886406+0000","last_active":"2021-02-27T14:26:50.239286+0000","last_peered":"2021-02-27T14:26:50.239286+0000","last_clean":"2021-02-27T14:26:50.239286+0000","last_became_active":"2021-02-27T14:25:39.885568+0000","last_became_peered":"2021-02-27T14:25:39.885568+0000","last_unstale":"2021-02-27T14:26:50.239286+0000","last_undegraded":"2021-02-27T14:26:50.239286+0000","last_fullsized":"2021-02-27T14:26:50.239286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'417","reported_seq":"1258","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495177+0000","last_change":"2021-02-27T14:26:45.344017+0000","last_active":"2021-02-27T14:26:49.495177+0000","last_peered":"2021-02-27T14:26:49.495177+0000","last_clean":"2021-02-27T14:26:49.495177+0000","last_became_active":"2021-02-27T14:26:45.343445+0000","last_became_peered":"2021-02-27T14:26:45.343445+0000","last_unstale":"2021-02-27T14:26:49.495177+0000","last_undegraded":"2021-02-27T14:26:49.495177+0000","last_fullsized":"2021-02-27T14:26:49.495177+0000","mapping_epoch":51,"log_start":"39'414","ondisk_log_start":"39'414","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":764896107,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":374,"num_read_kb":246383,"num_write":458,"num_write_kb":814921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":259,"num_bytes_recovered":760041606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'147","reported_seq":"316","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439291+0000","last_change":"2021-02-27T14:25:58.352046+0000","last_active":"2021-02-27T14:26:50.439291+0000","last_peered":"2021-02-27T14:26:50.439291+0000","last_clean":"2021-02-27T14:26:50.439291+0000","last_became_active":"2021-02-27T14:25:58.351588+0000","last_became_peered":"2021-02-27T14:25:58.351588+0000","last_unstale":"2021-02-27T14:26:50.439291+0000","last_undegraded":"2021-02-27T14:26:50.439291+0000","last_fullsized":"2021-02-27T14:26:50.439291+0000","mapping_epoch":20,"log_start":"35'144","ondisk_log_start":"35'144","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3966485,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":93,"num_read_kb":31,"num_write":176,"num_write_kb":135402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":30,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"67","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.929049+0000","last_change":"2021-02-27T14:26:35.328699+0000","last_active":"2021-02-27T14:26:49.929049+0000","last_peered":"2021-02-27T14:26:49.929049+0000","last_clean":"2021-02-27T14:26:49.929049+0000","last_became_active":"2021-02-27T14:26:35.328282+0000","last_became_peered":"2021-02-27T14:26:35.328282+0000","last_unstale":"2021-02-27T14:26:49.929049+0000","last_undegraded":"2021-02-27T14:26:49.929049+0000","last_fullsized":"2021-02-27T14:26:49.929049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'463","reported_seq":"806","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495655+0000","last_change":"2021-02-27T14:25:57.344070+0000","last_active":"2021-02-27T14:26:49.495655+0000","last_peered":"2021-02-27T14:26:49.495655+0000","last_clean":"2021-02-27T14:26:49.495655+0000","last_became_active":"2021-02-27T14:25:57.343539+0000","last_became_peered":"2021-02-27T14:25:57.343539+0000","last_unstale":"2021-02-27T14:26:49.495655+0000","last_undegraded":"2021-02-27T14:26:49.495655+0000","last_fullsized":"2021-02-27T14:26:49.495655+0000","mapping_epoch":19,"log_start":"39'460","ondisk_log_start":"39'460","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":729568321,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":437,"num_read_kb":278382,"num_write":522,"num_write_kb":797260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"36'169","reported_seq":"530","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239129+0000","last_change":"2021-02-27T14:26:47.482864+0000","last_active":"2021-02-27T14:26:50.239129+0000","last_peered":"2021-02-27T14:26:50.239129+0000","last_clean":"2021-02-27T14:26:50.239129+0000","last_became_active":"2021-02-27T14:26:47.482458+0000","last_became_peered":"2021-02-27T14:26:47.482458+0000","last_unstale":"2021-02-27T14:26:50.239129+0000","last_undegraded":"2021-02-27T14:26:50.239129+0000","last_fullsized":"2021-02-27T14:26:50.239129+0000","mapping_epoch":53,"log_start":"36'167","ondisk_log_start":"36'167","created":20,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12386792,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":108,"num_read_kb":35,"num_write":197,"num_write_kb":145986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":59345993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":32,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"72","reported_epoch":"57","state":"active+clean","last_fresh":"2021-02-27T14:26:51.403760+0000","last_change":"2021-02-27T14:26:51.403760+0000","last_active":"2021-02-27T14:26:51.403760+0000","last_peered":"2021-02-27T14:26:51.403760+0000","last_clean":"2021-02-27T14:26:51.403760+0000","last_became_active":"2021-02-27T14:26:35.327288+0000","last_became_peered":"2021-02-27T14:26:35.327288+0000","last_unstale":"2021-02-27T14:26:51.403760+0000","last_undegraded":"2021-02-27T14:26:51.403760+0000","last_fullsized":"2021-02-27T14:26:51.403760+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:51.403609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:26:51.403609+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"60","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495557+0000","last_change":"2021-02-27T14:26:48.910549+0000","last_active":"2021-02-27T14:26:49.495557+0000","last_peered":"2021-02-27T14:26:49.495557+0000","last_clean":"2021-02-27T14:26:49.495557+0000","last_became_active":"2021-02-27T14:25:37.806159+0000","last_became_peered":"2021-02-27T14:25:37.806159+0000","last_unstale":"2021-02-27T14:26:49.495557+0000","last_undegraded":"2021-02-27T14:26:49.495557+0000","last_fullsized":"2021-02-27T14:26:49.495557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:48.910322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:26:48.910322+0000","last_clean_scrub_stamp":"2021-02-27T14:26:48.910322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"38'452","reported_seq":"1276","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490218+0000","last_change":"2021-02-27T14:26:44.349481+0000","last_active":"2021-02-27T14:26:48.490218+0000","last_peered":"2021-02-27T14:26:48.490218+0000","last_clean":"2021-02-27T14:26:48.490218+0000","last_became_active":"2021-02-27T14:26:44.348778+0000","last_became_peered":"2021-02-27T14:26:44.348778+0000","last_unstale":"2021-02-27T14:26:48.490218+0000","last_undegraded":"2021-02-27T14:26:48.490218+0000","last_fullsized":"2021-02-27T14:26:48.490218+0000","mapping_epoch":50,"log_start":"38'450","ondisk_log_start":"38'450","created":19,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":750946429,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":0,"num_read":431,"num_read_kb":309278,"num_write":506,"num_write_kb":818046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":743296267,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"38'168","reported_seq":"359","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495861+0000","last_change":"2021-02-27T14:25:58.345979+0000","last_active":"2021-02-27T14:26:49.495861+0000","last_peered":"2021-02-27T14:26:49.495861+0000","last_clean":"2021-02-27T14:26:49.495861+0000","last_became_active":"2021-02-27T14:25:58.345472+0000","last_became_peered":"2021-02-27T14:25:58.345472+0000","last_unstale":"2021-02-27T14:26:49.495861+0000","last_undegraded":"2021-02-27T14:26:49.495861+0000","last_fullsized":"2021-02-27T14:26:49.495861+0000","mapping_epoch":20,"log_start":"36'165","ondisk_log_start":"36'165","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12554928,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":108,"num_read_kb":36,"num_write":195,"num_write_kb":150294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":32,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.238812+0000","last_change":"2021-02-27T14:25:39.889728+0000","last_active":"2021-02-27T14:26:50.238812+0000","last_peered":"2021-02-27T14:26:50.238812+0000","last_clean":"2021-02-27T14:26:50.238812+0000","last_became_active":"2021-02-27T14:25:39.888095+0000","last_became_peered":"2021-02-27T14:25:39.888095+0000","last_unstale":"2021-02-27T14:26:50.238812+0000","last_undegraded":"2021-02-27T14:26:50.238812+0000","last_fullsized":"2021-02-27T14:26:50.238812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"39'417","reported_seq":"1718","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439010+0000","last_change":"2021-02-27T14:26:48.511335+0000","last_active":"2021-02-27T14:26:50.439010+0000","last_peered":"2021-02-27T14:26:50.439010+0000","last_clean":"2021-02-27T14:26:50.439010+0000","last_became_active":"2021-02-27T14:26:48.509468+0000","last_became_peered":"2021-02-27T14:26:48.509468+0000","last_unstale":"2021-02-27T14:26:50.439010+0000","last_undegraded":"2021-02-27T14:26:50.439010+0000","last_fullsized":"2021-02-27T14:26:50.439010+0000","mapping_epoch":54,"log_start":"39'414","ondisk_log_start":"39'414","created":19,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":678557327,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":371,"num_read_kb":249483,"num_write":468,"num_write_kb":730685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":1201512642,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"38'141","reported_seq":"481","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439150+0000","last_change":"2021-02-27T14:26:43.345466+0000","last_active":"2021-02-27T14:26:50.439150+0000","last_peered":"2021-02-27T14:26:50.439150+0000","last_clean":"2021-02-27T14:26:50.439150+0000","last_became_active":"2021-02-27T14:26:43.344981+0000","last_became_peered":"2021-02-27T14:26:43.344981+0000","last_unstale":"2021-02-27T14:26:50.439150+0000","last_undegraded":"2021-02-27T14:26:50.439150+0000","last_fullsized":"2021-02-27T14:26:50.439150+0000","mapping_epoch":49,"log_start":"36'138","ondisk_log_start":"36'138","created":20,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5663893,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":94,"num_read_kb":31,"num_write":168,"num_write_kb":120553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":44113101,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":29,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"46","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.497042+0000","last_change":"2021-02-27T14:26:18.662588+0000","last_active":"2021-02-27T14:26:49.497042+0000","last_peered":"2021-02-27T14:26:49.497042+0000","last_clean":"2021-02-27T14:26:49.497042+0000","last_became_active":"2021-02-27T14:26:18.662126+0000","last_became_peered":"2021-02-27T14:26:18.662126+0000","last_unstale":"2021-02-27T14:26:49.497042+0000","last_undegraded":"2021-02-27T14:26:49.497042+0000","last_fullsized":"2021-02-27T14:26:49.497042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"24","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490537+0000","last_change":"2021-02-27T14:26:35.327952+0000","last_active":"2021-02-27T14:26:48.490537+0000","last_peered":"2021-02-27T14:26:48.490537+0000","last_clean":"2021-02-27T14:26:48.490537+0000","last_became_active":"2021-02-27T14:26:35.327515+0000","last_became_peered":"2021-02-27T14:26:35.327515+0000","last_unstale":"2021-02-27T14:26:48.490537+0000","last_undegraded":"2021-02-27T14:26:48.490537+0000","last_fullsized":"2021-02-27T14:26:48.490537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'149","reported_seq":"402","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490166+0000","last_change":"2021-02-27T14:26:38.418326+0000","last_active":"2021-02-27T14:26:48.490166+0000","last_peered":"2021-02-27T14:26:48.490166+0000","last_clean":"2021-02-27T14:26:48.490166+0000","last_became_active":"2021-02-27T14:26:38.417842+0000","last_became_peered":"2021-02-27T14:26:38.417842+0000","last_unstale":"2021-02-27T14:26:48.490166+0000","last_undegraded":"2021-02-27T14:26:48.490166+0000","last_fullsized":"2021-02-27T14:26:48.490166+0000","mapping_epoch":44,"log_start":"39'147","ondisk_log_start":"39'147","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11344824,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":96,"num_read_kb":33,"num_write":173,"num_write_kb":132509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":11344824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239305+0000","last_change":"2021-02-27T14:25:39.889476+0000","last_active":"2021-02-27T14:26:50.239305+0000","last_peered":"2021-02-27T14:26:50.239305+0000","last_clean":"2021-02-27T14:26:50.239305+0000","last_became_active":"2021-02-27T14:25:39.887704+0000","last_became_peered":"2021-02-27T14:25:39.887704+0000","last_unstale":"2021-02-27T14:26:50.239305+0000","last_undegraded":"2021-02-27T14:26:50.239305+0000","last_fullsized":"2021-02-27T14:26:50.239305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'127","reported_seq":"286","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.276786+0000","last_change":"2021-02-27T14:25:58.364236+0000","last_active":"2021-02-27T14:26:50.276786+0000","last_peered":"2021-02-27T14:26:50.276786+0000","last_clean":"2021-02-27T14:26:50.276786+0000","last_became_active":"2021-02-27T14:25:58.363827+0000","last_became_peered":"2021-02-27T14:25:58.363827+0000","last_unstale":"2021-02-27T14:26:50.276786+0000","last_undegraded":"2021-02-27T14:26:50.276786+0000","last_fullsized":"2021-02-27T14:26:50.276786+0000","mapping_epoch":20,"log_start":"35'124","ondisk_log_start":"35'124","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2336305,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":84,"num_read_kb":28,"num_write":153,"num_write_kb":115605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":152290174,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":1571,"num_read_kb":87796,"num_write":2785,"num_write_kb":2110534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":282,"num_bytes_recovered":154592900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":449,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":452665344,"data_stored":452336373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":2923968184,"num_objects":988,"num_object_clones":0,"num_object_copies":2964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":988,"num_whiteouts":0,"num_read":1613,"num_read_kb":1083526,"num_write":1954,"num_write_kb":3160912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":922,"num_bytes_recovered":2704850515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9436385280,"data_stored":9429049195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1121388,"kb_used_data":1096548,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":93250452,"statfs":{"total":96636764160,"available":95488462848,"internally_reserved":0,"allocated":1122865152,"data_stored":1121563473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":4.7510000000000003,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":1.266},{"interface":"front","average":{"1min":1.633,"5min":1.633,"15min":1.633},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":1.4399999999999999}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.7749999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":3.1890000000000001},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":1.6599999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":2.161,"15min":2.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":2.1059999999999999},{"interface":"front","average":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"min":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":2.1480000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":2.621}]},{"osd":4,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.2410000000000001,"5min":3.2410000000000001,"15min":3.2410000000000001},"last":2.3879999999999999},{"interface":"front","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.78}]},{"osd":5,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"max":{"1min":5.7290000000000001,"5min":5.7290000000000001,"15min":5.7290000000000001},"last":2.2320000000000002},{"interface":"front","average":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":5.0090000000000003,"5min":5.0090000000000003,"15min":5.0090000000000003},"last":2.8239999999999998}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"min":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":2.609},{"interface":"front","average":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"min":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"max":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"last":3.2770000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704444,"kb_used_data":689332,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":93667396,"statfs":{"total":96636764160,"available":95915413504,"internally_reserved":0,"allocated":705875968,"data_stored":704938802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":2.855},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.599}]},{"osd":1,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.863,"5min":1.863,"15min":1.863},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.7},{"interface":"front","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":1.782}]},{"osd":2,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.294,"15min":2.294},"min":{"1min":1.321,"5min":1.321,"15min":1.321},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":3.4409999999999998},{"interface":"front","average":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":3.0960000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"min":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":3.359},{"interface":"front","average":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"min":{"1min":1.46,"5min":1.46,"15min":1.46},"max":{"1min":3.5139999999999998,"5min":3.5139999999999998,"15min":3.5139999999999998},"last":2.4430000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.581,"5min":2.581,"15min":2.581},"min":{"1min":1.421,"5min":1.421,"15min":1.421},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":2.1059999999999999},{"interface":"front","average":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":2.7679999999999998}]},{"osd":5,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.351,"5min":2.351,"15min":2.351},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":2.1819999999999999},{"interface":"front","average":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"min":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":3.7770000000000001}]},{"osd":7,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":3.097,"15min":3.097},"min":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":2.3380000000000001},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"max":{"1min":4.2249999999999996,"5min":4.2249999999999996,"15min":4.2249999999999996},"last":3.1789999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2206336,"kb_used_data":2176120,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":92165504,"statfs":{"total":96636764160,"available":94377476096,"internally_reserved":0,"allocated":2228346880,"data_stored":2226283422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.032,"5min":3.032,"15min":3.032},"last":10.554}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1},{"interface":"front","average":{"1min":1.76,"5min":1.76,"15min":1.76},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":11.089}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.869,"15min":1.869},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":13.345000000000001},{"interface":"front","average":{"1min":2.278,"5min":2.278,"15min":2.278},"min":{"1min":1.371,"5min":1.371,"15min":1.371},"max":{"1min":3.2869999999999999,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":13.728}]},{"osd":3,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":13.956},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":11.874000000000001}]},{"osd":5,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":12.587},{"interface":"front","average":{"1min":2.544,"5min":2.544,"15min":2.544},"min":{"1min":1.47,"5min":1.47,"15min":1.47},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":14.151}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"min":{"1min":1.343,"5min":1.343,"15min":1.343},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":13.231999999999999},{"interface":"front","average":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"min":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.968,"5min":3.968,"15min":3.968},"last":12.519}]},{"osd":7,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.899,"5min":2.899,"15min":2.899},"min":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"max":{"1min":4.0270000000000001,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":15.246},{"interface":"front","average":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":13.007}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751808,"kb_used_data":726328,"kb_used_omap":0,"kb_used_meta":25472,"kb_avail":93620032,"statfs":{"total":96636764160,"available":95866912768,"internally_reserved":0,"allocated":743759872,"data_stored":742842622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26083328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.26},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.6890000000000001}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.849,"15min":1.849},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.401},{"interface":"front","average":{"1min":1.823,"5min":1.823,"15min":1.823},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.448}]},{"osd":4,"last update":"Sat Feb 27 14:26:35 2021","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.631},{"interface":"front","average":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":10.196999999999999,"5min":10.196999999999999,"15min":10.196999999999999},"last":2.0139999999999998}]},{"osd":5,"last update":"Sat Feb 27 14:26:35 2021","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":2.2490000000000001},{"interface":"front","average":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"min":{"1min":1.181,"5min":1.181,"15min":1.181},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":2.29}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.944},{"interface":"front","average":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"min":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"max":{"1min":9.7490000000000006,"5min":9.7490000000000006,"15min":9.7490000000000006},"last":2.3359999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.784},{"interface":"front","average":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":2.5089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752812,"kb_used_data":737508,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":93619028,"statfs":{"total":96636764160,"available":95865884672,"internally_reserved":0,"allocated":755208192,"data_stored":754170139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":2.669},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.3490000000000002,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.484}]},{"osd":1,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":1.702,"15min":1.702},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.627},{"interface":"front","average":{"1min":1.883,"5min":1.883,"15min":1.883},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":2.036}]},{"osd":2,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.97,"15min":1.97},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":3.0409999999999999},{"interface":"front","average":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":3.2309999999999999}]},{"osd":3,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":1.915,"15min":1.915},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":2.1549999999999998},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":2.2250000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":2.456},{"interface":"front","average":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.6739999999999999,"5min":3.6739999999999999,"15min":3.6739999999999999},"last":1.5489999999999999}]},{"osd":6,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":4.0570000000000004,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":2.9900000000000002},{"interface":"front","average":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":2.5539999999999998}]},{"osd":7,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":6.0410000000000004,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":2.8660000000000001},{"interface":"front","average":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"min":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":3.516}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1508788,"kb_used_data":1490412,"kb_used_omap":0,"kb_used_meta":18368,"kb_avail":92863052,"statfs":{"total":96636764160,"available":95091765248,"internally_reserved":0,"allocated":1526181888,"data_stored":1524684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18808832},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.3959999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.871},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.26}]},{"osd":3,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.3799999999999999},{"interface":"front","average":{"1min":1.901,"5min":1.901,"15min":1.901},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":2.3130000000000002}]},{"osd":4,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.5830000000000002,"5min":3.5830000000000002,"15min":3.5830000000000002},"last":1.831},{"interface":"front","average":{"1min":2.085,"5min":2.085,"15min":2.085},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.984}]},{"osd":5,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":4.1950000000000003,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":2.1259999999999999},{"interface":"front","average":{"1min":2.109,"5min":2.109,"15min":2.109},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":2.218}]},{"osd":6,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"min":{"1min":1.123,"5min":1.123,"15min":1.123},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":2.657},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":1.353,"5min":1.353,"15min":1.353},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":2.4409999999999998}]},{"osd":7,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"min":{"1min":1.542,"5min":1.542,"15min":1.542},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":2.726},{"interface":"front","average":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"min":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":2.6179999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126688,"kb_used_data":109592,"kb_used_omap":0,"kb_used_meta":17088,"kb_avail":94245152,"statfs":{"total":96636764160,"available":96507035648,"internally_reserved":0,"allocated":112222208,"data_stored":111765477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17498112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":1.3200000000000001},{"interface":"front","average":{"1min":2.012,"5min":2.012,"15min":2.012},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":7.3380000000000001,"5min":7.3380000000000001,"15min":7.3380000000000001},"last":1.7729999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":6.8230000000000004,"5min":6.8230000000000004,"15min":6.8230000000000004},"last":1.3979999999999999},{"interface":"front","average":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"min":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"max":{"1min":5.7990000000000004,"5min":5.7990000000000004,"15min":5.7990000000000004},"last":1.827}]},{"osd":3,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.556},{"interface":"front","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":6.4950000000000001,"5min":6.4950000000000001,"15min":6.4950000000000001},"last":1.3600000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.905},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"min":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":2.379}]},{"osd":5,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":5.9550000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"min":{"1min":1.526,"5min":1.526,"15min":1.526},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":2.649}]},{"osd":6,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":2.677,"15min":2.677},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":5.2300000000000004,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":2.4740000000000002},{"interface":"front","average":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"min":{"1min":1.248,"5min":1.248,"15min":1.248},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":2.8679999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.573,"15min":2.573},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":3.573,"5min":3.573,"15min":3.573},"last":2.5670000000000002},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"min":{"1min":1.329,"5min":1.329,"15min":1.329},"max":{"1min":5.4039999999999999,"5min":5.4039999999999999,"15min":5.4039999999999999},"last":2.806}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2921908,"kb_used_data":2884844,"kb_used_omap":0,"kb_used_meta":37056,"kb_avail":91449932,"statfs":{"total":96636764160,"available":93644730368,"internally_reserved":0,"allocated":2954080256,"data_stored":2951390709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37945344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.5680000000000001}]},{"osd":1,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.2010000000000001,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":3.2610000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.905,"5min":1.905,"15min":1.905},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":3.254}]},{"osd":4,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":2.956},{"interface":"front","average":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"min":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":1.7849999999999999}]},{"osd":5,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.907,"15min":1.907},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":2.1970000000000001},{"interface":"front","average":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":3.746,"5min":3.746,"15min":3.746},"last":3.4279999999999999}]},{"osd":6,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"min":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.9850000000000001},{"interface":"front","average":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":2.5169999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"min":{"1min":1.607,"5min":1.607,"15min":1.607},"max":{"1min":3.8660000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":2.258},{"interface":"front","average":{"1min":2.29,"5min":2.29,"15min":2.29},"min":{"1min":1.268,"5min":1.268,"15min":1.268},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":2.879}]}]}]}}
, 2021-02-27T14:26:56.742 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json

2021-02-28T06:28:14.242 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:27:04.554 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2021-02-27T14:25:57.309134+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=57, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:27:04.555 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-27T14:25:38.659383+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=38, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:27:04.555 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-02-27T14:25:56.298657+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=56, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:14.242 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:27:46.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com
, 2021-02-27T14:27:46.994 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1
, 2021-02-27T14:27:47.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com

2021-02-28T06:28:14.243 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:28:11.242 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72      3 u   53   64   37    0.132   -1.851   7.599
, 2021-02-27T14:28:11.242 INFO:teuthology.orchestra.run.smithi184.stdout:*hv04.front.sepi 144.172.126.201  3 u   55   64   37    0.115   -0.691   8.440
, 2021-02-27T14:28:11.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab

2021-02-28T06:28:14.299 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7feef7faf79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7feef7faf978]

2021-02-28T06:28:14.301 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.695 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:10.373169+0000",
, 2021-02-27T14:26:31.696 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 6.3250000000000006e-05

2021-02-28T06:28:14.301 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "age": 17.958649700999999,
, 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.15429325599999999,
, 2021-02-27T14:26:31.738 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {

2021-02-28T06:28:14.302 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.762 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.763 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "throttled",
, 2021-02-27T14:26:31.763 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.681551+0000",

2021-02-28T06:28:14.302 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.797 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.797 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:31.798 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.688773+0000",

2021-02-28T06:28:14.303 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.837 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.838 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:31.838 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.829044+0000",

2021-02-28T06:28:14.304 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.877 INFO:teuthology.orchestra.run.smithi119.stdout:            "initiated_at": "2021-02-27T14:26:13.693999+0000",
, 2021-02-27T14:26:31.877 INFO:teuthology.orchestra.run.smithi119.stdout:            "age": 17.934994554999999,
, 2021-02-27T14:26:31.878 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.134263781,

2021-02-28T06:28:14.304 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.903 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:31.904 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:31.904 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.305 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.934 INFO:teuthology.orchestra.run.smithi119.stdout:                    }
, 2021-02-27T14:26:31.935 INFO:teuthology.orchestra.run.smithi119.stdout:                ]
, 2021-02-27T14:26:31.935 INFO:teuthology.orchestra.run.smithi119.stdout:            }

2021-02-28T06:28:14.306 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:31.978 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 8.3229999999999998e-06
, 2021-02-27T14:26:31.979 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:31.979 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.306 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.032 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 3.4638000000000003e-05
, 2021-02-27T14:26:32.033 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.033 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.307 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.844478+0000",
, 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.666e-05
, 2021-02-27T14:26:32.116 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.308 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.226890+0000",
, 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00028260299999999998
, 2021-02-27T14:26:32.138 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.308 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.159 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.326699+0000",
, 2021-02-27T14:26:32.159 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.008482669
, 2021-02-27T14:26:32.160 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.309 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:14.457702+0000",
, 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00012408100000000001
, 2021-02-27T14:26:32.198 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.309 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:            "duration": 0.12518553299999999,
, 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {
, 2021-02-27T14:26:32.237 INFO:teuthology.orchestra.run.smithi119.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:14.310 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 479, in wait
,     proc.wait()
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 161, in wait

2021-02-28T06:28:14.311 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.699 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.700 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "done",
, 2021-02-27T14:26:32.700 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.672717+0000",

2021-02-28T06:28:14.312 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.727 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "queued_for_pg",

2021-02-28T06:28:14.312 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.756 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0
, 2021-02-27T14:26:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.757 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.313 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.789 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.000113101
, 2021-02-27T14:26:32.790 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.790 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.314 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.692336+0000",
, 2021-02-27T14:26:32.824 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.0087e-05
, 2021-02-27T14:26:32.825 INFO:teuthology.orchestra.run.smithi119.stdout:                    },

2021-02-28T06:28:14.314 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "initiated",
, 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.714193+0000",
, 2021-02-27T14:26:32.848 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0

2021-02-28T06:28:14.315 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.882 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",
, 2021-02-27T14:26:32.883 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.836489+0000",
, 2021-02-27T14:26:32.883 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 0.00010335700000000001

2021-02-28T06:28:14.316 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.911 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.912 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "dispatched",
, 2021-02-27T14:26:32.912 INFO:teuthology.orchestra.run.smithi119.stdout:                        "time": "2021-02-27T14:26:13.866924+0000",

2021-02-28T06:28:14.316 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.936 INFO:teuthology.orchestra.run.smithi119.stdout:                "events": [
, 2021-02-27T14:26:32.937 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.937 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "initiated",

2021-02-28T06:28:14.317 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.960 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.961 INFO:teuthology.orchestra.run.smithi119.stdout:                    {
, 2021-02-27T14:26:32.961 INFO:teuthology.orchestra.run.smithi119.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.317 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:32.985 INFO:teuthology.orchestra.run.smithi119.stdout:                        "duration": 1.8258e-05
, 2021-02-27T14:26:32.986 INFO:teuthology.orchestra.run.smithi119.stdout:                    },
, 2021-02-27T14:26:32.986 INFO:teuthology.orchestra.run.smithi119.stdout:                    {

2021-02-28T06:28:14.318 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:            "type_data": {
, 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T14:26:33.038 INFO:teuthology.orchestra.run.smithi119.stdout:                "events": [

2021-02-28T06:28:14.319 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.844 INFO:teuthology.orchestra.run.smithi184.stdout:            "duration": 0.43877463,
, 2021-02-27T14:26:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:            "type_data": {
, 2021-02-27T14:26:33.845 INFO:teuthology.orchestra.run.smithi184.stdout:                "flag_point": "commit sent; apply or cleanup",

2021-02-28T06:28:14.319 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.875 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",
, 2021-02-27T14:26:33.876 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.451200+0000",
, 2021-02-27T14:26:33.876 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999461

2021-02-28T06:28:14.320 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "dispatched",
, 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.513806+0000",
, 2021-02-27T14:26:33.918 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.0450000000000001e-06

2021-02-28T06:28:14.321 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "started",
, 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.683468+0000",
, 2021-02-27T14:26:33.944 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.011857326

2021-02-28T06:28:14.321 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "op_commit",
, 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.727028+0000",
, 2021-02-27T14:26:33.975 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.103888732

2021-02-28T06:28:14.322 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",
, 2021-02-27T14:26:34.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.966617+0000",
, 2021-02-27T14:26:34.004 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.134253861

2021-02-28T06:28:14.322 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.031 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client": "client.4472",
, 2021-02-27T14:26:34.031 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",
, 2021-02-27T14:26:34.032 INFO:teuthology.orchestra.run.smithi184.stdout:                    "tid": 2731

2021-02-28T06:28:14.323 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.062 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.063 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "header_read",
, 2021-02-27T14:26:34.063 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.337296+0000",

2021-02-28T06:28:14.324 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.114 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:34.115 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.338540+0000",

2021-02-28T06:28:14.324 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for subops from 2,7",
, 2021-02-27T14:26:34.142 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.372046+0000",

2021-02-28T06:28:14.325 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "sub_op_commit_rec",
, 2021-02-27T14:26:34.169 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.462711+0000",

2021-02-28T06:28:14.326 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.205 INFO:teuthology.orchestra.run.smithi184.stdout:                ]
, 2021-02-27T14:26:34.208 INFO:teuthology.orchestra.run.smithi184.stdout:            }
, 2021-02-27T14:26:34.208 INFO:teuthology.orchestra.run.smithi184.stdout:        },

2021-02-28T06:28:14.326 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.241 INFO:teuthology.orchestra.run.smithi184.stdout:                "events": [
, 2021-02-27T14:26:34.242 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.242 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "initiated",

2021-02-28T06:28:14.327 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.265 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.266 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "all_read",

2021-02-28T06:28:14.328 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.292 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.328 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.319 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "op_commit",

2021-02-28T06:28:14.329 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.346 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.330 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.372 INFO:teuthology.orchestra.run.smithi184.stdout:}
, 2021-02-27T14:26:34.374 DEBUG:teuthology.orchestra.run.smithi184:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight
, marked in osd.4.

2021-02-28T06:28:14.330 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                "client_info": {
, 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client": "client.4472",
, 2021-02-27T14:26:34.789 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",

2021-02-28T06:28:14.331 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.813 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for peered",

2021-02-28T06:28:14.331 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.837 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.837 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:34.838 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "commit_sent",

2021-02-28T06:28:14.332 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.862 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.5663999999999998e-05
, 2021-02-27T14:26:34.862 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.863 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.333 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.041298841000000003
, 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.333 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.079475975000000004
, 2021-02-27T14:26:34.908 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.909 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.334 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 1.3969e-05
, 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.931 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.335 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.955 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 1.0544368580000001
, 2021-02-27T14:26:34.956 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:34.956 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.335 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:            "type_data": {
, 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:                "flag_point": "reached pg",
, 2021-02-27T14:26:34.979 INFO:teuthology.orchestra.run.smithi184.stdout:                "client_info": {

2021-02-28T06:28:14.336 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.671657+0000",
, 2021-02-27T14:26:35.003 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.000100437
, 2021-02-27T14:26:35.004 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.337 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                    "client_addr": "v1:172.21.15.119:0/2224955584",
, 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                    "tid": 2853
, 2021-02-27T14:26:35.027 INFO:teuthology.orchestra.run.smithi184.stdout:                },

2021-02-28T06:28:14.337 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",
, 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.708811+0000",
, 2021-02-27T14:26:35.050 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 8.7909999999999993e-06

2021-02-28T06:28:14.338 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.072 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.073 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "initiated",
, 2021-02-27T14:26:35.073 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.808525+0000",

2021-02-28T06:28:14.339 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "waiting for peered",
, 2021-02-27T14:26:35.095 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.809491+0000",

2021-02-28T06:28:14.339 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.514 INFO:teuthology.orchestra.run.smithi184.stdout:    "size": 20,
, 2021-02-27T14:26:35.515 INFO:teuthology.orchestra.run.smithi184.stdout:    "duration": 600,
, 2021-02-27T14:26:35.515 INFO:teuthology.orchestra.run.smithi184.stdout:    "ops": [

2021-02-28T06:28:14.340 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.587 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.588 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.588 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.340 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.627 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999681
, 2021-02-27T14:26:35.628 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.628 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.341 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.672 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.035520544000000001
, 2021-02-27T14:26:35.672 INFO:teuthology.orchestra.run.smithi184.stdout:                    }
, 2021-02-27T14:26:35.673 INFO:teuthology.orchestra.run.smithi184.stdout:                ]

2021-02-28T06:28:14.342 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:13.585295+0000",
, 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.0040886719999999998
, 2021-02-27T14:26:35.723 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.343 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",
, 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.170647+0000",
, 2021-02-27T14:26:35.756 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 4294967295.9999375

2021-02-28T06:28:14.343 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.795 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",
, 2021-02-27T14:26:35.796 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.219423+0000",
, 2021-02-27T14:26:35.797 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0.041800245999999999

2021-02-28T06:28:14.344 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.853 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.854 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "queued_for_pg",
, 2021-02-27T14:26:35.854 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.183462+0000",

2021-02-28T06:28:14.344 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.886 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "throttled",

2021-02-28T06:28:14.345 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                    {
, 2021-02-27T14:26:35.928 INFO:teuthology.orchestra.run.smithi184.stdout:                        "event": "done",

2021-02-28T06:28:14.346 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.949 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 9.3360000000000001e-06
, 2021-02-27T14:26:35.950 INFO:teuthology.orchestra.run.smithi184.stdout:                    },
, 2021-02-27T14:26:35.950 INFO:teuthology.orchestra.run.smithi184.stdout:                    {

2021-02-28T06:28:14.346 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.972 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.484131+0000",
, 2021-02-27T14:26:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 0
, 2021-02-27T14:26:35.973 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.347 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:26:35.999 INFO:teuthology.orchestra.run.smithi184.stdout:                        "time": "2021-02-27T14:26:14.525757+0000",
, 2021-02-27T14:26:35.999 INFO:teuthology.orchestra.run.smithi184.stdout:                        "duration": 5.6601000000000002e-05
, 2021-02-27T14:26:36.000 INFO:teuthology.orchestra.run.smithi184.stdout:                    },

2021-02-28T06:28:14.350 WARNING:scrape:Ignoring malparsed backtrace: dumped all
, 2021-02-27T14:26:56.738 INFO:teuthology.orchestra.run.smithi119.stdout:{"pg_ready":true,"pg_map":{"version":90,"stamp":"2021-02-27T14:26:55.619324+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3076258358,"num_objects":1488,"num_object_clones":0,"num_object_copies":4464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1488,"num_whiteouts":0,"num_read":3184,"num_read_kb":1171322,"num_write":4739,"num_write_kb":5271446,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1204,"num_bytes_recovered":2859443415,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":449,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":57,"ondisk_log_size":57,"up":87,"acting":87,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":91,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":10094172,"kb_used_data":9910684,"kb_used_omap":0,"kb_used_meta":183424,"kb_avail":744880548,"statfs":{"total":773094113280,"available":762757681152,"internally_reserved":0,"allocated":10148540416,"data_stored":10137639078,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":187826176},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":22,"apply_latency_ms":22,"commit_latency_ns":22000000,"apply_latency_ns":22000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.139010"},"pg_stats":[{"pgid":"4.f","version":"38'109","reported_seq":"321","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.929471+0000","last_change":"2021-02-27T14:26:39.420528+0000","last_active":"2021-02-27T14:26:49.929471+0000","last_peered":"2021-02-27T14:26:49.929471+0000","last_clean":"2021-02-27T14:26:49.929471+0000","last_became_active":"2021-02-27T14:26:39.420082+0000","last_became_peered":"2021-02-27T14:26:39.420082+0000","last_unstale":"2021-02-27T14:26:49.929471+0000","last_undegraded":"2021-02-27T14:26:49.929471+0000","last_fullsized":"2021-02-27T14:26:49.929471+0000","mapping_epoch":45,"log_start":"35'106","ondisk_log_start":"35'106","created":20,"last_epoch_clean":46,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3798481,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":72,"num_read_kb":24,"num_write":131,"num_write_kb":99470,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":3798481,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":23,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"39'203","reported_seq":"423","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.277085+0000","last_change":"2021-02-27T14:25:58.360562+0000","last_active":"2021-02-27T14:26:50.277085+0000","last_peered":"2021-02-27T14:26:50.277085+0000","last_clean":"2021-02-27T14:26:50.277085+0000","last_became_active":"2021-02-27T14:25:58.359615+0000","last_became_peered":"2021-02-27T14:25:58.359615+0000","last_unstale":"2021-02-27T14:26:50.277085+0000","last_undegraded":"2021-02-27T14:26:50.277085+0000","last_fullsized":"2021-02-27T14:26:50.277085+0000","mapping_epoch":20,"log_start":"37'200","ondisk_log_start":"37'200","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11260855,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":138,"num_read_kb":16691,"num_write":238,"num_write_kb":184324,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":38,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.d","version":"38'135","reported_seq":"294","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239249+0000","last_change":"2021-02-27T14:25:58.358332+0000","last_active":"2021-02-27T14:26:50.239249+0000","last_peered":"2021-02-27T14:26:50.239249+0000","last_clean":"2021-02-27T14:26:50.239249+0000","last_became_active":"2021-02-27T14:25:58.356582+0000","last_became_peered":"2021-02-27T14:25:58.356582+0000","last_unstale":"2021-02-27T14:26:50.239249+0000","last_undegraded":"2021-02-27T14:26:50.239249+0000","last_fullsized":"2021-02-27T14:26:50.239249+0000","mapping_epoch":20,"log_start":"38'132","ondisk_log_start":"38'132","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16571801,"num_objects":27,"num_object_clones":0,"num_object_copies":81,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":90,"num_read_kb":12047,"num_write":151,"num_write_kb":119395,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":22,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.c","version":"38'146","reported_seq":"397","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495109+0000","last_change":"2021-02-27T14:26:38.418145+0000","last_active":"2021-02-27T14:26:49.495109+0000","last_peered":"2021-02-27T14:26:49.495109+0000","last_clean":"2021-02-27T14:26:49.495109+0000","last_became_active":"2021-02-27T14:26:38.417490+0000","last_became_peered":"2021-02-27T14:26:38.417490+0000","last_unstale":"2021-02-27T14:26:49.495109+0000","last_undegraded":"2021-02-27T14:26:49.495109+0000","last_fullsized":"2021-02-27T14:26:49.495109+0000","mapping_epoch":44,"log_start":"36'143","ondisk_log_start":"36'143","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11462506,"num_objects":30,"num_object_clones":0,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":92,"num_read_kb":32,"num_write":169,"num_write_kb":129234,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":30,"num_bytes_recovered":11462506,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":26,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,1],"acting":[0,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"38'152","reported_seq":"418","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495750+0000","last_change":"2021-02-27T14:26:38.418219+0000","last_active":"2021-02-27T14:26:49.495750+0000","last_peered":"2021-02-27T14:26:49.495750+0000","last_clean":"2021-02-27T14:26:49.495750+0000","last_became_active":"2021-02-27T14:26:38.417606+0000","last_became_peered":"2021-02-27T14:26:38.417606+0000","last_unstale":"2021-02-27T14:26:49.495750+0000","last_undegraded":"2021-02-27T14:26:49.495750+0000","last_fullsized":"2021-02-27T14:26:49.495750+0000","mapping_epoch":44,"log_start":"38'149","ondisk_log_start":"38'149","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12840680,"num_objects":32,"num_object_clones":0,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":0,"num_read":107,"num_read_kb":11857,"num_write":175,"num_write_kb":123916,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":32,"num_bytes_recovered":12073777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,1],"acting":[5,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.a","version":"36'190","reported_seq":"396","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.276884+0000","last_change":"2021-02-27T14:25:58.361631+0000","last_active":"2021-02-27T14:26:50.276884+0000","last_peered":"2021-02-27T14:26:50.276884+0000","last_clean":"2021-02-27T14:26:50.276884+0000","last_became_active":"2021-02-27T14:25:58.359858+0000","last_became_peered":"2021-02-27T14:25:58.359858+0000","last_unstale":"2021-02-27T14:26:50.276884+0000","last_undegraded":"2021-02-27T14:26:50.276884+0000","last_fullsized":"2021-02-27T14:26:50.276884+0000","mapping_epoch":20,"log_start":"36'187","ondisk_log_start":"36'187","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":16067657,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":122,"num_read_kb":41,"num_write":221,"num_write_kb":166857,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":35,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,7],"acting":[2,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"38'157","reported_seq":"412","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.494919+0000","last_change":"2021-02-27T14:26:38.420332+0000","last_active":"2021-02-27T14:26:49.494919+0000","last_peered":"2021-02-27T14:26:49.494919+0000","last_clean":"2021-02-27T14:26:49.494919+0000","last_became_active":"2021-02-27T14:26:38.419573+0000","last_became_peered":"2021-02-27T14:26:38.419573+0000","last_unstale":"2021-02-27T14:26:49.494919+0000","last_undegraded":"2021-02-27T14:26:49.494919+0000","last_fullsized":"2021-02-27T14:26:49.494919+0000","mapping_epoch":44,"log_start":"35'154","ondisk_log_start":"35'154","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12454218,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":94,"num_read_kb":32,"num_write":181,"num_write_kb":137358,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":12454218,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[1,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"36'118","reported_seq":"260","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239025+0000","last_change":"2021-02-27T14:25:58.359214+0000","last_active":"2021-02-27T14:26:50.239025+0000","last_peered":"2021-02-27T14:26:50.239025+0000","last_clean":"2021-02-27T14:26:50.239025+0000","last_became_active":"2021-02-27T14:25:58.358653+0000","last_became_peered":"2021-02-27T14:25:58.358653+0000","last_unstale":"2021-02-27T14:26:50.239025+0000","last_undegraded":"2021-02-27T14:26:50.239025+0000","last_fullsized":"2021-02-27T14:26:50.239025+0000","mapping_epoch":20,"log_start":"36'115","ondisk_log_start":"36'115","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":8638996,"num_objects":24,"num_object_clones":0,"num_object_copies":72,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":72,"num_read_kb":24,"num_write":136,"num_write_kb":111476,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":21,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":"54","reported_epoch":"57","state":"active+clean","last_fresh":"2021-02-27T14:26:51.671230+0000","last_change":"2021-02-27T14:26:51.671230+0000","last_active":"2021-02-27T14:26:51.671230+0000","last_peered":"2021-02-27T14:26:51.671230+0000","last_clean":"2021-02-27T14:26:51.671230+0000","last_became_active":"2021-02-27T14:25:39.885593+0000","last_became_peered":"2021-02-27T14:25:39.885593+0000","last_unstale":"2021-02-27T14:26:51.671230+0000","last_undegraded":"2021-02-27T14:26:51.671230+0000","last_fullsized":"2021-02-27T14:26:51.671230+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:51.670955+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:26:51.670955+0000","last_clean_scrub_stamp":"2021-02-27T14:26:51.670955+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6,2],"acting":[5,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"38'137","reported_seq":"304","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439030+0000","last_change":"2021-02-27T14:25:58.352218+0000","last_active":"2021-02-27T14:26:50.439030+0000","last_peered":"2021-02-27T14:26:50.439030+0000","last_clean":"2021-02-27T14:26:50.439030+0000","last_became_active":"2021-02-27T14:25:58.351397+0000","last_became_peered":"2021-02-27T14:25:58.351397+0000","last_unstale":"2021-02-27T14:26:50.439030+0000","last_undegraded":"2021-02-27T14:26:50.439030+0000","last_fullsized":"2021-02-27T14:26:50.439030+0000","mapping_epoch":20,"log_start":"35'134","ondisk_log_start":"35'134","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":6806967,"num_objects":29,"num_object_clones":0,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":98,"num_read_kb":23476,"num_write":161,"num_write_kb":117745,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,7],"acting":[6,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.4","version":"39'136","reported_seq":"303","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439197+0000","last_change":"2021-02-27T14:25:58.352355+0000","last_active":"2021-02-27T14:26:50.439197+0000","last_peered":"2021-02-27T14:26:50.439197+0000","last_clean":"2021-02-27T14:26:50.439197+0000","last_became_active":"2021-02-27T14:25:58.351733+0000","last_became_peered":"2021-02-27T14:25:58.351733+0000","last_unstale":"2021-02-27T14:26:50.439197+0000","last_undegraded":"2021-02-27T14:26:50.439197+0000","last_fullsized":"2021-02-27T14:26:50.439197+0000","mapping_epoch":20,"log_start":"36'133","ondisk_log_start":"36'133","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":4134786,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":103,"num_read_kb":23378,"num_write":160,"num_write_kb":120410,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":26,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,3],"acting":[6,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239286+0000","last_change":"2021-02-27T14:25:39.886406+0000","last_active":"2021-02-27T14:26:50.239286+0000","last_peered":"2021-02-27T14:26:50.239286+0000","last_clean":"2021-02-27T14:26:50.239286+0000","last_became_active":"2021-02-27T14:25:39.885568+0000","last_became_peered":"2021-02-27T14:25:39.885568+0000","last_unstale":"2021-02-27T14:26:50.239286+0000","last_undegraded":"2021-02-27T14:26:50.239286+0000","last_fullsized":"2021-02-27T14:26:50.239286+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6,1],"acting":[3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"39'417","reported_seq":"1258","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495177+0000","last_change":"2021-02-27T14:26:45.344017+0000","last_active":"2021-02-27T14:26:49.495177+0000","last_peered":"2021-02-27T14:26:49.495177+0000","last_clean":"2021-02-27T14:26:49.495177+0000","last_became_active":"2021-02-27T14:26:45.343445+0000","last_became_peered":"2021-02-27T14:26:45.343445+0000","last_unstale":"2021-02-27T14:26:49.495177+0000","last_undegraded":"2021-02-27T14:26:49.495177+0000","last_fullsized":"2021-02-27T14:26:49.495177+0000","mapping_epoch":51,"log_start":"39'414","ondisk_log_start":"39'414","created":19,"last_epoch_clean":52,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":764896107,"num_objects":259,"num_object_clones":0,"num_object_copies":777,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":259,"num_whiteouts":0,"num_read":374,"num_read_kb":246383,"num_write":458,"num_write_kb":814921,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":259,"num_bytes_recovered":760041606,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4],"acting":[0,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.7","version":"35'147","reported_seq":"316","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439291+0000","last_change":"2021-02-27T14:25:58.352046+0000","last_active":"2021-02-27T14:26:50.439291+0000","last_peered":"2021-02-27T14:26:50.439291+0000","last_clean":"2021-02-27T14:26:50.439291+0000","last_became_active":"2021-02-27T14:25:58.351588+0000","last_became_peered":"2021-02-27T14:25:58.351588+0000","last_unstale":"2021-02-27T14:26:50.439291+0000","last_undegraded":"2021-02-27T14:26:50.439291+0000","last_fullsized":"2021-02-27T14:26:50.439291+0000","mapping_epoch":20,"log_start":"35'144","ondisk_log_start":"35'144","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":3966485,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":93,"num_read_kb":31,"num_write":176,"num_write_kb":135402,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":30,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,7],"acting":[6,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"67","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.929049+0000","last_change":"2021-02-27T14:26:35.328699+0000","last_active":"2021-02-27T14:26:49.929049+0000","last_peered":"2021-02-27T14:26:49.929049+0000","last_clean":"2021-02-27T14:26:49.929049+0000","last_became_active":"2021-02-27T14:26:35.328282+0000","last_became_peered":"2021-02-27T14:26:35.328282+0000","last_unstale":"2021-02-27T14:26:49.929049+0000","last_undegraded":"2021-02-27T14:26:49.929049+0000","last_fullsized":"2021-02-27T14:26:49.929049+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,4],"acting":[7,5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"39'463","reported_seq":"806","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495655+0000","last_change":"2021-02-27T14:25:57.344070+0000","last_active":"2021-02-27T14:26:49.495655+0000","last_peered":"2021-02-27T14:26:49.495655+0000","last_clean":"2021-02-27T14:26:49.495655+0000","last_became_active":"2021-02-27T14:25:57.343539+0000","last_became_peered":"2021-02-27T14:25:57.343539+0000","last_unstale":"2021-02-27T14:26:49.495655+0000","last_undegraded":"2021-02-27T14:26:49.495655+0000","last_fullsized":"2021-02-27T14:26:49.495655+0000","mapping_epoch":19,"log_start":"39'460","ondisk_log_start":"39'460","created":19,"last_epoch_clean":20,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":729568321,"num_objects":250,"num_object_clones":0,"num_object_copies":750,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":250,"num_whiteouts":0,"num_read":437,"num_read_kb":278382,"num_write":522,"num_write_kb":797260,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2],"acting":[5,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"36'169","reported_seq":"530","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239129+0000","last_change":"2021-02-27T14:26:47.482864+0000","last_active":"2021-02-27T14:26:50.239129+0000","last_peered":"2021-02-27T14:26:50.239129+0000","last_clean":"2021-02-27T14:26:50.239129+0000","last_became_active":"2021-02-27T14:26:47.482458+0000","last_became_peered":"2021-02-27T14:26:47.482458+0000","last_unstale":"2021-02-27T14:26:50.239129+0000","last_undegraded":"2021-02-27T14:26:50.239129+0000","last_fullsized":"2021-02-27T14:26:50.239129+0000","mapping_epoch":53,"log_start":"36'167","ondisk_log_start":"36'167","created":20,"last_epoch_clean":54,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12386792,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":108,"num_read_kb":35,"num_write":197,"num_write_kb":145986,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":72,"num_bytes_recovered":59345993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":32,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2],"acting":[3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"72","reported_epoch":"57","state":"active+clean","last_fresh":"2021-02-27T14:26:51.403760+0000","last_change":"2021-02-27T14:26:51.403760+0000","last_active":"2021-02-27T14:26:51.403760+0000","last_peered":"2021-02-27T14:26:51.403760+0000","last_clean":"2021-02-27T14:26:51.403760+0000","last_became_active":"2021-02-27T14:26:35.327288+0000","last_became_peered":"2021-02-27T14:26:35.327288+0000","last_unstale":"2021-02-27T14:26:51.403760+0000","last_undegraded":"2021-02-27T14:26:51.403760+0000","last_fullsized":"2021-02-27T14:26:51.403760+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:51.403609+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:26:51.403609+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,4],"acting":[3,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"0'0","reported_seq":"60","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495557+0000","last_change":"2021-02-27T14:26:48.910549+0000","last_active":"2021-02-27T14:26:49.495557+0000","last_peered":"2021-02-27T14:26:49.495557+0000","last_clean":"2021-02-27T14:26:49.495557+0000","last_became_active":"2021-02-27T14:25:37.806159+0000","last_became_peered":"2021-02-27T14:25:37.806159+0000","last_unstale":"2021-02-27T14:26:49.495557+0000","last_undegraded":"2021-02-27T14:26:49.495557+0000","last_fullsized":"2021-02-27T14:26:49.495557+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:26:48.910322+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:26:48.910322+0000","last_clean_scrub_stamp":"2021-02-27T14:26:48.910322+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,2],"acting":[1,5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"38'452","reported_seq":"1276","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490218+0000","last_change":"2021-02-27T14:26:44.349481+0000","last_active":"2021-02-27T14:26:48.490218+0000","last_peered":"2021-02-27T14:26:48.490218+0000","last_clean":"2021-02-27T14:26:48.490218+0000","last_became_active":"2021-02-27T14:26:44.348778+0000","last_became_peered":"2021-02-27T14:26:44.348778+0000","last_unstale":"2021-02-27T14:26:48.490218+0000","last_undegraded":"2021-02-27T14:26:48.490218+0000","last_fullsized":"2021-02-27T14:26:48.490218+0000","mapping_epoch":50,"log_start":"38'450","ondisk_log_start":"38'450","created":19,"last_epoch_clean":51,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":750946429,"num_objects":248,"num_object_clones":0,"num_object_copies":744,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":248,"num_whiteouts":0,"num_read":431,"num_read_kb":309278,"num_write":506,"num_write_kb":818046,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":248,"num_bytes_recovered":743296267,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,0],"acting":[4,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.6","version":"38'168","reported_seq":"359","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.495861+0000","last_change":"2021-02-27T14:25:58.345979+0000","last_active":"2021-02-27T14:26:49.495861+0000","last_peered":"2021-02-27T14:26:49.495861+0000","last_clean":"2021-02-27T14:26:49.495861+0000","last_became_active":"2021-02-27T14:25:58.345472+0000","last_became_peered":"2021-02-27T14:25:58.345472+0000","last_unstale":"2021-02-27T14:26:49.495861+0000","last_undegraded":"2021-02-27T14:26:49.495861+0000","last_fullsized":"2021-02-27T14:26:49.495861+0000","mapping_epoch":20,"log_start":"36'165","ondisk_log_start":"36'165","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":12554928,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":108,"num_read_kb":36,"num_write":195,"num_write_kb":150294,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":32,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.238812+0000","last_change":"2021-02-27T14:25:39.889728+0000","last_active":"2021-02-27T14:26:50.238812+0000","last_peered":"2021-02-27T14:26:50.238812+0000","last_clean":"2021-02-27T14:26:50.238812+0000","last_became_active":"2021-02-27T14:25:39.888095+0000","last_became_peered":"2021-02-27T14:25:39.888095+0000","last_unstale":"2021-02-27T14:26:50.238812+0000","last_undegraded":"2021-02-27T14:26:50.238812+0000","last_fullsized":"2021-02-27T14:26:50.238812+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"39'417","reported_seq":"1718","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439010+0000","last_change":"2021-02-27T14:26:48.511335+0000","last_active":"2021-02-27T14:26:50.439010+0000","last_peered":"2021-02-27T14:26:50.439010+0000","last_clean":"2021-02-27T14:26:50.439010+0000","last_became_active":"2021-02-27T14:26:48.509468+0000","last_became_peered":"2021-02-27T14:26:48.509468+0000","last_unstale":"2021-02-27T14:26:50.439010+0000","last_undegraded":"2021-02-27T14:26:50.439010+0000","last_fullsized":"2021-02-27T14:26:50.439010+0000","mapping_epoch":54,"log_start":"39'414","ondisk_log_start":"39'414","created":19,"last_epoch_clean":55,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:56.298657+0000","last_clean_scrub_stamp":"2021-02-27T14:25:56.298657+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":678557327,"num_objects":231,"num_object_clones":0,"num_object_copies":693,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":231,"num_whiteouts":0,"num_read":371,"num_read_kb":249483,"num_write":468,"num_write_kb":730685,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":1201512642,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4],"acting":[6,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"38'141","reported_seq":"481","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.439150+0000","last_change":"2021-02-27T14:26:43.345466+0000","last_active":"2021-02-27T14:26:50.439150+0000","last_peered":"2021-02-27T14:26:50.439150+0000","last_clean":"2021-02-27T14:26:50.439150+0000","last_became_active":"2021-02-27T14:26:43.344981+0000","last_became_peered":"2021-02-27T14:26:43.344981+0000","last_unstale":"2021-02-27T14:26:50.439150+0000","last_undegraded":"2021-02-27T14:26:50.439150+0000","last_fullsized":"2021-02-27T14:26:50.439150+0000","mapping_epoch":49,"log_start":"36'138","ondisk_log_start":"36'138","created":20,"last_epoch_clean":50,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":5663893,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":94,"num_read_kb":31,"num_write":168,"num_write_kb":120553,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":62,"num_bytes_recovered":44113101,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":29,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,2],"acting":[6,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"46","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:49.497042+0000","last_change":"2021-02-27T14:26:18.662588+0000","last_active":"2021-02-27T14:26:49.497042+0000","last_peered":"2021-02-27T14:26:49.497042+0000","last_clean":"2021-02-27T14:26:49.497042+0000","last_became_active":"2021-02-27T14:26:18.662126+0000","last_became_peered":"2021-02-27T14:26:18.662126+0000","last_unstale":"2021-02-27T14:26:49.497042+0000","last_undegraded":"2021-02-27T14:26:49.497042+0000","last_fullsized":"2021-02-27T14:26:49.497042+0000","mapping_epoch":34,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":35,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3],"acting":[0,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"24","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490537+0000","last_change":"2021-02-27T14:26:35.327952+0000","last_active":"2021-02-27T14:26:48.490537+0000","last_peered":"2021-02-27T14:26:48.490537+0000","last_clean":"2021-02-27T14:26:48.490537+0000","last_became_active":"2021-02-27T14:26:35.327515+0000","last_became_peered":"2021-02-27T14:26:35.327515+0000","last_unstale":"2021-02-27T14:26:48.490537+0000","last_undegraded":"2021-02-27T14:26:48.490537+0000","last_fullsized":"2021-02-27T14:26:48.490537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,5],"acting":[4,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.0","version":"39'149","reported_seq":"402","reported_epoch":"55","state":"active+clean","last_fresh":"2021-02-27T14:26:48.490166+0000","last_change":"2021-02-27T14:26:38.418326+0000","last_active":"2021-02-27T14:26:48.490166+0000","last_peered":"2021-02-27T14:26:48.490166+0000","last_clean":"2021-02-27T14:26:48.490166+0000","last_became_active":"2021-02-27T14:26:38.417842+0000","last_became_peered":"2021-02-27T14:26:38.417842+0000","last_unstale":"2021-02-27T14:26:48.490166+0000","last_undegraded":"2021-02-27T14:26:48.490166+0000","last_fullsized":"2021-02-27T14:26:48.490166+0000","mapping_epoch":44,"log_start":"39'147","ondisk_log_start":"39'147","created":20,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":11344824,"num_objects":31,"num_object_clones":0,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":96,"num_read_kb":33,"num_write":173,"num_write_kb":132509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":31,"num_bytes_recovered":11344824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3],"acting":[4,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"49","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.239305+0000","last_change":"2021-02-27T14:25:39.889476+0000","last_active":"2021-02-27T14:26:50.239305+0000","last_peered":"2021-02-27T14:26:50.239305+0000","last_clean":"2021-02-27T14:26:50.239305+0000","last_became_active":"2021-02-27T14:25:39.887704+0000","last_became_peered":"2021-02-27T14:25:39.887704+0000","last_unstale":"2021-02-27T14:26:50.239305+0000","last_undegraded":"2021-02-27T14:26:50.239305+0000","last_fullsized":"2021-02-27T14:26:50.239305+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:38.659383+0000","last_clean_scrub_stamp":"2021-02-27T14:25:38.659383+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,6],"acting":[3,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"38'127","reported_seq":"286","reported_epoch":"56","state":"active+clean","last_fresh":"2021-02-27T14:26:50.276786+0000","last_change":"2021-02-27T14:25:58.364236+0000","last_active":"2021-02-27T14:26:50.276786+0000","last_peered":"2021-02-27T14:26:50.276786+0000","last_clean":"2021-02-27T14:26:50.276786+0000","last_became_active":"2021-02-27T14:25:58.363827+0000","last_became_peered":"2021-02-27T14:25:58.363827+0000","last_unstale":"2021-02-27T14:26:50.276786+0000","last_undegraded":"2021-02-27T14:26:50.276786+0000","last_fullsized":"2021-02-27T14:26:50.276786+0000","mapping_epoch":20,"log_start":"35'124","ondisk_log_start":"35'124","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-02-27T14:25:57.309134+0000","last_clean_scrub_stamp":"2021-02-27T14:25:57.309134+0000","log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2336305,"num_objects":28,"num_object_clones":0,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":84,"num_read_kb":28,"num_write":153,"num_write_kb":115605,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":27,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1],"acting":[2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":16,"stat_sum":{"num_bytes":152290174,"num_objects":500,"num_object_clones":0,"num_object_copies":1500,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":500,"num_whiteouts":0,"num_read":1571,"num_read_kb":87796,"num_write":2785,"num_write_kb":2110534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":282,"num_bytes_recovered":154592900,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":449,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":452665344,"data_stored":452336373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":46,"ondisk_log_size":46,"up":48,"acting":48,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":2923968184,"num_objects":988,"num_object_clones":0,"num_object_copies":2964,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":988,"num_whiteouts":0,"num_read":1613,"num_read_kb":1083526,"num_write":1954,"num_write_kb":3160912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":922,"num_bytes_recovered":2704850515,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":9436385280,"data_stored":9429049195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":14,"seq":60129542162,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1121388,"kb_used_data":1096548,"kb_used_omap":0,"kb_used_meta":24832,"kb_avail":93250452,"statfs":{"total":96636764160,"available":95488462848,"internally_reserved":0,"allocated":1122865152,"data_stored":1121563473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":25427968},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.5840000000000001,"5min":1.5840000000000001,"15min":1.5840000000000001},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":4.7510000000000003,"5min":4.7510000000000003,"15min":4.7510000000000003},"last":1.266},{"interface":"front","average":{"1min":1.633,"5min":1.633,"15min":1.633},"min":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"max":{"1min":2.649,"5min":2.649,"15min":2.649},"last":1.4399999999999999}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.389,"5min":1.389,"15min":1.389},"min":{"1min":0.70599999999999996,"5min":0.70599999999999996,"15min":0.70599999999999996},"max":{"1min":2.7749999999999999,"5min":2.7749999999999999,"15min":2.7749999999999999},"last":3.1890000000000001},{"interface":"front","average":{"1min":1.8879999999999999,"5min":1.8879999999999999,"15min":1.8879999999999999},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":3.9159999999999999,"5min":3.9159999999999999,"15min":3.9159999999999999},"last":1.6599999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.161,"5min":2.161,"15min":2.161},"min":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"max":{"1min":5.4880000000000004,"5min":5.4880000000000004,"15min":5.4880000000000004},"last":2.1059999999999999},{"interface":"front","average":{"1min":2.1680000000000001,"5min":2.1680000000000001,"15min":2.1680000000000001},"min":{"1min":1.2490000000000001,"5min":1.2490000000000001,"15min":1.2490000000000001},"max":{"1min":3.2330000000000001,"5min":3.2330000000000001,"15min":3.2330000000000001},"last":2.1480000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":0.97799999999999998,"5min":0.97799999999999998,"15min":0.97799999999999998},"max":{"1min":2.7959999999999998,"5min":2.7959999999999998,"15min":2.7959999999999998},"last":2.3839999999999999},{"interface":"front","average":{"1min":2.2320000000000002,"5min":2.2320000000000002,"15min":2.2320000000000002},"min":{"1min":1.016,"5min":1.016,"15min":1.016},"max":{"1min":5.1870000000000003,"5min":5.1870000000000003,"15min":5.1870000000000003},"last":2.621}]},{"osd":4,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1360000000000001,"5min":2.1360000000000001,"15min":2.1360000000000001},"min":{"1min":0.98299999999999998,"5min":0.98299999999999998,"15min":0.98299999999999998},"max":{"1min":3.2410000000000001,"5min":3.2410000000000001,"15min":3.2410000000000001},"last":2.3879999999999999},{"interface":"front","average":{"1min":2.153,"5min":2.153,"15min":2.153},"min":{"1min":0.88,"5min":0.88,"15min":0.88},"max":{"1min":3.4980000000000002,"5min":3.4980000000000002,"15min":3.4980000000000002},"last":1.78}]},{"osd":5,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.5089999999999999,"5min":2.5089999999999999,"15min":2.5089999999999999},"min":{"1min":1.2729999999999999,"5min":1.2729999999999999,"15min":1.2729999999999999},"max":{"1min":5.7290000000000001,"5min":5.7290000000000001,"15min":5.7290000000000001},"last":2.2320000000000002},{"interface":"front","average":{"1min":2.4940000000000002,"5min":2.4940000000000002,"15min":2.4940000000000002},"min":{"1min":1.038,"5min":1.038,"15min":1.038},"max":{"1min":5.0090000000000003,"5min":5.0090000000000003,"15min":5.0090000000000003},"last":2.8239999999999998}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.6659999999999999,"5min":2.6659999999999999,"15min":2.6659999999999999},"min":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"max":{"1min":3.6230000000000002,"5min":3.6230000000000002,"15min":3.6230000000000002},"last":2.609},{"interface":"front","average":{"1min":3.1539999999999999,"5min":3.1539999999999999,"15min":3.1539999999999999},"min":{"1min":1.8480000000000001,"5min":1.8480000000000001,"15min":1.8480000000000001},"max":{"1min":5.8739999999999997,"5min":5.8739999999999997,"15min":5.8739999999999997},"last":3.2770000000000001}]}]},{"osd":6,"up_from":14,"seq":60129542164,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":704444,"kb_used_data":689332,"kb_used_omap":0,"kb_used_meta":15104,"kb_avail":93667396,"statfs":{"total":96636764160,"available":95915413504,"internally_reserved":0,"allocated":705875968,"data_stored":704938802,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15466496},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.6990000000000001,"5min":1.6990000000000001,"15min":1.6990000000000001},"min":{"1min":0.71599999999999997,"5min":0.71599999999999997,"15min":0.71599999999999997},"max":{"1min":3.4089999999999998,"5min":3.4089999999999998,"15min":3.4089999999999998},"last":2.855},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.276,"5min":1.276,"15min":1.276},"max":{"1min":3.0880000000000001,"5min":3.0880000000000001,"15min":3.0880000000000001},"last":1.599}]},{"osd":1,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":1.863,"5min":1.863,"15min":1.863},"min":{"1min":0.997,"5min":0.997,"15min":0.997},"max":{"1min":2.7469999999999999,"5min":2.7469999999999999,"15min":2.7469999999999999},"last":1.7},{"interface":"front","average":{"1min":1.671,"5min":1.671,"15min":1.671},"min":{"1min":0.97499999999999998,"5min":0.97499999999999998,"15min":0.97499999999999998},"max":{"1min":3.3199999999999998,"5min":3.3199999999999998,"15min":3.3199999999999998},"last":1.782}]},{"osd":2,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.294,"5min":2.294,"15min":2.294},"min":{"1min":1.321,"5min":1.321,"15min":1.321},"max":{"1min":3.6880000000000002,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":3.4409999999999998},{"interface":"front","average":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"min":{"1min":1.0669999999999999,"5min":1.0669999999999999,"15min":1.0669999999999999},"max":{"1min":6.5899999999999999,"5min":6.5899999999999999,"15min":6.5899999999999999},"last":3.0960000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.5499999999999998,"5min":2.5499999999999998,"15min":2.5499999999999998},"min":{"1min":1.8300000000000001,"5min":1.8300000000000001,"15min":1.8300000000000001},"max":{"1min":6.2439999999999998,"5min":6.2439999999999998,"15min":6.2439999999999998},"last":3.359},{"interface":"front","average":{"1min":2.0630000000000002,"5min":2.0630000000000002,"15min":2.0630000000000002},"min":{"1min":1.46,"5min":1.46,"15min":1.46},"max":{"1min":3.5139999999999998,"5min":3.5139999999999998,"15min":3.5139999999999998},"last":2.4430000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.581,"5min":2.581,"15min":2.581},"min":{"1min":1.421,"5min":1.421,"15min":1.421},"max":{"1min":4.6029999999999998,"5min":4.6029999999999998,"15min":4.6029999999999998},"last":2.1059999999999999},{"interface":"front","average":{"1min":2.6080000000000001,"5min":2.6080000000000001,"15min":2.6080000000000001},"min":{"1min":1.385,"5min":1.385,"15min":1.385},"max":{"1min":4.4480000000000004,"5min":4.4480000000000004,"15min":4.4480000000000004},"last":2.7679999999999998}]},{"osd":5,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":2.351,"5min":2.351,"15min":2.351},"min":{"1min":0.96299999999999997,"5min":0.96299999999999997,"15min":0.96299999999999997},"max":{"1min":4.0629999999999997,"5min":4.0629999999999997,"15min":4.0629999999999997},"last":2.1819999999999999},{"interface":"front","average":{"1min":2.9260000000000002,"5min":2.9260000000000002,"15min":2.9260000000000002},"min":{"1min":1.7609999999999999,"5min":1.7609999999999999,"15min":1.7609999999999999},"max":{"1min":3.8540000000000001,"5min":3.8540000000000001,"15min":3.8540000000000001},"last":3.7770000000000001}]},{"osd":7,"last update":"Sat Feb 27 14:26:40 2021","interfaces":[{"interface":"back","average":{"1min":3.097,"5min":3.097,"15min":3.097},"min":{"1min":2.5369999999999999,"5min":2.5369999999999999,"15min":2.5369999999999999},"max":{"1min":4.8879999999999999,"5min":4.8879999999999999,"15min":4.8879999999999999},"last":2.3380000000000001},{"interface":"front","average":{"1min":2.661,"5min":2.661,"15min":2.661},"min":{"1min":1.5780000000000001,"5min":1.5780000000000001,"15min":1.5780000000000001},"max":{"1min":4.2249999999999996,"5min":4.2249999999999996,"15min":4.2249999999999996},"last":3.1789999999999998}]}]},{"osd":4,"up_from":13,"seq":55834574867,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2206336,"kb_used_data":2176120,"kb_used_omap":0,"kb_used_meta":30208,"kb_avail":92165504,"statfs":{"total":96636764160,"available":94377476096,"internally_reserved":0,"allocated":2228346880,"data_stored":2226283422,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":30932992},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.4890000000000001,"5min":1.4890000000000001,"15min":1.4890000000000001},"min":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":2.7130000000000001,"5min":2.7130000000000001,"15min":2.7130000000000001},"last":0.95199999999999996},{"interface":"front","average":{"1min":1.6850000000000001,"5min":1.6850000000000001,"15min":1.6850000000000001},"min":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"max":{"1min":3.032,"5min":3.032,"15min":3.032},"last":10.554}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.486,"5min":1.486,"15min":1.486},"min":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"max":{"1min":2.226,"5min":2.226,"15min":2.226},"last":1},{"interface":"front","average":{"1min":1.76,"5min":1.76,"15min":1.76},"min":{"1min":1.0720000000000001,"5min":1.0720000000000001,"15min":1.0720000000000001},"max":{"1min":2.8290000000000002,"5min":2.8290000000000002,"15min":2.8290000000000002},"last":11.089}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.869,"5min":1.869,"15min":1.869},"min":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"max":{"1min":2.8380000000000001,"5min":2.8380000000000001,"15min":2.8380000000000001},"last":13.345000000000001},{"interface":"front","average":{"1min":2.278,"5min":2.278,"15min":2.278},"min":{"1min":1.371,"5min":1.371,"15min":1.371},"max":{"1min":3.2869999999999999,"5min":3.2869999999999999,"15min":3.2869999999999999},"last":13.728}]},{"osd":3,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.2639999999999998,"5min":2.2639999999999998,"15min":2.2639999999999998},"min":{"1min":1.0169999999999999,"5min":1.0169999999999999,"15min":1.0169999999999999},"max":{"1min":3.5790000000000002,"5min":3.5790000000000002,"15min":3.5790000000000002},"last":13.956},{"interface":"front","average":{"1min":1.8819999999999999,"5min":1.8819999999999999,"15min":1.8819999999999999},"min":{"1min":0.92900000000000005,"5min":0.92900000000000005,"15min":0.92900000000000005},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":11.874000000000001}]},{"osd":5,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.1509999999999998,"5min":2.1509999999999998,"15min":2.1509999999999998},"min":{"1min":1.373,"5min":1.373,"15min":1.373},"max":{"1min":3.0390000000000001,"5min":3.0390000000000001,"15min":3.0390000000000001},"last":12.587},{"interface":"front","average":{"1min":2.544,"5min":2.544,"15min":2.544},"min":{"1min":1.47,"5min":1.47,"15min":1.47},"max":{"1min":3.7829999999999999,"5min":3.7829999999999999,"15min":3.7829999999999999},"last":14.151}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.4039999999999999,"5min":2.4039999999999999,"15min":2.4039999999999999},"min":{"1min":1.343,"5min":1.343,"15min":1.343},"max":{"1min":2.8279999999999998,"5min":2.8279999999999998,"15min":2.8279999999999998},"last":13.231999999999999},{"interface":"front","average":{"1min":2.3380000000000001,"5min":2.3380000000000001,"15min":2.3380000000000001},"min":{"1min":1.3320000000000001,"5min":1.3320000000000001,"15min":1.3320000000000001},"max":{"1min":3.968,"5min":3.968,"15min":3.968},"last":12.519}]},{"osd":7,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.899,"5min":2.899,"15min":2.899},"min":{"1min":1.9099999999999999,"5min":1.9099999999999999,"15min":1.9099999999999999},"max":{"1min":4.0270000000000001,"5min":4.0270000000000001,"15min":4.0270000000000001},"last":15.246},{"interface":"front","average":{"1min":2.5150000000000001,"5min":2.5150000000000001,"15min":2.5150000000000001},"min":{"1min":1.704,"5min":1.704,"15min":1.704},"max":{"1min":3.5750000000000002,"5min":3.5750000000000002,"15min":3.5750000000000002},"last":13.007}]}]},{"osd":3,"up_from":13,"seq":55834574867,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":751808,"kb_used_data":726328,"kb_used_omap":0,"kb_used_meta":25472,"kb_avail":93620032,"statfs":{"total":96636764160,"available":95866912768,"internally_reserved":0,"allocated":743759872,"data_stored":742842622,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":26083328},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.3440000000000001,"5min":1.3440000000000001,"15min":1.3440000000000001},"min":{"1min":0.65200000000000002,"5min":0.65200000000000002,"15min":0.65200000000000002},"max":{"1min":2.1440000000000001,"5min":2.1440000000000001,"15min":2.1440000000000001},"last":0.96099999999999997},{"interface":"front","average":{"1min":1.347,"5min":1.347,"15min":1.347},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":2.1389999999999998,"5min":2.1389999999999998,"15min":2.1389999999999998},"last":1.1519999999999999}]},{"osd":1,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.4490000000000001,"5min":1.4490000000000001,"15min":1.4490000000000001},"min":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.2949999999999999,"5min":2.2949999999999999,"15min":2.2949999999999999},"last":1.26},{"interface":"front","average":{"1min":1.6919999999999999,"5min":1.6919999999999999,"15min":1.6919999999999999},"min":{"1min":0.72799999999999998,"5min":0.72799999999999998,"15min":0.72799999999999998},"max":{"1min":2.5699999999999998,"5min":2.5699999999999998,"15min":2.5699999999999998},"last":1.6890000000000001}]},{"osd":2,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":1.849,"5min":1.849,"15min":1.849},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":3.8210000000000002,"5min":3.8210000000000002,"15min":3.8210000000000002},"last":1.401},{"interface":"front","average":{"1min":1.823,"5min":1.823,"15min":1.823},"min":{"1min":0.80600000000000005,"5min":0.80600000000000005,"15min":0.80600000000000005},"max":{"1min":2.8759999999999999,"5min":2.8759999999999999,"15min":2.8759999999999999},"last":1.448}]},{"osd":4,"last update":"Sat Feb 27 14:26:35 2021","interfaces":[{"interface":"back","average":{"1min":1.8919999999999999,"5min":1.8919999999999999,"15min":1.8919999999999999},"min":{"1min":1.3149999999999999,"5min":1.3149999999999999,"15min":1.3149999999999999},"max":{"1min":3.6499999999999999,"5min":3.6499999999999999,"15min":3.6499999999999999},"last":1.631},{"interface":"front","average":{"1min":2.5899999999999999,"5min":2.5899999999999999,"15min":2.5899999999999999},"min":{"1min":1.292,"5min":1.292,"15min":1.292},"max":{"1min":10.196999999999999,"5min":10.196999999999999,"15min":10.196999999999999},"last":2.0139999999999998}]},{"osd":5,"last update":"Sat Feb 27 14:26:35 2021","interfaces":[{"interface":"back","average":{"1min":2.1579999999999999,"5min":2.1579999999999999,"15min":2.1579999999999999},"min":{"1min":1.3779999999999999,"5min":1.3779999999999999,"15min":1.3779999999999999},"max":{"1min":2.8410000000000002,"5min":2.8410000000000002,"15min":2.8410000000000002},"last":2.2490000000000001},{"interface":"front","average":{"1min":2.0750000000000002,"5min":2.0750000000000002,"15min":2.0750000000000002},"min":{"1min":1.181,"5min":1.181,"15min":1.181},"max":{"1min":2.9550000000000001,"5min":2.9550000000000001,"15min":2.9550000000000001},"last":2.29}]},{"osd":6,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.3799999999999999,"5min":2.3799999999999999,"15min":2.3799999999999999},"min":{"1min":1.5289999999999999,"5min":1.5289999999999999,"15min":1.5289999999999999},"max":{"1min":2.972,"5min":2.972,"15min":2.972},"last":1.944},{"interface":"front","average":{"1min":2.8929999999999998,"5min":2.8929999999999998,"15min":2.8929999999999998},"min":{"1min":1.5900000000000001,"5min":1.5900000000000001,"15min":1.5900000000000001},"max":{"1min":9.7490000000000006,"5min":9.7490000000000006,"15min":9.7490000000000006},"last":2.3359999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:39 2021","interfaces":[{"interface":"back","average":{"1min":2.5510000000000002,"5min":2.5510000000000002,"15min":2.5510000000000002},"min":{"1min":1.7290000000000001,"5min":1.7290000000000001,"15min":1.7290000000000001},"max":{"1min":3.206,"5min":3.206,"15min":3.206},"last":1.784},{"interface":"front","average":{"1min":2.6000000000000001,"5min":2.6000000000000001,"15min":2.6000000000000001},"min":{"1min":1.548,"5min":1.548,"15min":1.548},"max":{"1min":3.3370000000000002,"5min":3.3370000000000002,"15min":3.3370000000000002},"last":2.5089999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574867,"num_pgs":9,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":752812,"kb_used_data":737508,"kb_used_omap":0,"kb_used_meta":15296,"kb_avail":93619028,"statfs":{"total":96636764160,"available":95865884672,"internally_reserved":0,"allocated":755208192,"data_stored":754170139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":15663104},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.4359999999999999,"5min":1.4359999999999999,"15min":1.4359999999999999},"min":{"1min":0.81599999999999995,"5min":0.81599999999999995,"15min":0.81599999999999995},"max":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"last":2.669},{"interface":"front","average":{"1min":1.746,"5min":1.746,"15min":1.746},"min":{"1min":1.1439999999999999,"5min":1.1439999999999999,"15min":1.1439999999999999},"max":{"1min":3.3490000000000002,"5min":3.3490000000000002,"15min":3.3490000000000002},"last":1.484}]},{"osd":1,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.702,"5min":1.702,"15min":1.702},"min":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"max":{"1min":2.3050000000000002,"5min":2.3050000000000002,"15min":2.3050000000000002},"last":1.627},{"interface":"front","average":{"1min":1.883,"5min":1.883,"15min":1.883},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":2.036}]},{"osd":2,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.97,"5min":1.97,"15min":1.97},"min":{"1min":0.82599999999999996,"5min":0.82599999999999996,"15min":0.82599999999999996},"max":{"1min":3.1179999999999999,"5min":3.1179999999999999,"15min":3.1179999999999999},"last":3.0409999999999999},{"interface":"front","average":{"1min":2.2669999999999999,"5min":2.2669999999999999,"15min":2.2669999999999999},"min":{"1min":1.1930000000000001,"5min":1.1930000000000001,"15min":1.1930000000000001},"max":{"1min":3.1419999999999999,"5min":3.1419999999999999,"15min":3.1419999999999999},"last":3.2309999999999999}]},{"osd":3,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":1.915,"5min":1.915,"15min":1.915},"min":{"1min":1.119,"5min":1.119,"15min":1.119},"max":{"1min":3.0499999999999998,"5min":3.0499999999999998,"15min":3.0499999999999998},"last":2.1549999999999998},{"interface":"front","average":{"1min":2.1960000000000002,"5min":2.1960000000000002,"15min":2.1960000000000002},"min":{"1min":0.77900000000000003,"5min":0.77900000000000003,"15min":0.77900000000000003},"max":{"1min":3.5379999999999998,"5min":3.5379999999999998,"15min":3.5379999999999998},"last":2.2250000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":2.3719999999999999,"5min":2.3719999999999999,"15min":2.3719999999999999},"min":{"1min":0.96499999999999997,"5min":0.96499999999999997,"15min":0.96499999999999997},"max":{"1min":3.585,"5min":3.585,"15min":3.585},"last":2.456},{"interface":"front","average":{"1min":2.4239999999999999,"5min":2.4239999999999999,"15min":2.4239999999999999},"min":{"1min":0.89900000000000002,"5min":0.89900000000000002,"15min":0.89900000000000002},"max":{"1min":3.6739999999999999,"5min":3.6739999999999999,"15min":3.6739999999999999},"last":1.5489999999999999}]},{"osd":6,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":2.6349999999999998,"5min":2.6349999999999998,"15min":2.6349999999999998},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":4.0570000000000004,"5min":4.0570000000000004,"15min":4.0570000000000004},"last":2.9900000000000002},{"interface":"front","average":{"1min":2.6949999999999998,"5min":2.6949999999999998,"15min":2.6949999999999998},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":3.7410000000000001,"5min":3.7410000000000001,"15min":3.7410000000000001},"last":2.5539999999999998}]},{"osd":7,"last update":"Sat Feb 27 14:26:41 2021","interfaces":[{"interface":"back","average":{"1min":3.0249999999999999,"5min":3.0249999999999999,"15min":3.0249999999999999},"min":{"1min":1.101,"5min":1.101,"15min":1.101},"max":{"1min":6.0410000000000004,"5min":6.0410000000000004,"15min":6.0410000000000004},"last":2.8660000000000001},{"interface":"front","average":{"1min":3.1989999999999998,"5min":3.1989999999999998,"15min":3.1989999999999998},"min":{"1min":1.7090000000000001,"5min":1.7090000000000001,"15min":1.7090000000000001},"max":{"1min":6.0910000000000002,"5min":6.0910000000000002,"15min":6.0910000000000002},"last":3.516}]}]},{"osd":0,"up_from":14,"seq":60129542163,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1508788,"kb_used_data":1490412,"kb_used_omap":0,"kb_used_meta":18368,"kb_avail":92863052,"statfs":{"total":96636764160,"available":95091765248,"internally_reserved":0,"allocated":1526181888,"data_stored":1524684434,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":18808832},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.2589999999999999,"5min":1.2589999999999999,"15min":1.2589999999999999},"min":{"1min":0.60099999999999998,"5min":0.60099999999999998,"15min":0.60099999999999998},"max":{"1min":2.141,"5min":2.141,"15min":2.141},"last":1.1419999999999999},{"interface":"front","average":{"1min":1.3580000000000001,"5min":1.3580000000000001,"15min":1.3580000000000001},"min":{"1min":0.76100000000000001,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":2.2090000000000001,"5min":2.2090000000000001,"15min":2.2090000000000001},"last":1.3959999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.6579999999999999,"5min":1.6579999999999999,"15min":1.6579999999999999},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.6259999999999999,"5min":2.6259999999999999,"15min":2.6259999999999999},"last":0.871},{"interface":"front","average":{"1min":1.4019999999999999,"5min":1.4019999999999999,"15min":1.4019999999999999},"min":{"1min":0.66200000000000003,"5min":0.66200000000000003,"15min":0.66200000000000003},"max":{"1min":2.8540000000000001,"5min":2.8540000000000001,"15min":2.8540000000000001},"last":1.26}]},{"osd":3,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":1.544,"5min":1.544,"15min":1.544},"min":{"1min":0.89500000000000002,"5min":0.89500000000000002,"15min":0.89500000000000002},"max":{"1min":2.7879999999999998,"5min":2.7879999999999998,"15min":2.7879999999999998},"last":2.3799999999999999},{"interface":"front","average":{"1min":1.901,"5min":1.901,"15min":1.901},"min":{"1min":0.63700000000000001,"5min":0.63700000000000001,"15min":0.63700000000000001},"max":{"1min":2.6749999999999998,"5min":2.6749999999999998,"15min":2.6749999999999998},"last":2.3130000000000002}]},{"osd":4,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.1850000000000001,"5min":2.1850000000000001,"15min":2.1850000000000001},"min":{"1min":0.99099999999999999,"5min":0.99099999999999999,"15min":0.99099999999999999},"max":{"1min":3.5830000000000002,"5min":3.5830000000000002,"15min":3.5830000000000002},"last":1.831},{"interface":"front","average":{"1min":2.085,"5min":2.085,"15min":2.085},"min":{"1min":0.93700000000000006,"5min":0.93700000000000006,"15min":0.93700000000000006},"max":{"1min":2.9510000000000001,"5min":2.9510000000000001,"15min":2.9510000000000001},"last":1.984}]},{"osd":5,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"min":{"1min":1.417,"5min":1.417,"15min":1.417},"max":{"1min":4.1950000000000003,"5min":4.1950000000000003,"15min":4.1950000000000003},"last":2.1259999999999999},{"interface":"front","average":{"1min":2.109,"5min":2.109,"15min":2.109},"min":{"1min":0.98699999999999999,"5min":0.98699999999999999,"15min":0.98699999999999999},"max":{"1min":3.048,"5min":3.048,"15min":3.048},"last":2.218}]},{"osd":6,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.4750000000000001,"5min":2.4750000000000001,"15min":2.4750000000000001},"min":{"1min":1.123,"5min":1.123,"15min":1.123},"max":{"1min":3.4900000000000002,"5min":3.4900000000000002,"15min":3.4900000000000002},"last":2.657},{"interface":"front","average":{"1min":2.214,"5min":2.214,"15min":2.214},"min":{"1min":1.353,"5min":1.353,"15min":1.353},"max":{"1min":3.7130000000000001,"5min":3.7130000000000001,"15min":3.7130000000000001},"last":2.4409999999999998}]},{"osd":7,"last update":"Sat Feb 27 14:26:36 2021","interfaces":[{"interface":"back","average":{"1min":2.3679999999999999,"5min":2.3679999999999999,"15min":2.3679999999999999},"min":{"1min":1.542,"5min":1.542,"15min":1.542},"max":{"1min":3.4359999999999999,"5min":3.4359999999999999,"15min":3.4359999999999999},"last":2.726},{"interface":"front","average":{"1min":2.6619999999999999,"5min":2.6619999999999999,"15min":2.6619999999999999},"min":{"1min":1.5640000000000001,"5min":1.5640000000000001,"15min":1.5640000000000001},"max":{"1min":4.0369999999999999,"5min":4.0369999999999999,"15min":4.0369999999999999},"last":2.6179999999999999}]}]},{"osd":1,"up_from":14,"seq":60129542163,"num_pgs":11,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126688,"kb_used_data":109592,"kb_used_omap":0,"kb_used_meta":17088,"kb_avail":94245152,"statfs":{"total":96636764160,"available":96507035648,"internally_reserved":0,"allocated":112222208,"data_stored":111765477,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":17498112},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.831,"5min":1.831,"15min":1.831},"min":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"max":{"1min":7.5410000000000004,"5min":7.5410000000000004,"15min":7.5410000000000004},"last":1.3200000000000001},{"interface":"front","average":{"1min":2.012,"5min":2.012,"15min":2.012},"min":{"1min":0.68700000000000006,"5min":0.68700000000000006,"15min":0.68700000000000006},"max":{"1min":7.3380000000000001,"5min":7.3380000000000001,"15min":7.3380000000000001},"last":1.7729999999999999}]},{"osd":2,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.9510000000000001,"5min":1.9510000000000001,"15min":1.9510000000000001},"min":{"1min":0.98999999999999999,"5min":0.98999999999999999,"15min":0.98999999999999999},"max":{"1min":6.8230000000000004,"5min":6.8230000000000004,"15min":6.8230000000000004},"last":1.3979999999999999},{"interface":"front","average":{"1min":2.3130000000000002,"5min":2.3130000000000002,"15min":2.3130000000000002},"min":{"1min":1.2689999999999999,"5min":1.2689999999999999,"15min":1.2689999999999999},"max":{"1min":5.7990000000000004,"5min":5.7990000000000004,"15min":5.7990000000000004},"last":1.827}]},{"osd":3,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.675,"5min":1.675,"15min":1.675},"min":{"1min":0.752,"5min":0.752,"15min":0.752},"max":{"1min":2.774,"5min":2.774,"15min":2.774},"last":1.556},{"interface":"front","average":{"1min":2.1619999999999999,"5min":2.1619999999999999,"15min":2.1619999999999999},"min":{"1min":0.76000000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":6.4950000000000001,"5min":6.4950000000000001,"15min":6.4950000000000001},"last":1.3600000000000001}]},{"osd":4,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":1.9139999999999999,"5min":1.9139999999999999,"15min":1.9139999999999999},"min":{"1min":1.1519999999999999,"5min":1.1519999999999999,"15min":1.1519999999999999},"max":{"1min":3.9529999999999998,"5min":3.9529999999999998,"15min":3.9529999999999998},"last":1.905},{"interface":"front","average":{"1min":2.3839999999999999,"5min":2.3839999999999999,"15min":2.3839999999999999},"min":{"1min":1.5720000000000001,"5min":1.5720000000000001,"15min":1.5720000000000001},"max":{"1min":3.5539999999999998,"5min":3.5539999999999998,"15min":3.5539999999999998},"last":2.379}]},{"osd":5,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.54,"5min":2.54,"15min":2.54},"min":{"1min":1.0389999999999999,"5min":1.0389999999999999,"15min":1.0389999999999999},"max":{"1min":5.9550000000000001,"5min":5.9550000000000001,"15min":5.9550000000000001},"last":1.6080000000000001},{"interface":"front","average":{"1min":2.4460000000000002,"5min":2.4460000000000002,"15min":2.4460000000000002},"min":{"1min":1.526,"5min":1.526,"15min":1.526},"max":{"1min":4.4059999999999997,"5min":4.4059999999999997,"15min":4.4059999999999997},"last":2.649}]},{"osd":6,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.677,"5min":2.677,"15min":2.677},"min":{"1min":1.097,"5min":1.097,"15min":1.097},"max":{"1min":5.2300000000000004,"5min":5.2300000000000004,"15min":5.2300000000000004},"last":2.4740000000000002},{"interface":"front","average":{"1min":2.4950000000000001,"5min":2.4950000000000001,"15min":2.4950000000000001},"min":{"1min":1.248,"5min":1.248,"15min":1.248},"max":{"1min":4.5049999999999999,"5min":4.5049999999999999,"15min":4.5049999999999999},"last":2.8679999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:37 2021","interfaces":[{"interface":"back","average":{"1min":2.573,"5min":2.573,"15min":2.573},"min":{"1min":1.2,"5min":1.2,"15min":1.2},"max":{"1min":3.573,"5min":3.573,"15min":3.573},"last":2.5670000000000002},{"interface":"front","average":{"1min":2.7850000000000001,"5min":2.7850000000000001,"15min":2.7850000000000001},"min":{"1min":1.329,"5min":1.329,"15min":1.329},"max":{"1min":5.4039999999999999,"5min":5.4039999999999999,"15min":5.4039999999999999},"last":2.806}]}]},{"osd":2,"up_from":14,"seq":60129542162,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2921908,"kb_used_data":2884844,"kb_used_omap":0,"kb_used_meta":37056,"kb_avail":91449932,"statfs":{"total":96636764160,"available":93644730368,"internally_reserved":0,"allocated":2954080256,"data_stored":2951390709,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37945344},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.161,"5min":1.161,"15min":1.161},"min":{"1min":0.63500000000000001,"5min":0.63500000000000001,"15min":0.63500000000000001},"max":{"1min":1.998,"5min":1.998,"15min":1.998},"last":1.6140000000000001},{"interface":"front","average":{"1min":1.3180000000000001,"5min":1.3180000000000001,"15min":1.3180000000000001},"min":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":2.2450000000000001,"5min":2.2450000000000001,"15min":2.2450000000000001},"last":1.5680000000000001}]},{"osd":1,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3700000000000001,"5min":1.3700000000000001,"15min":1.3700000000000001},"min":{"1min":0.68799999999999994,"5min":0.68799999999999994,"15min":0.68799999999999994},"max":{"1min":3.2010000000000001,"5min":3.2010000000000001,"15min":3.2010000000000001},"last":0.99199999999999999},{"interface":"front","average":{"1min":1.405,"5min":1.405,"15min":1.405},"min":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":3.2610000000000001,"5min":3.2610000000000001,"15min":3.2610000000000001},"last":1.3080000000000001}]},{"osd":3,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.3680000000000001,"5min":1.3680000000000001,"15min":1.3680000000000001},"min":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"max":{"1min":2.1789999999999998,"5min":2.1789999999999998,"15min":2.1789999999999998},"last":1.8380000000000001},{"interface":"front","average":{"1min":1.905,"5min":1.905,"15min":1.905},"min":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"max":{"1min":3.4289999999999998,"5min":3.4289999999999998,"15min":3.4289999999999998},"last":3.254}]},{"osd":4,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.9770000000000001,"5min":1.9770000000000001,"15min":1.9770000000000001},"min":{"1min":1.022,"5min":1.022,"15min":1.022},"max":{"1min":3.629,"5min":3.629,"15min":3.629},"last":2.956},{"interface":"front","average":{"1min":2.0430000000000001,"5min":2.0430000000000001,"15min":2.0430000000000001},"min":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"max":{"1min":3.5179999999999998,"5min":3.5179999999999998,"15min":3.5179999999999998},"last":1.7849999999999999}]},{"osd":5,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":1.907,"5min":1.907,"15min":1.907},"min":{"1min":0.97199999999999998,"5min":0.97199999999999998,"15min":0.97199999999999998},"max":{"1min":3.036,"5min":3.036,"15min":3.036},"last":2.1970000000000001},{"interface":"front","average":{"1min":2.3290000000000002,"5min":2.3290000000000002,"15min":2.3290000000000002},"min":{"1min":1.1399999999999999,"5min":1.1399999999999999,"15min":1.1399999999999999},"max":{"1min":3.746,"5min":3.746,"15min":3.746},"last":3.4279999999999999}]},{"osd":6,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":2.3399999999999999,"5min":2.3399999999999999,"15min":2.3399999999999999},"min":{"1min":1.5329999999999999,"5min":1.5329999999999999,"15min":1.5329999999999999},"max":{"1min":3.7080000000000002,"5min":3.7080000000000002,"15min":3.7080000000000002},"last":1.9850000000000001},{"interface":"front","average":{"1min":2.1339999999999999,"5min":2.1339999999999999,"15min":2.1339999999999999},"min":{"1min":1.105,"5min":1.105,"15min":1.105},"max":{"1min":3.0169999999999999,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":2.5169999999999999}]},{"osd":7,"last update":"Sat Feb 27 14:26:38 2021","interfaces":[{"interface":"back","average":{"1min":2.5419999999999998,"5min":2.5419999999999998,"15min":2.5419999999999998},"min":{"1min":1.607,"5min":1.607,"15min":1.607},"max":{"1min":3.8660000000000001,"5min":3.8660000000000001,"15min":3.8660000000000001},"last":2.258},{"interface":"front","average":{"1min":2.29,"5min":2.29,"15min":2.29},"min":{"1min":1.268,"5min":1.268,"15min":1.268},"max":{"1min":3.415,"5min":3.415,"15min":3.415},"last":2.879}]}]}]}}
, 2021-02-27T14:26:56.742 DEBUG:teuthology.orchestra.run.smithi119:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json

2021-02-28T06:28:14.356 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:27:04.554 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2021-02-27T14:25:57.309134+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=57, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:27:04.555 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2021-02-27T14:25:38.659383+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=38, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)
, 2021-02-27T14:27:04.555 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2021-02-27T14:25:56.298657+0000 time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=25, tm_sec=56, tm_wday=5, tm_yday=58, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=2, tm_mday=27, tm_hour=14, tm_min=26, tm_sec=58, tm_wday=5, tm_yday=58, tm_isdst=0)

2021-02-28T06:28:14.357 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:27:46.993 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi119.front.sepia.ceph.com
, 2021-02-27T14:27:46.994 DEBUG:teuthology.orchestra.run.smithi119:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1
, 2021-02-27T14:27:47.129 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi119.front.sepia.ceph.com

2021-02-28T06:28:14.358 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T14:28:11.242 INFO:teuthology.orchestra.run.smithi184.stdout:+hv03.front.sepi 74.6.168.72      3 u   53   64   37    0.132   -1.851   7.599
, 2021-02-27T14:28:11.242 INFO:teuthology.orchestra.run.smithi184.stdout:*hv04.front.sepi 144.172.126.201  3 u   55   64   37    0.115   -0.691   8.440
, 2021-02-27T14:28:11.243 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab

2021-02-28T06:28:14.746 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fa077edb79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fa077edb978]

2021-02-28T06:28:14.747 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:23.918719+0000",
, 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.026545863999999999
, 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.747 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.707 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:23.918644+0000",
, 2021-02-27T13:43:30.707 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.048208938999999999
, 2021-02-27T13:43:30.708 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.748 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.728 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.467977+0000",
, 2021-02-27T13:43:30.729 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.25961466300000002
, 2021-02-27T13:43:30.729 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.748 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.467962+0000",
, 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 8.3911000000000003e-05
, 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.749 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.468054+0000",
, 2021-02-27T13:43:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 1.2649e-05
, 2021-02-27T13:43:30.783 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.750 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.733756+0000",
, 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 5.4023000000000001e-05
, 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.750 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.733988+0000",
, 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 1.4584e-05
, 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.751 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.848 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.734066+0000",
, 2021-02-27T13:43:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.999969
, 2021-02-27T13:43:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.751 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                    "tid": 1537
, 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                },
, 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                "events": [

2021-02-28T06:28:14.752 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.891 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.840239+0000",
, 2021-02-27T13:43:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.999908
, 2021-02-27T13:43:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.753 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.912 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.848967+0000",
, 2021-02-27T13:43:30.913 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.90969941700000001
, 2021-02-27T13:43:30.913 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.753 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.933 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client_addr": "v1:172.21.15.85:0/3768588230",
, 2021-02-27T13:43:30.934 INFO:teuthology.orchestra.run.smithi121.stdout:                    "tid": 5007
, 2021-02-27T13:43:30.934 INFO:teuthology.orchestra.run.smithi121.stdout:                },

2021-02-28T06:28:14.754 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "queued_for_pg",
, 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.852659+0000",
, 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.9179999999999997e-05

2021-02-28T06:28:14.755 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:        {

2021-02-28T06:28:14.755 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "all_read",
, 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.921055+0000",

2021-02-28T06:28:14.756 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "commit_sent",
, 2021-02-27T13:43:31.019 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:56.969341+0000",

2021-02-28T06:28:14.757 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.039 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.039 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.040 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",

2021-02-28T06:28:14.758 WARNING:scrape:Ignoring malparsed backtrace:     raise CommandCrashedError(command=self.command)
, teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_redirect --low_tier_pool low_tier --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 50 --op write 50 --op delete 10 --op tier_promote 30 --op write_excl 50 --pool unique_pool_0'
, 2021-02-27T13:43:31.069 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds

2021-02-28T06:28:14.758 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4.7318000000000003e-05
, 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:14.759 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.420108168
, 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:14.759 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:38.822222+0000",
, 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 9.9620000000000005e-06
, 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.760 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:        {
, 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:            "description": "osd_repop(client.4472.0:3012 3.1 e48/36 3:91b7a324:::smithi08521406-765 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head v 48'199, mlcod=48'194)",

2021-02-28T06:28:14.761 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",
, 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:44.829574+0000",
, 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 3.0858999999999997e-05

2021-02-28T06:28:14.761 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "header_read",
, 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:44.890885+0000",

2021-02-28T06:28:14.762 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:14.762 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.687 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.763 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999828
, 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:14.764 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.28086183100000001
, 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:14.764 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:45.305835+0000",
, 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.047658732000000002
, 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.765 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",
, 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.128272+0000",
, 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999738

2021-02-28T06:28:14.765 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.811 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",
, 2021-02-27T13:43:31.812 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.570787+0000",
, 2021-02-27T13:43:31.812 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.382520792

2021-02-28T06:28:14.766 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.257 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:38.842760+0000",
, 2021-02-27T13:43:32.257 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.023849760000000001
, 2021-02-27T13:43:32.258 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.767 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:        {
, 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:            "description": "osd_repop(client.4472.0:2717 3.0 e45/18 3:21c98165:::smithi08521406-470 low_tier:head v 45'128, mlcod=44'124)",

2021-02-28T06:28:14.767 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",
, 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:39.138156+0000",
, 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.000196054

2021-02-28T06:28:14.768 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "header_read",
, 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:39.692225+0000",

2021-02-28T06:28:14.768 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:14.769 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",

2021-02-28T06:28:14.770 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999733
, 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:14.770 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.408 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.37533145400000001
, 2021-02-27T13:43:32.409 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:32.409 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:14.771 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:45.788358+0000",
, 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.090980637000000003
, 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.771 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.449 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",
, 2021-02-27T13:43:32.450 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.064336+0000",
, 2021-02-27T13:43:32.450 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999747

2021-02-28T06:28:14.772 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",
, 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.629140+0000",
, 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.499579826

2021-02-28T06:28:14.773 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "queued_for_pg",
, 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.263622+0000",

2021-02-28T06:28:14.773 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.767 INFO:teuthology.orchestra.run.smithi121.stdout:}
, set osd.0 primary-affinity to 1 (8655362)
, 2021-02-27T13:43:32.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops

2021-02-28T06:28:14.774 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.933 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:32.934 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:32.934 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:14.775 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.958 INFO:teuthology.orchestra.run.smithi121.stdout:            "initiated_at": "2021-02-27T13:42:19.435199+0000",
, 2021-02-27T13:43:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:            "age": 73.474023082000002,
, 2021-02-27T13:43:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:            "duration": 0.52637023299999997,

2021-02-28T06:28:14.775 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:                "client_info": {
, 2021-02-27T13:43:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client": "client.4472",
, 2021-02-27T13:43:32.981 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client_addr": "v1:172.21.15.85:0/3768588230",

2021-02-28T06:28:14.776 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.001 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",

2021-02-28T06:28:14.776 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",

2021-02-28T06:28:14.777 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.2899999999999997e-06
, 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:14.778 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.065 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.102174+0000",
, 2021-02-27T13:43:33.066 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0
, 2021-02-27T13:43:33.066 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.778 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.305705+0000",
, 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 6.6191000000000004e-05
, 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:14.779 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "dispatched",
, 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.136706+0000",
, 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.6120000000000001e-06

2021-02-28T06:28:14.779 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.129 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "initiated",
, 2021-02-27T13:43:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.142409+0000",

2021-02-28T06:28:14.780 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "commit_sent",
, 2021-02-27T13:43:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.342916+0000",

2021-02-28T06:28:14.781 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "dispatched",

2021-02-28T06:28:14.781 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                "events": [
, 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:14.783 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:47.557 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":92,"fsid":"da6b30e2-1a3a-4547-88be-f3addb958f36","created":"2021-02-27T13:41:48.953373+0000","modified":"2021-02-27T13:43:46.909479+0000","last_up_change":"2021-02-27T13:41:58.891397+0000","last_in_change":"2021-02-27T13:42:21.829573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-27T13:41:57.942764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-27T13:41:59.917535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"low_tier","create_time":"2021-02-27T13:42:10.214932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":4,"pool_name":"unique_pool_0","create_time":"2021-02-27T13:42:11.161758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"59a508d1-be18-4084-9dbf-f488ebabe385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6804","nonce":16848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6805","nonce":16848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6807","nonce":16848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6806","nonce":16848}]},"public_addr":"172.21.15.85:6804/16848","cluster_addr":"172.21.15.85:6805/16848","heartbeat_back_addr":"172.21.15.85:6807/16848","heartbeat_front_addr":"172.21.15.85:6806/16848","state":["exists","up"]},{"osd":1,"uuid":"ea0d9f7b-f7de-496f-960b-519e63834f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6800","nonce":16847}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6801","nonce":16847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6803","nonce":16847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6802","nonce":16847}]},"public_addr":"172.21.15.85:6800/16847","cluster_addr":"172.21.15.85:6801/16847","heartbeat_back_addr":"172.21.15.85:6803/16847","heartbeat_front_addr":"172.21.15.85:6802/16847","state":["exists","up"]},{"osd":2,"uuid":"1c79c7eb-7dea-41a2-b814-e30bf576eb9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6812","nonce":16857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6813","nonce":16857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6815","nonce":16857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6814","nonce":16857}]},"public_addr":"172.21.15.85:6812/16857","cluster_addr":"172.21.15.85:6813/16857","heartbeat_back_addr":"172.21.15.85:6815/16857","heartbeat_front_addr":"172.21.15.85:6814/16857","state":["exists","up"]},{"osd":3,"uuid":"11ca03fe-4dc9-40bc-bb3d-ab6509b94ffe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6808","nonce":16858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6809","nonce":16858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6811","nonce":16858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6810","nonce":16858}]},"public_addr":"172.21.15.85:6808/16858","cluster_addr":"172.21.15.85:6809/16858","heartbeat_back_addr":"172.21.15.85:6811/16858","heartbeat_front_addr":"172.21.15.85:6810/16858","state":["exists","up"]},{"osd":4,"uuid":"098441ce-6f22-406d-9663-a220e46ee4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6800","nonce":16968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6801","nonce":16968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6803","nonce":16968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6802","nonce":16968}]},"public_addr":"172.21.15.121:6800/16968","cluster_addr":"172.21.15.121:6801/16968","heartbeat_back_addr":"172.21.15.121:6803/16968","heartbeat_front_addr":"172.21.15.121:6802/16968","state":["exists","up"]},{"osd":5,"uuid":"e8d23c6e-db5e-49d7-9957-2f2bdc193be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6808","nonce":16994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6809","nonce":16994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6811","nonce":16994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6810","nonce":16994}]},"public_addr":"172.21.15.121:6808/16994","cluster_addr":"172.21.15.121:6809/16994","heartbeat_back_addr":"172.21.15.121:6811/16994","heartbeat_front_addr":"172.21.15.121:6810/16994","state":["exists","up"]},{"osd":6,"uuid":"617e8c68-025d-43b1-99f9-3681ea7ab74f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6812","nonce":16993}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6813","nonce":16993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6815","nonce":16993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6814","nonce":16993}]},"public_addr":"172.21.15.121:6812/16993","cluster_addr":"172.21.15.121:6813/16993","heartbeat_back_addr":"172.21.15.121:6815/16993","heartbeat_front_addr":"172.21.15.121:6814/16993","state":["exists","up"]},{"osd":7,"uuid":"3945180c-c2bc-45f2-849d-0c8e25847190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6804","nonce":16970}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6805","nonce":16970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6807","nonce":16970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6806","nonce":16970}]},"public_addr":"172.21.15.121:6804/16970","cluster_addr":"172.21.15.121:6805/16970","heartbeat_back_addr":"172.21.15.121:6807/16970","heartbeat_front_addr":"172.21.15.121:6806/16970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.646913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.909105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.899998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.354995+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.038975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.987185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.454667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.638880+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[7,3,4]},{"pgid":"3.1","osds":[1,6,5]},{"pgid":"4.e","osds":[3,4,7]}],"pg_upmap_items":[{"pgid":"1.0","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
, 2021-02-27T13:43:47.571 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats
, 2021-02-27T13:43:47.742 INFO:teuthology.orchestra.run.smithi085.stdout:55834574873

2021-02-28T06:28:14.893 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 4 to deep-scrub
, 2021-02-27T13:43:58.228 INFO:tasks.ceph:Scrubbing osd.5
, 2021-02-27T13:43:58.229 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0

2021-02-28T06:28:14.893 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 479, in wait
,     proc.wait()

2021-02-28T06:28:14.894 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:45:05.256 DEBUG:teuthology.orchestra.run.smithi085:> sudo tar cz -f - -C /var/lib/ceph/crash -- .
, 2021-02-27T13:45:05.274 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/myoungwon-2021-02-23_10:10:24-rados-wip-manifest-dedup-test-distro-basic-smithi/5907228/remote/smithi121/crash
, 2021-02-27T13:45:05.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2021-02-28T06:28:14.895 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 286, in task
,     running.get()
,   File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get

2021-02-28T06:28:15.003 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fa077edb79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fa077edb978]

2021-02-28T06:28:15.004 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:23.918719+0000",
, 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.026545863999999999
, 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.005 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.707 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:23.918644+0000",
, 2021-02-27T13:43:30.707 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.048208938999999999
, 2021-02-27T13:43:30.708 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.006 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.728 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.467977+0000",
, 2021-02-27T13:43:30.729 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.25961466300000002
, 2021-02-27T13:43:30.729 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.006 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.467962+0000",
, 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 8.3911000000000003e-05
, 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.007 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.468054+0000",
, 2021-02-27T13:43:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 1.2649e-05
, 2021-02-27T13:43:30.783 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.009 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.733756+0000",
, 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 5.4023000000000001e-05
, 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.009 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.733988+0000",
, 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 1.4584e-05
, 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.010 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.848 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.734066+0000",
, 2021-02-27T13:43:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.999969
, 2021-02-27T13:43:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.011 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                    "tid": 1537
, 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                },
, 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                "events": [

2021-02-28T06:28:15.011 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.891 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.840239+0000",
, 2021-02-27T13:43:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.999908
, 2021-02-27T13:43:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.012 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.912 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.848967+0000",
, 2021-02-27T13:43:30.913 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.90969941700000001
, 2021-02-27T13:43:30.913 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.013 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.933 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client_addr": "v1:172.21.15.85:0/3768588230",
, 2021-02-27T13:43:30.934 INFO:teuthology.orchestra.run.smithi121.stdout:                    "tid": 5007
, 2021-02-27T13:43:30.934 INFO:teuthology.orchestra.run.smithi121.stdout:                },

2021-02-28T06:28:15.014 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "queued_for_pg",
, 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.852659+0000",
, 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.9179999999999997e-05

2021-02-28T06:28:15.014 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:        {

2021-02-28T06:28:15.015 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "all_read",
, 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.921055+0000",

2021-02-28T06:28:15.016 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "commit_sent",
, 2021-02-27T13:43:31.019 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:56.969341+0000",

2021-02-28T06:28:15.016 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.039 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.039 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.040 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",

2021-02-28T06:28:15.017 WARNING:scrape:Ignoring malparsed backtrace:     raise CommandCrashedError(command=self.command)
, teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_redirect --low_tier_pool low_tier --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 50 --op write 50 --op delete 10 --op tier_promote 30 --op write_excl 50 --pool unique_pool_0'
, 2021-02-27T13:43:31.069 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds

2021-02-28T06:28:15.018 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4.7318000000000003e-05
, 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.018 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.420108168
, 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:15.019 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:38.822222+0000",
, 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 9.9620000000000005e-06
, 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.020 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:        {
, 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:            "description": "osd_repop(client.4472.0:3012 3.1 e48/36 3:91b7a324:::smithi08521406-765 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head v 48'199, mlcod=48'194)",

2021-02-28T06:28:15.020 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",
, 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:44.829574+0000",
, 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 3.0858999999999997e-05

2021-02-28T06:28:15.021 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "header_read",
, 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:44.890885+0000",

2021-02-28T06:28:15.022 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:15.023 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.687 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",

2021-02-28T06:28:15.024 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999828
, 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.024 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.28086183100000001
, 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:15.025 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:45.305835+0000",
, 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.047658732000000002
, 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.026 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",
, 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.128272+0000",
, 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999738

2021-02-28T06:28:15.026 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.811 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",
, 2021-02-27T13:43:31.812 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.570787+0000",
, 2021-02-27T13:43:31.812 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.382520792

2021-02-28T06:28:15.027 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.257 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:38.842760+0000",
, 2021-02-27T13:43:32.257 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.023849760000000001
, 2021-02-27T13:43:32.258 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.028 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:        {
, 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:            "description": "osd_repop(client.4472.0:2717 3.0 e45/18 3:21c98165:::smithi08521406-470 low_tier:head v 45'128, mlcod=44'124)",

2021-02-28T06:28:15.028 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",
, 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:39.138156+0000",
, 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.000196054

2021-02-28T06:28:15.029 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "header_read",
, 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:39.692225+0000",

2021-02-28T06:28:15.030 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:15.030 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",

2021-02-28T06:28:15.031 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999733
, 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.031 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.408 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.37533145400000001
, 2021-02-27T13:43:32.409 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:32.409 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:15.032 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:45.788358+0000",
, 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.090980637000000003
, 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.033 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.449 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",
, 2021-02-27T13:43:32.450 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.064336+0000",
, 2021-02-27T13:43:32.450 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999747

2021-02-28T06:28:15.033 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",
, 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.629140+0000",
, 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.499579826

2021-02-28T06:28:15.034 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "queued_for_pg",
, 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.263622+0000",

2021-02-28T06:28:15.035 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.767 INFO:teuthology.orchestra.run.smithi121.stdout:}
, set osd.0 primary-affinity to 1 (8655362)
, 2021-02-27T13:43:32.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops

2021-02-28T06:28:15.035 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.933 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:32.934 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:32.934 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:15.036 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.958 INFO:teuthology.orchestra.run.smithi121.stdout:            "initiated_at": "2021-02-27T13:42:19.435199+0000",
, 2021-02-27T13:43:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:            "age": 73.474023082000002,
, 2021-02-27T13:43:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:            "duration": 0.52637023299999997,

2021-02-28T06:28:15.037 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:                "client_info": {
, 2021-02-27T13:43:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client": "client.4472",
, 2021-02-27T13:43:32.981 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client_addr": "v1:172.21.15.85:0/3768588230",

2021-02-28T06:28:15.038 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.001 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",

2021-02-28T06:28:15.038 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",

2021-02-28T06:28:15.039 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.2899999999999997e-06
, 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.040 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.065 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.102174+0000",
, 2021-02-27T13:43:33.066 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0
, 2021-02-27T13:43:33.066 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.040 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.305705+0000",
, 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 6.6191000000000004e-05
, 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.041 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "dispatched",
, 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.136706+0000",
, 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.6120000000000001e-06

2021-02-28T06:28:15.042 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.129 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "initiated",
, 2021-02-27T13:43:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.142409+0000",

2021-02-28T06:28:15.042 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "commit_sent",
, 2021-02-27T13:43:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.342916+0000",

2021-02-28T06:28:15.043 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "dispatched",

2021-02-28T06:28:15.044 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                "events": [
, 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.046 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:47.557 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":92,"fsid":"da6b30e2-1a3a-4547-88be-f3addb958f36","created":"2021-02-27T13:41:48.953373+0000","modified":"2021-02-27T13:43:46.909479+0000","last_up_change":"2021-02-27T13:41:58.891397+0000","last_in_change":"2021-02-27T13:42:21.829573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-27T13:41:57.942764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-27T13:41:59.917535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"low_tier","create_time":"2021-02-27T13:42:10.214932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":4,"pool_name":"unique_pool_0","create_time":"2021-02-27T13:42:11.161758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"59a508d1-be18-4084-9dbf-f488ebabe385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6804","nonce":16848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6805","nonce":16848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6807","nonce":16848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6806","nonce":16848}]},"public_addr":"172.21.15.85:6804/16848","cluster_addr":"172.21.15.85:6805/16848","heartbeat_back_addr":"172.21.15.85:6807/16848","heartbeat_front_addr":"172.21.15.85:6806/16848","state":["exists","up"]},{"osd":1,"uuid":"ea0d9f7b-f7de-496f-960b-519e63834f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6800","nonce":16847}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6801","nonce":16847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6803","nonce":16847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6802","nonce":16847}]},"public_addr":"172.21.15.85:6800/16847","cluster_addr":"172.21.15.85:6801/16847","heartbeat_back_addr":"172.21.15.85:6803/16847","heartbeat_front_addr":"172.21.15.85:6802/16847","state":["exists","up"]},{"osd":2,"uuid":"1c79c7eb-7dea-41a2-b814-e30bf576eb9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6812","nonce":16857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6813","nonce":16857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6815","nonce":16857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6814","nonce":16857}]},"public_addr":"172.21.15.85:6812/16857","cluster_addr":"172.21.15.85:6813/16857","heartbeat_back_addr":"172.21.15.85:6815/16857","heartbeat_front_addr":"172.21.15.85:6814/16857","state":["exists","up"]},{"osd":3,"uuid":"11ca03fe-4dc9-40bc-bb3d-ab6509b94ffe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6808","nonce":16858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6809","nonce":16858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6811","nonce":16858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6810","nonce":16858}]},"public_addr":"172.21.15.85:6808/16858","cluster_addr":"172.21.15.85:6809/16858","heartbeat_back_addr":"172.21.15.85:6811/16858","heartbeat_front_addr":"172.21.15.85:6810/16858","state":["exists","up"]},{"osd":4,"uuid":"098441ce-6f22-406d-9663-a220e46ee4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6800","nonce":16968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6801","nonce":16968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6803","nonce":16968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6802","nonce":16968}]},"public_addr":"172.21.15.121:6800/16968","cluster_addr":"172.21.15.121:6801/16968","heartbeat_back_addr":"172.21.15.121:6803/16968","heartbeat_front_addr":"172.21.15.121:6802/16968","state":["exists","up"]},{"osd":5,"uuid":"e8d23c6e-db5e-49d7-9957-2f2bdc193be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6808","nonce":16994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6809","nonce":16994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6811","nonce":16994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6810","nonce":16994}]},"public_addr":"172.21.15.121:6808/16994","cluster_addr":"172.21.15.121:6809/16994","heartbeat_back_addr":"172.21.15.121:6811/16994","heartbeat_front_addr":"172.21.15.121:6810/16994","state":["exists","up"]},{"osd":6,"uuid":"617e8c68-025d-43b1-99f9-3681ea7ab74f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6812","nonce":16993}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6813","nonce":16993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6815","nonce":16993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6814","nonce":16993}]},"public_addr":"172.21.15.121:6812/16993","cluster_addr":"172.21.15.121:6813/16993","heartbeat_back_addr":"172.21.15.121:6815/16993","heartbeat_front_addr":"172.21.15.121:6814/16993","state":["exists","up"]},{"osd":7,"uuid":"3945180c-c2bc-45f2-849d-0c8e25847190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6804","nonce":16970}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6805","nonce":16970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6807","nonce":16970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6806","nonce":16970}]},"public_addr":"172.21.15.121:6804/16970","cluster_addr":"172.21.15.121:6805/16970","heartbeat_back_addr":"172.21.15.121:6807/16970","heartbeat_front_addr":"172.21.15.121:6806/16970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.646913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.909105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.899998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.354995+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.038975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.987185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.454667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.638880+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[7,3,4]},{"pgid":"3.1","osds":[1,6,5]},{"pgid":"4.e","osds":[3,4,7]}],"pg_upmap_items":[{"pgid":"1.0","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
, 2021-02-27T13:43:47.571 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats
, 2021-02-27T13:43:47.742 INFO:teuthology.orchestra.run.smithi085.stdout:55834574873

2021-02-28T06:28:15.050 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 4 to deep-scrub
, 2021-02-27T13:43:58.228 INFO:tasks.ceph:Scrubbing osd.5
, 2021-02-27T13:43:58.229 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0

2021-02-28T06:28:15.051 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 479, in wait
,     proc.wait()

2021-02-28T06:28:15.052 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:45:05.256 DEBUG:teuthology.orchestra.run.smithi085:> sudo tar cz -f - -C /var/lib/ceph/crash -- .
, 2021-02-27T13:45:05.274 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/myoungwon-2021-02-23_10:10:24-rados-wip-manifest-dedup-test-distro-basic-smithi/5907228/remote/smithi121/crash
, 2021-02-27T13:45:05.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2021-02-28T06:28:15.052 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 286, in task
,     running.get()
,   File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get

2021-02-28T06:28:15.152 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fa077edb79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fa077edb978]

2021-02-28T06:28:15.153 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:23.918719+0000",
, 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.026545863999999999
, 2021-02-27T13:43:30.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.153 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.707 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:23.918644+0000",
, 2021-02-27T13:43:30.707 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.048208938999999999
, 2021-02-27T13:43:30.708 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.154 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.728 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.467977+0000",
, 2021-02-27T13:43:30.729 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.25961466300000002
, 2021-02-27T13:43:30.729 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.155 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.467962+0000",
, 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 8.3911000000000003e-05
, 2021-02-27T13:43:30.750 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.155 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.468054+0000",
, 2021-02-27T13:43:30.782 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 1.2649e-05
, 2021-02-27T13:43:30.783 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.156 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.733756+0000",
, 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 5.4023000000000001e-05
, 2021-02-27T13:43:30.806 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.156 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.733988+0000",
, 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 1.4584e-05
, 2021-02-27T13:43:30.827 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.157 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.848 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:22.734066+0000",
, 2021-02-27T13:43:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.999969
, 2021-02-27T13:43:30.849 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.158 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                    "tid": 1537
, 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                },
, 2021-02-27T13:43:30.870 INFO:teuthology.orchestra.run.smithi121.stdout:                "events": [

2021-02-28T06:28:15.158 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.891 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.840239+0000",
, 2021-02-27T13:43:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.999908
, 2021-02-27T13:43:30.892 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.159 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.912 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.848967+0000",
, 2021-02-27T13:43:30.913 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.90969941700000001
, 2021-02-27T13:43:30.913 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.159 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.933 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client_addr": "v1:172.21.15.85:0/3768588230",
, 2021-02-27T13:43:30.934 INFO:teuthology.orchestra.run.smithi121.stdout:                    "tid": 5007
, 2021-02-27T13:43:30.934 INFO:teuthology.orchestra.run.smithi121.stdout:                },

2021-02-28T06:28:15.160 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "queued_for_pg",
, 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.852659+0000",
, 2021-02-27T13:43:30.955 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.9179999999999997e-05

2021-02-28T06:28:15.161 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:30.976 INFO:teuthology.orchestra.run.smithi121.stdout:        {

2021-02-28T06:28:15.161 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "all_read",
, 2021-02-27T13:43:30.997 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:54.921055+0000",

2021-02-28T06:28:15.162 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.018 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "commit_sent",
, 2021-02-27T13:43:31.019 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:56.969341+0000",

2021-02-28T06:28:15.163 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.039 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.039 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.040 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",

2021-02-28T06:28:15.163 WARNING:scrape:Ignoring malparsed backtrace:     raise CommandCrashedError(command=self.command)
, teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_redirect --low_tier_pool low_tier --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 50 --op write 50 --op delete 10 --op tier_promote 30 --op write_excl 50 --pool unique_pool_0'
, 2021-02-27T13:43:31.069 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds

2021-02-28T06:28:15.164 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4.7318000000000003e-05
, 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.513 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.165 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.420108168
, 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:31.545 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:15.165 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:38.822222+0000",
, 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 9.9620000000000005e-06
, 2021-02-27T13:43:31.569 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.166 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:        {
, 2021-02-27T13:43:31.591 INFO:teuthology.orchestra.run.smithi121.stdout:            "description": "osd_repop(client.4472.0:3012 3.1 e48/36 3:91b7a324:::smithi08521406-765 low_tier mmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmmm:head v 48'199, mlcod=48'194)",

2021-02-28T06:28:15.168 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",
, 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:44.829574+0000",
, 2021-02-27T13:43:31.614 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 3.0858999999999997e-05

2021-02-28T06:28:15.168 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "header_read",
, 2021-02-27T13:43:31.641 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:44.890885+0000",

2021-02-28T06:28:15.169 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:31.666 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:15.170 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.686 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:31.687 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",

2021-02-28T06:28:15.170 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999828
, 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:31.711 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.171 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.28086183100000001
, 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:31.737 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:15.172 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:45.305835+0000",
, 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.047658732000000002
, 2021-02-27T13:43:31.762 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.172 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",
, 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.128272+0000",
, 2021-02-27T13:43:31.787 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999738

2021-02-28T06:28:15.173 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:31.811 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",
, 2021-02-27T13:43:31.812 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.570787+0000",
, 2021-02-27T13:43:31.812 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.382520792

2021-02-28T06:28:15.173 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.257 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:38.842760+0000",
, 2021-02-27T13:43:32.257 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.023849760000000001
, 2021-02-27T13:43:32.258 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.174 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:        },
, 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:        {
, 2021-02-27T13:43:32.279 INFO:teuthology.orchestra.run.smithi121.stdout:            "description": "osd_repop(client.4472.0:2717 3.0 e45/18 3:21c98165:::smithi08521406-470 low_tier:head v 45'128, mlcod=44'124)",

2021-02-28T06:28:15.175 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",
, 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:39.138156+0000",
, 2021-02-27T13:43:32.300 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.000196054

2021-02-28T06:28:15.175 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "header_read",
, 2021-02-27T13:43:32.321 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:39.692225+0000",

2021-02-28T06:28:15.176 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:32.342 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:15.177 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.367 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "reached_pg",

2021-02-28T06:28:15.177 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999733
, 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:32.388 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.178 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.408 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.37533145400000001
, 2021-02-27T13:43:32.409 INFO:teuthology.orchestra.run.smithi121.stdout:                    }
, 2021-02-27T13:43:32.409 INFO:teuthology.orchestra.run.smithi121.stdout:                ]

2021-02-28T06:28:15.179 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:45.788358+0000",
, 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.090980637000000003
, 2021-02-27T13:43:32.429 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.179 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.449 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",
, 2021-02-27T13:43:32.450 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.064336+0000",
, 2021-02-27T13:43:32.450 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 4294967295.9999747

2021-02-28T06:28:15.180 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",
, 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.629140+0000",
, 2021-02-27T13:43:32.470 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0.499579826

2021-02-28T06:28:15.181 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "queued_for_pg",
, 2021-02-27T13:43:32.491 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:46.263622+0000",

2021-02-28T06:28:15.181 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.767 INFO:teuthology.orchestra.run.smithi121.stdout:}
, set osd.0 primary-affinity to 1 (8655362)
, 2021-02-27T13:43:32.779 DEBUG:teuthology.orchestra.run.smithi121:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops

2021-02-28T06:28:15.182 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.933 INFO:teuthology.orchestra.run.smithi121.stdout:                ]
, 2021-02-27T13:43:32.934 INFO:teuthology.orchestra.run.smithi121.stdout:            }
, 2021-02-27T13:43:32.934 INFO:teuthology.orchestra.run.smithi121.stdout:        },

2021-02-28T06:28:15.183 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.958 INFO:teuthology.orchestra.run.smithi121.stdout:            "initiated_at": "2021-02-27T13:42:19.435199+0000",
, 2021-02-27T13:43:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:            "age": 73.474023082000002,
, 2021-02-27T13:43:32.959 INFO:teuthology.orchestra.run.smithi121.stdout:            "duration": 0.52637023299999997,

2021-02-28T06:28:15.184 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:                "client_info": {
, 2021-02-27T13:43:32.980 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client": "client.4472",
, 2021-02-27T13:43:32.981 INFO:teuthology.orchestra.run.smithi121.stdout:                    "client_addr": "v1:172.21.15.85:0/3768588230",

2021-02-28T06:28:15.184 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.001 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.002 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "throttled",

2021-02-28T06:28:15.186 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.023 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "done",

2021-02-28T06:28:15.187 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.2899999999999997e-06
, 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.044 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.188 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.065 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.102174+0000",
, 2021-02-27T13:43:33.066 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 0
, 2021-02-27T13:43:33.066 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.189 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.305705+0000",
, 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 6.6191000000000004e-05
, 2021-02-27T13:43:33.087 INFO:teuthology.orchestra.run.smithi121.stdout:                    },

2021-02-28T06:28:15.190 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "dispatched",
, 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.136706+0000",
, 2021-02-27T13:43:33.108 INFO:teuthology.orchestra.run.smithi121.stdout:                        "duration": 7.6120000000000001e-06

2021-02-28T06:28:15.190 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.129 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "initiated",
, 2021-02-27T13:43:33.130 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.142409+0000",

2021-02-28T06:28:15.191 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.150 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "commit_sent",
, 2021-02-27T13:43:33.151 INFO:teuthology.orchestra.run.smithi121.stdout:                        "time": "2021-02-27T13:42:24.342916+0000",

2021-02-28T06:28:15.195 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                    },
, 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                    {
, 2021-02-27T13:43:33.172 INFO:teuthology.orchestra.run.smithi121.stdout:                        "event": "dispatched",

2021-02-28T06:28:15.198 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                "flag_point": "commit sent; apply or cleanup",
, 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                "events": [
, 2021-02-27T13:43:33.193 INFO:teuthology.orchestra.run.smithi121.stdout:                    {

2021-02-28T06:28:15.201 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:43:47.557 INFO:teuthology.orchestra.run.smithi085.stdout:{"epoch":92,"fsid":"da6b30e2-1a3a-4547-88be-f3addb958f36","created":"2021-02-27T13:41:48.953373+0000","modified":"2021-02-27T13:43:46.909479+0000","last_up_change":"2021-02-27T13:41:58.891397+0000","last_in_change":"2021-02-27T13:42:21.829573+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2021-02-27T13:41:57.942764+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"rbd","create_time":"2021-02-27T13:41:59.917535+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"17","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}}},{"pool":3,"pool_name":"low_tier","create_time":"2021-02-27T13:42:10.214932+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":4,"pg_placement_num":4,"pg_placement_num_target":4,"pg_num_target":4,"pg_num_pending":4,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{}},{"pool":4,"pool_name":"unique_pool_0","create_time":"2021-02-27T13:42:11.161758+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":16,"pg_placement_num":16,"pg_placement_num_target":16,"pg_num_target":16,"pg_num_pending":16,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rados":{}}}],"osds":[{"osd":0,"uuid":"59a508d1-be18-4084-9dbf-f488ebabe385","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":82,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6804","nonce":16848}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6805","nonce":16848}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6807","nonce":16848}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6806","nonce":16848}]},"public_addr":"172.21.15.85:6804/16848","cluster_addr":"172.21.15.85:6805/16848","heartbeat_back_addr":"172.21.15.85:6807/16848","heartbeat_front_addr":"172.21.15.85:6806/16848","state":["exists","up"]},{"osd":1,"uuid":"ea0d9f7b-f7de-496f-960b-519e63834f49","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":83,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6800","nonce":16847}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6801","nonce":16847}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6803","nonce":16847}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6802","nonce":16847}]},"public_addr":"172.21.15.85:6800/16847","cluster_addr":"172.21.15.85:6801/16847","heartbeat_back_addr":"172.21.15.85:6803/16847","heartbeat_front_addr":"172.21.15.85:6802/16847","state":["exists","up"]},{"osd":2,"uuid":"1c79c7eb-7dea-41a2-b814-e30bf576eb9d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":56,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6812","nonce":16857}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6813","nonce":16857}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6815","nonce":16857}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6814","nonce":16857}]},"public_addr":"172.21.15.85:6812/16857","cluster_addr":"172.21.15.85:6813/16857","heartbeat_back_addr":"172.21.15.85:6815/16857","heartbeat_front_addr":"172.21.15.85:6814/16857","state":["exists","up"]},{"osd":3,"uuid":"11ca03fe-4dc9-40bc-bb3d-ab6509b94ffe","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":74,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6808","nonce":16858}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6809","nonce":16858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6811","nonce":16858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.85:6810","nonce":16858}]},"public_addr":"172.21.15.85:6808/16858","cluster_addr":"172.21.15.85:6809/16858","heartbeat_back_addr":"172.21.15.85:6811/16858","heartbeat_front_addr":"172.21.15.85:6810/16858","state":["exists","up"]},{"osd":4,"uuid":"098441ce-6f22-406d-9663-a220e46ee4cc","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6800","nonce":16968}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6801","nonce":16968}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6803","nonce":16968}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6802","nonce":16968}]},"public_addr":"172.21.15.121:6800/16968","cluster_addr":"172.21.15.121:6801/16968","heartbeat_back_addr":"172.21.15.121:6803/16968","heartbeat_front_addr":"172.21.15.121:6802/16968","state":["exists","up"]},{"osd":5,"uuid":"e8d23c6e-db5e-49d7-9957-2f2bdc193be8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":45,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6808","nonce":16994}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6809","nonce":16994}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6811","nonce":16994}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6810","nonce":16994}]},"public_addr":"172.21.15.121:6808/16994","cluster_addr":"172.21.15.121:6809/16994","heartbeat_back_addr":"172.21.15.121:6811/16994","heartbeat_front_addr":"172.21.15.121:6810/16994","state":["exists","up"]},{"osd":6,"uuid":"617e8c68-025d-43b1-99f9-3681ea7ab74f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":60,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6812","nonce":16993}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6813","nonce":16993}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6815","nonce":16993}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6814","nonce":16993}]},"public_addr":"172.21.15.121:6812/16993","cluster_addr":"172.21.15.121:6813/16993","heartbeat_back_addr":"172.21.15.121:6815/16993","heartbeat_front_addr":"172.21.15.121:6814/16993","state":["exists","up"]},{"osd":7,"uuid":"3945180c-c2bc-45f2-849d-0c8e25847190","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":54,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6804","nonce":16970}]},"cluster_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6805","nonce":16970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6807","nonce":16970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v1","addr":"172.21.15.121:6806","nonce":16970}]},"public_addr":"172.21.15.121:6804/16970","cluster_addr":"172.21.15.121:6805/16970","heartbeat_back_addr":"172.21.15.121:6807/16970","heartbeat_front_addr":"172.21.15.121:6806/16970","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.646913+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.909105+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.899998+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.354995+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.038975+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:56.987185+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.454667+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2021-02-27T13:42:57.638880+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"2.4","osds":[7,3,4]},{"pgid":"3.1","osds":[1,6,5]},{"pgid":"4.e","osds":[3,4,7]}],"pg_upmap_items":[{"pgid":"1.0","mappings":[{"from":0,"to":4}]}],"pg_temp":[],"primary_temp":[],"blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","ruleset-failure-domain":"osd","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}}
, 2021-02-27T13:43:47.571 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats
, 2021-02-27T13:43:47.742 INFO:teuthology.orchestra.run.smithi085.stdout:55834574873

2021-02-28T06:28:15.204 WARNING:scrape:Ignoring malparsed backtrace: instructed osd(s) 4 to deep-scrub
, 2021-02-27T13:43:58.228 INFO:tasks.ceph:Scrubbing osd.5
, 2021-02-27T13:43:58.229 DEBUG:teuthology.orchestra.run.smithi085:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0

2021-02-28T06:28:15.205 WARNING:scrape:Ignoring malparsed backtrace:     run.wait(tests.values())
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/orchestra/run.py", line 479, in wait
,     proc.wait()

2021-02-28T06:28:15.207 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:45:05.256 DEBUG:teuthology.orchestra.run.smithi085:> sudo tar cz -f - -C /var/lib/ceph/crash -- .
, 2021-02-27T13:45:05.274 DEBUG:teuthology.misc:Transferring archived files from smithi121:/var/lib/ceph/crash to /home/teuthworker/archive/myoungwon-2021-02-23_10:10:24-rados-wip-manifest-dedup-test-distro-basic-smithi/5907228/remote/smithi121/crash
, 2021-02-27T13:45:05.276 DEBUG:teuthology.orchestra.run.smithi121:> sudo tar cz -f - -C /var/lib/ceph/crash -- .

2021-02-28T06:28:15.208 WARNING:scrape:Ignoring malparsed backtrace:   File "/home/teuthworker/src/git.ceph.com_ceph-c_7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69/qa/tasks/rados.py", line 286, in task
,     running.get()
,   File "src/gevent/greenlet.py", line 709, in gevent._greenlet.Greenlet.get

2021-02-28T06:28:15.633 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fcb7371a79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fcb7371a978]

2021-02-28T06:28:15.636 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:49:19.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0
, 2021-02-27T13:49:20.049 INFO:teuthology.orchestra.run.smithi060.stdout:{
, 2021-02-27T13:49:20.050 INFO:teuthology.orchestra.run.smithi060.stdout:    "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) "

2021-02-28T06:28:15.637 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:50:02.448 INFO:teuthology.orchestra.run:waiting for 300
, 2021-02-27T13:50:02.523 INFO:tasks.ceph.osd.2:Stopped
, 2021-02-27T13:50:02.525 DEBUG:tasks.ceph.osd.3:waiting for process to exit

2021-02-28T06:28:15.639 WARNING:scrape:Ignoring malparsed backtrace:     yield
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/run_tasks.py", line 176, in run_tasks
,     suppress = manager.__exit__(*exc_info)

2021-02-28T06:28:15.640 WARNING:scrape:Ignoring malparsed backtrace: During handling of the above exception, another exception occurred:
, 
, Traceback (most recent call last):

2021-02-28T06:28:15.688 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fcb7371a79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fcb7371a978]

2021-02-28T06:28:15.690 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:49:19.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0
, 2021-02-27T13:49:20.049 INFO:teuthology.orchestra.run.smithi060.stdout:{
, 2021-02-27T13:49:20.050 INFO:teuthology.orchestra.run.smithi060.stdout:    "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) "

2021-02-28T06:28:15.691 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:50:02.448 INFO:teuthology.orchestra.run:waiting for 300
, 2021-02-27T13:50:02.523 INFO:tasks.ceph.osd.2:Stopped
, 2021-02-27T13:50:02.525 DEBUG:tasks.ceph.osd.3:waiting for process to exit

2021-02-28T06:28:15.691 WARNING:scrape:Ignoring malparsed backtrace:     yield
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/run_tasks.py", line 176, in run_tasks
,     suppress = manager.__exit__(*exc_info)

2021-02-28T06:28:15.692 WARNING:scrape:Ignoring malparsed backtrace: During handling of the above exception, another exception occurred:
, 
, Traceback (most recent call last):

2021-02-28T06:28:15.730 WARNING:scrape:Ignoring malparsed backtrace:  ceph version 17.0.0-571-g7b4bf320 (7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69) quincy (dev)
,  1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7fcb7371a79d]
,  2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7fcb7371a978]

2021-02-28T06:28:15.732 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:49:19.883 DEBUG:teuthology.orchestra.run.smithi060:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0
, 2021-02-27T13:49:20.049 INFO:teuthology.orchestra.run.smithi060.stdout:{
, 2021-02-27T13:49:20.050 INFO:teuthology.orchestra.run.smithi060.stdout:    "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) "

2021-02-28T06:28:15.733 WARNING:scrape:Ignoring malparsed backtrace: 2021-02-27T13:50:02.448 INFO:teuthology.orchestra.run:waiting for 300
, 2021-02-27T13:50:02.523 INFO:tasks.ceph.osd.2:Stopped
, 2021-02-27T13:50:02.525 DEBUG:tasks.ceph.osd.3:waiting for process to exit

2021-02-28T06:28:15.734 WARNING:scrape:Ignoring malparsed backtrace:     yield
,   File "/home/teuthworker/src/git.ceph.com_git_teuthology_9a6b849c7975e1b07e5495aaa5b961c0d22cad1c/teuthology/run_tasks.py", line 176, in run_tasks
,     suppress = manager.__exit__(*exc_info)

2021-02-28T06:28:15.735 WARNING:scrape:Ignoring malparsed backtrace: During handling of the above exception, another exception occurred:
, 
, Traceback (most recent call last):

2021-02-28T06:28:15.747 INFO:scrape:Found 5 distinct failure reasons
2021-02-28T06:28:15.748 INFO:scrape:Failure: Command failed (workunit test rados/test.sh) on smithi122 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh'
2021-02-28T06:28:15.752 INFO:scrape:6 jobs: ['5907300', '5907217', '5907272', '5907234', '5907154', '5907172']
2021-02-28T06:28:15.753 INFO:scrape:suites intersection: ['rados', 'supported-random-distro$/{ubuntu_latest}']
2021-02-28T06:28:15.754 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/3-mons', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/monthrash/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests}', 'thrashers/careful', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashosds-health', 'workloads/rados_api_tests}']
2021-02-28T06:28:15.754 INFO:scrape:
2021-02-28T06:28:15.755 INFO:scrape:Failure: Found coredumps on ubuntu@smithi166.front.sepia.ceph.com
2021-02-28T06:28:15.756 INFO:scrape:2 jobs: ['5907288', '5907158']
2021-02-28T06:28:15.757 INFO:scrape:suites intersection: ['rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{ubuntu_latest}}']
2021-02-28T06:28:15.758 INFO:scrape:suites union: ['mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/many', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{ubuntu_latest}}']
2021-02-28T06:28:15.759 INFO:scrape:
2021-02-28T06:28:15.760 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_redirect --low_tier_pool low_tier --max-ops 4000 --objects 500 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 50 --op write 50 --op delete 10 --op tier_promote 30 --op write_excl 50 --pool unique_pool_0'
2021-02-28T06:28:15.760 INFO:scrape:6 jobs: ['5907261', '5907219', '5907356', '5907301', '5907228', '5907237']
2021-02-28T06:28:15.761 INFO:scrape:suites intersection: ['ceph', 'clusters/{fixed-2', 'openstack}', 'rados', 'supported-random-distro$/{ubuntu_latest}', 'thrashosds-health', 'workloads/redirect_promote_tests}']
2021-02-28T06:28:15.761 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashers/none', 'thrashosds-health', 'workloads/redirect_promote_tests}']
2021-02-28T06:28:15.762 INFO:scrape:
2021-02-28T06:28:15.763 INFO:scrape:Dead: b'2021-02-26T09:15:33.931 DEBUG:teuthology.exit:Finished running handlers'
2021-02-28T06:28:15.763 INFO:scrape:3 jobs: ['5907196', '5907309', '5907174']
2021-02-28T06:28:15.764 INFO:scrape:suites intersection: ['clusters/{fixed-2', 'msgr-failures/fastclose', 'openstack}', 'rados', 'supported-random-distro$/{ubuntu_latest}', 'thrashosds-health']
2021-02-28T06:28:15.765 INFO:scrape:suites union: ['1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-partial-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'fast/normal', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async-v1only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash-erasure-code/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'recovery-overrides/{more-async-recovery}', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/careful', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/ec-radosbench}', 'workloads/snaps-few-objects}', 'workloads/write_fadvise_dontneed}']
2021-02-28T06:28:15.765 INFO:scrape:
2021-02-28T06:28:15.766 INFO:scrape:Failure: Command failed on smithi064 with status 128: 'rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone git://git.ceph.com/ceph.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 7b4bf320a7ec9cdc1cb85a21a35a5b10eeae9c69'
2021-02-28T06:28:15.767 INFO:scrape:2 jobs: ['5907354', '5907364']
2021-02-28T06:28:15.767 INFO:scrape:suites intersection: ['rados']
2021-02-28T06:28:15.768 INFO:scrape:suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async', 'objectstore/bluestore-comp-snappy', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/pool-access', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/none', 'thrashosds-health', 'workloads/rados_api_tests}']
2021-02-28T06:28:15.769 INFO:scrape: