2022-05-01T03:37:41.166 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-01T03:37:41.167 INFO:teuthology.results:subset: '1/4' 2022-05-01T03:37:41.167 INFO:teuthology.results:seed: '4783' 2022-05-01T04:10:55.313 INFO:root:teuthology version: 1.1.1.dev331+gfd5c3166 2022-05-01T04:10:55.339 INFO:teuthology.results:Waiting up to 43200 seconds for tests to finish... 2022-05-01T10:42:25.987 INFO:teuthology.results:Tests finished! gathering results... 2022-05-01T10:42:30.403 INFO:scrape:Found 45 jobs 2022-05-01T10:42:30.767 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-11854-g7e2ba75f (7e2ba75f07d12b6d8e925d4291e3d3c5168d80cb) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f59310de114] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f59310de335] 2022-05-01T10:42:30.767 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 165.34371991500001, , 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.79822107499999995, , 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:30.768 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", , 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:27:13.021813+0000", 2022-05-01T10:42:30.768 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "commit_sent", , 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:27:15.429554+0000", 2022-05-01T10:42:30.768 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:27:14.821435+0000", , 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 163.54397385499999, , 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.61002250300000005, 2022-05-01T10:42:30.768 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.463 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.463 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "dispatched", 2022-05-01T10:42:30.769 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting_for_map not empty", 2022-05-01T10:42:30.769 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.503 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.503 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:30.769 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", 2022-05-01T10:42:30.769 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:30.769 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.569 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.569 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for degraded object", 2022-05-01T10:42:30.770 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:30.770 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:30.770 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.601 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.602 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for subops from 6,7", 2022-05-01T10:42:30.771 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:30.771 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "description": "osd_op(client.4455.0:7064 3.5 3:a09ddd8e:::smithi06197363-888:head [write 1929332~491206] snapc c8=[c8,c6,c5,c4,c3,c1,be,b5,b4,b0,ac,a8,a2] ondisk+write+known_if_redirected+supports_pool_eio e244)", , 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:29:27.804769+0000", , 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 30.560639985999998, 2022-05-01T10:42:30.771 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:30.771 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 5.7226999999999999e-05 , 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:30.772 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5339809390000001, , 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { , 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2022-05-01T10:42:30.772 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", , 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 140 , 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2022-05-01T10:42:30.772 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", , 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.254057+0000", , 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9273000000000002e-05 2022-05-01T10:42:30.772 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.889696+0000", , 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.63557935899999995 2022-05-01T10:42:30.773 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:36.308535+0000", , 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.143439328 2022-05-01T10:42:30.773 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:36.532607+0000", , 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.22404791199999999 2022-05-01T10:42:30.773 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 256.59385050200001, , 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.451711459, , 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2022-05-01T10:42:30.773 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.273 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.274 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", , 2022-05-01T04:29:59.274 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 2885 2022-05-01T10:42:30.774 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", , 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.150976+0000", 2022-05-01T10:42:30.774 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.823546+0000", 2022-05-01T10:42:30.774 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.924465+0000", 2022-05-01T10:42:30.774 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.320 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:50.640007+0000", 2022-05-01T10:42:30.775 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:50.640570+0000", 2022-05-01T10:42:30.775 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.101230+0000", 2022-05-01T10:42:30.775 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:30.775 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2022-05-01T10:42:30.776 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for degraded object", 2022-05-01T10:42:30.776 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.778 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, , 2022-05-01T04:29:59.778 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ , 2022-05-01T04:29:59.779 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:30.776 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.788 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.789 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", , 2022-05-01T04:29:59.789 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.258436+0000", 2022-05-01T10:42:30.776 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.259144+0000", 2022-05-01T10:42:30.777 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", , 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.259193+0000", 2022-05-01T10:42:30.777 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.331931+0000", 2022-05-01T10:42:30.777 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.847377+0000", 2022-05-01T10:42:30.777 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2,3", , 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:52.042695+0000", 2022-05-01T10:42:30.777 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.849 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:29:59.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:52.457260+0000", 2022-05-01T10:42:30.778 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2022-05-01T04:25:49.424986+0000", , 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 250.35124122400001, , 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6264513410000001, 2022-05-01T10:42:30.778 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:30.778 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ , 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2022-05-01T10:42:30.778 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2022-05-01T10:42:30.779 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2022-05-01T10:42:30.779 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2022-05-01T10:42:30.779 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2022-05-01T10:42:30.779 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.982 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 6,7", 2022-05-01T10:42:30.780 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2022-05-01T10:42:30.780 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:30.780 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.015 INFO:teuthology.orchestra.run.smithi136.stdout: } , 2022-05-01T04:30:00.016 INFO:teuthology.orchestra.run.smithi136.stdout: ] , 2022-05-01T04:30:00.016 INFO:teuthology.orchestra.run.smithi136.stdout: } 2022-05-01T10:42:30.780 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.422013+0000", , 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.40178407399999999 2022-05-01T10:42:30.781 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.448 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 272.10812970900002, , 2022-05-01T04:30:00.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1152526899999999, , 2022-05-01T04:30:00.449 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2022-05-01T10:42:30.781 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.307854+0000", 2022-05-01T10:42:30.781 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.475 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.476 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", , 2022-05-01T04:30:00.476 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.307960+0000", 2022-05-01T10:42:30.781 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.523043+0000", 2022-05-01T10:42:30.782 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.928874+0000", 2022-05-01T10:42:30.782 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:30.782 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2022-05-01T10:42:30.782 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.532 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.532 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 1,4", 2022-05-01T10:42:30.783 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2022-05-01T10:42:30.783 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:30.783 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: } , 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: ] , 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: } 2022-05-01T10:42:30.783 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4455.0:1778 3.a 3:53a403a1:::smithi06197363-398:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e24)", , 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2022-05-01T04:25:36.695333+0000", , 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 263.72001420200002, 2022-05-01T10:42:30.784 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 , 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:30.784 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.99999 , 2022-05-01T04:30:00.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:30.784 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.101112457 , 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:30.784 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7070999999999997e-05 , 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:30.785 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.821119+0000", , 2022-05-01T04:30:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6906e-05 2022-05-01T10:42:30.785 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:42.446962+0000", , 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.52507275200000003 2022-05-01T10:42:30.785 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:42.450351+0000", , 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9092999999999996e-05 2022-05-01T10:42:30.785 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.561503+0000", , 2022-05-01T04:30:01.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0105489990000001 2022-05-01T10:42:30.786 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", , 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.866227+0000", , 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000105265 2022-05-01T10:42:30.786 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:30:01.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.866671+0000", , 2022-05-01T04:30:01.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1624000000000005e-05 2022-05-01T10:42:30.786 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", , 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.582716+0000", 2022-05-01T10:42:30.786 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.197 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.198 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:30:01.198 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.582989+0000", 2022-05-01T10:42:30.787 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", , 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.583036+0000", 2022-05-01T10:42:30.787 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.459659+0000", 2022-05-01T10:42:30.787 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.459820+0000", 2022-05-01T10:42:30.787 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.869578+0000", 2022-05-01T10:42:30.788 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.870154+0000", 2022-05-01T10:42:30.788 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:44.477163+0000", 2022-05-01T10:42:30.788 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", , 2022-05-01T04:30:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:44.576950+0000", 2022-05-01T10:42:30.788 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:30:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:30:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:30.789 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ , 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2022-05-01T10:42:30.789 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2022-05-01T10:42:30.789 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 1.8369999999999999e-05 , 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:30.789 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.100218394 , 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:30.790 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.786 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:52.881169+0000", , 2022-05-01T04:30:01.787 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 1.9573e-05 , 2022-05-01T04:30:01.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-05-01T10:42:30.790 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "throttled", , 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:57.746561+0000", , 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 2022-05-01T10:42:30.790 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 3.7012903449999999, , 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.2022516, , 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:30.790 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", , 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:58.569471+0000", 2022-05-01T10:42:30.791 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:30.791 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.00045464499999999999 , 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:30.791 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:59.998668+0000", , 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-05-01T10:42:30.791 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.10288931900000001, , 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { , 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "flag_point": "started", 2022-05-01T10:42:30.792 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", , 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:30:00.993658+0000", , 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.0014074020000000001 2022-05-01T10:42:30.792 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:30:01.503016+0000", 2022-05-01T10:42:30.792 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.402 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 30.478786020000001, , 2022-05-01T04:30:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.41085582700000001, , 2022-05-01T04:30:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:30.792 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "dispatched", , 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:31.918835+0000", 2022-05-01T10:42:30.793 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", , 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:32.019048+0000", 2022-05-01T10:42:30.793 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for blocked object", , 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:32.368585+0000", 2022-05-01T10:42:30.793 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "op_commit", , 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.083575+0000", 2022-05-01T10:42:30.793 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.192148+0000", 2022-05-01T10:42:30.794 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.491318+0000", 2022-05-01T10:42:30.794 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: "events": [ , 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "initiated", 2022-05-01T10:42:30.794 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client_info": { , 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client": "client.4455", , 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:30.794 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:29:42.789238+0000", , 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 19.608178676000001, , 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.40311962699999998, 2022-05-01T10:42:30.795 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "header_read", 2022-05-01T10:42:30.795 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "throttled", 2022-05-01T10:42:30.795 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "header_read", 2022-05-01T10:42:30.800 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.598 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.598 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "all_read", 2022-05-01T10:42:30.800 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:30.801 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:30.801 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", 2022-05-01T10:42:30.801 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:30:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:30.801 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:13.025 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 , reweighted osd.7 to 1 (10000) , 2022-05-01T04:30:14.038 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2022-05-01T10:42:30.809 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:23.813 INFO:teuthology.orchestra.run.smithi061.stdout: , dumped all , 2022-05-01T04:30:23.825 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2022-05-01T04:30:23.278784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3095203105,"num_objects":1168,"num_object_clones":201,"num_object_copies":3504,"num_objects_missing_on_primary":82,"num_objects_missing":82,"num_objects_degraded":133,"num_objects_misplaced":309,"num_objects_unfound":0,"num_objects_dirty":1168,"num_whiteouts":30,"num_read":3828,"num_read_kb":1765564,"num_write":7625,"num_write_kb":2038597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3548,"num_bytes_recovered":3906462674,"num_keys_recovered":1880,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12998,"ondisk_log_size":12998,"up":105,"acting":103,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5618844,"kb_used_data":5318748,"kb_used_omap":655,"kb_used_meta":299376,"kb_avail":749355876,"statfs":{"total":773094113280,"available":767340417024,"internally_reserved":0,"allocated":5446397952,"data_stored":5679194944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":671085,"internal_metadata":306561683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-74,"num_objects_missing":-74,"num_objects_degraded":-142,"num_objects_misplaced":-72,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-39,"num_bytes_recovered":-47056945,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225277"},"pg_stats":[{"pgid":"3.19","version":"272'501","reported_seq":1324,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177697+0000","last_change":"2022-05-01T04:30:11.500632+0000","last_active":"2022-05-01T04:30:19.177697+0000","last_peered":"2022-05-01T04:30:19.177697+0000","last_clean":"2022-05-01T04:30:19.177697+0000","last_became_active":"2022-05-01T04:30:11.294414+0000","last_became_peered":"2022-05-01T04:30:11.294414+0000","last_unstale":"2022-05-01T04:30:19.177697+0000","last_undegraded":"2022-05-01T04:30:19.177697+0000","last_fullsized":"2022-05-01T04:30:19.177697+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":5,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":501,"ondisk_log_size":501,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.205175364,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":114,"num_read_kb":82076,"num_write":204,"num_write_kb":57354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":40234521,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.18","version":"273'465","reported_seq":2334,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277719+0000","last_change":"2022-05-01T04:30:15.339106+0000","last_active":"2022-05-01T04:30:19.277719+0000","last_peered":"2022-05-01T04:30:19.277719+0000","last_clean":"2022-05-01T04:30:19.277719+0000","last_became_active":"2022-05-01T04:30:15.336684+0000","last_became_peered":"2022-05-01T04:30:15.336684+0000","last_unstale":"2022-05-01T04:30:19.277719+0000","last_undegraded":"2022-05-01T04:30:19.277719+0000","last_fullsized":"2022-05-01T04:30:19.277719+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":5,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.001352624,"stat_sum":{"num_bytes":96164905,"num_objects":40,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":2,"num_read":116,"num_read_kb":48609,"num_write":277,"num_write_kb":64535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":249,"num_bytes_recovered":275012362,"num_keys_recovered":150,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.17","version":"273'533","reported_seq":1864,"reported_epoch":295,"state":"active+recovery_wait+degraded","last_fresh":"2022-05-01T04:30:19.057547+0000","last_change":"2022-05-01T04:30:07.304715+0000","last_active":"2022-05-01T04:30:19.057547+0000","last_peered":"2022-05-01T04:30:19.057547+0000","last_clean":"2022-05-01T04:29:49.419159+0000","last_became_active":"2022-05-01T04:30:07.303342+0000","last_became_peered":"2022-05-01T04:30:07.303342+0000","last_unstale":"2022-05-01T04:30:19.057547+0000","last_undegraded":"2022-05-01T04:30:06.968327+0000","last_fullsized":"2022-05-01T04:30:19.057547+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":533,"ondisk_log_size":533,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":12,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":90,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":145444603,"num_keys_recovered":30,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":["0","4","7"],"object_location_counts":[{"shards":"0,3,4,7","objects":18},{"shards":"0,3,5","objects":-1},{"shards":"0,4,7","objects":26},{"shards":"0,7","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"1"}]},{"pgid":"3.16","version":"275'571","reported_seq":1900,"reported_epoch":296,"state":"peering","last_fresh":"2022-05-01T04:30:20.074891+0000","last_change":"2022-05-01T04:30:20.075228+0000","last_active":"2022-05-01T04:29:59.794431+0000","last_peered":"2022-05-01T04:29:59.192384+0000","last_clean":"2022-05-01T04:29:59.192384+0000","last_became_active":"2022-05-01T04:29:59.190893+0000","last_became_peered":"2022-05-01T04:29:59.190893+0000","last_unstale":"2022-05-01T04:30:20.074891+0000","last_undegraded":"2022-05-01T04:30:20.074891+0000","last_fullsized":"2022-05-01T04:30:20.074891+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":5,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":571,"ondisk_log_size":571,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.00047920800000000001,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":113,"num_read_kb":54635,"num_write":201,"num_write_kb":69191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967346,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1,3,4,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.15","version":"261'465","reported_seq":1966,"reported_epoch":296,"state":"active+recovering","last_fresh":"2022-05-01T04:30:20.587146+0000","last_change":"2022-05-01T04:30:19.922879+0000","last_active":"2022-05-01T04:30:20.587146+0000","last_peered":"2022-05-01T04:30:20.587146+0000","last_clean":"2022-05-01T04:29:44.969856+0000","last_became_active":"2022-05-01T04:30:17.351913+0000","last_became_peered":"2022-05-01T04:30:17.351913+0000","last_unstale":"2022-05-01T04:30:20.587146+0000","last_undegraded":"2022-05-01T04:30:20.587146+0000","last_fullsized":"2022-05-01T04:30:20.587146+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":33,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79997673,"num_objects":32,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":60,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":1,"num_read":104,"num_read_kb":29450,"num_write":244,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":208364605,"num_keys_recovered":150,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":["7","2","6"],"object_location_counts":[{"shards":"2,6,7","objects":30},{"shards":"3,4,7","objects":2}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"264'361","reported_seq":1626,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155646+0000","last_change":"2022-05-01T04:30:13.108744+0000","last_active":"2022-05-01T04:30:19.155646+0000","last_peered":"2022-05-01T04:30:19.155646+0000","last_clean":"2022-05-01T04:30:19.155646+0000","last_became_active":"2022-05-01T04:30:13.107986+0000","last_became_peered":"2022-05-01T04:30:13.107986+0000","last_unstale":"2022-05-01T04:30:19.155646+0000","last_undegraded":"2022-05-01T04:30:19.155646+0000","last_fullsized":"2022-05-01T04:30:19.155646+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":5,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83569378,"num_objects":30,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":179,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":132378397,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.13","version":"296'566","reported_seq":1353,"reported_epoch":296,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:20.480444+0000","last_change":"2022-05-01T04:30:20.287148+0000","last_active":"2022-05-01T04:30:20.480444+0000","last_peered":"2022-05-01T04:30:20.480444+0000","last_clean":"2022-05-01T04:30:20.480444+0000","last_became_active":"2022-05-01T04:30:20.285780+0000","last_became_peered":"2022-05-01T04:30:20.285780+0000","last_unstale":"2022-05-01T04:30:20.480444+0000","last_undegraded":"2022-05-01T04:30:20.480444+0000","last_fullsized":"2022-05-01T04:30:20.480444+0000","mapping_epoch":295,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":296,"parent":"0.0","parent_split_bits":5,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":10,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102081758,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":128,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":56033723,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"2"}]},{"pgid":"3.12","version":"273'535","reported_seq":1795,"reported_epoch":296,"state":"active+recovering+degraded","last_fresh":"2022-05-01T04:30:20.481519+0000","last_change":"2022-05-01T04:30:20.378621+0000","last_active":"2022-05-01T04:30:20.481519+0000","last_peered":"2022-05-01T04:30:20.481519+0000","last_clean":"2022-05-01T04:29:46.967195+0000","last_became_active":"2022-05-01T04:30:07.095952+0000","last_became_peered":"2022-05-01T04:30:07.095952+0000","last_unstale":"2022-05-01T04:30:20.481519+0000","last_undegraded":"2022-05-01T04:30:20.304415+0000","last_fullsized":"2022-05-01T04:30:20.481519+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":230,"parent":"0.0","parent_split_bits":5,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":30,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":8,"num_object_copies":129,"num_objects_missing_on_primary":30,"num_objects_missing":30,"num_objects_degraded":0,"num_objects_misplaced":63,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":2,"num_read":142,"num_read_kb":77693,"num_write":291,"num_write_kb":74977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":130444559,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":["1","4","6"],"object_location_counts":[{"shards":"0,1,4,6","objects":1},{"shards":"0,1,4,6,7","objects":1},{"shards":"0,3,7","objects":21},{"shards":"1,4,6","objects":20}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"}]},{"pgid":"3.11","version":"294'459","reported_seq":1935,"reported_epoch":295,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:19.155957+0000","last_change":"2022-05-01T04:30:16.442516+0000","last_active":"2022-05-01T04:30:19.155957+0000","last_peered":"2022-05-01T04:30:19.155957+0000","last_clean":"2022-05-01T04:30:19.155957+0000","last_became_active":"2022-05-01T04:30:16.337078+0000","last_became_peered":"2022-05-01T04:30:16.337078+0000","last_unstale":"2022-05-01T04:30:19.155957+0000","last_undegraded":"2022-05-01T04:30:19.155957+0000","last_fullsized":"2022-05-01T04:30:19.155957+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":459,"ondisk_log_size":459,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":17,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.0044887349999999998,"stat_sum":{"num_bytes":95657072,"num_objects":39,"num_object_clones":8,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":121,"num_read_kb":76398,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":183552292,"num_keys_recovered":160,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"3"}]},{"pgid":"3.10","version":"273'490","reported_seq":1683,"reported_epoch":296,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2022-05-01T04:30:20.474618+0000","last_change":"2022-05-01T04:30:20.224873+0000","last_active":"2022-05-01T04:30:20.474618+0000","last_peered":"2022-05-01T04:30:20.474618+0000","last_clean":"2022-05-01T04:29:56.885986+0000","last_became_active":"2022-05-01T04:30:02.988629+0000","last_became_peered":"2022-05-01T04:30:02.988629+0000","last_unstale":"2022-05-01T04:30:20.474618+0000","last_undegraded":"2022-05-01T04:30:20.165835+0000","last_fullsized":"2022-05-01T04:30:02.785753+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":5,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93110779,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":21,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":104,"num_read_kb":46934,"num_write":216,"num_write_kb":63007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":114601618,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0],"avail_no_missing":["6","1","2"],"object_location_counts":[{"shards":"0,6","objects":26},{"shards":"1,2,5,6","objects":1},{"shards":"1,2,6","objects":10}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.f","version":"277'540","reported_seq":1300,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.256155+0000","last_change":"2022-05-01T04:30:16.500449+0000","last_active":"2022-05-01T04:30:19.256155+0000","last_peered":"2022-05-01T04:30:19.256155+0000","last_clean":"2022-05-01T04:30:19.256155+0000","last_became_active":"2022-05-01T04:30:16.399454+0000","last_became_peered":"2022-05-01T04:30:16.399454+0000","last_unstale":"2022-05-01T04:30:19.256155+0000","last_undegraded":"2022-05-01T04:30:19.256155+0000","last_fullsized":"2022-05-01T04:30:19.256155+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'412","last_scrub_stamp":"2022-05-01T04:28:16.288822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:16.288822+0000","objects_scrubbed":63,"log_size":540,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81907881800000004,"objects_trimmed":0,"snaptrim_duration":0.72566574800000005,"stat_sum":{"num_bytes":198947307,"num_objects":70,"num_object_clones":8,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":2,"num_read":226,"num_read_kb":100373,"num_write":447,"num_write_kb":118211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":2944186,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.e","version":"276'657","reported_seq":1954,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.156852+0000","last_change":"2022-05-01T04:30:02.666116+0000","last_active":"2022-05-01T04:30:19.156852+0000","last_peered":"2022-05-01T04:30:19.156852+0000","last_clean":"2022-05-01T04:30:19.156852+0000","last_became_active":"2022-05-01T04:29:15.968177+0000","last_became_peered":"2022-05-01T04:29:15.968177+0000","last_unstale":"2022-05-01T04:30:19.156852+0000","last_undegraded":"2022-05-01T04:30:19.156852+0000","last_fullsized":"2022-05-01T04:30:19.156852+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'588","last_scrub_stamp":"2022-05-01T04:29:37.821007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.821007+0000","objects_scrubbed":80,"log_size":657,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:41.870002+0000","scrub_duration":0.62661968000000001,"objects_trimmed":0,"snaptrim_duration":0.88139935800000002,"stat_sum":{"num_bytes":238859551,"num_objects":88,"num_object_clones":14,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":2,"num_read":259,"num_read_kb":84476,"num_write":573,"num_write_kb":169626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":228132670,"num_keys_recovered":80,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.d","version":"273'434","reported_seq":1401,"reported_epoch":295,"state":"active+recovery_wait+degraded","last_fresh":"2022-05-01T04:30:19.156101+0000","last_change":"2022-05-01T04:30:17.631154+0000","last_active":"2022-05-01T04:30:19.156101+0000","last_peered":"2022-05-01T04:30:19.156101+0000","last_clean":"2022-05-01T04:29:49.001379+0000","last_became_active":"2022-05-01T04:30:17.429652+0000","last_became_peered":"2022-05-01T04:30:17.429652+0000","last_unstale":"2022-05-01T04:30:19.156101+0000","last_undegraded":"2022-05-01T04:30:17.148995+0000","last_fullsized":"2022-05-01T04:30:19.156101+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'315","last_scrub_stamp":"2022-05-01T04:28:14.235007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:14.235007+0000","objects_scrubbed":59,"log_size":434,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.154700571,"objects_trimmed":0,"snaptrim_duration":0.40905342099999997,"stat_sum":{"num_bytes":173196488,"num_objects":65,"num_object_clones":11,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":43,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":1,"num_read":184,"num_read_kb":90112,"num_write":428,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":78443415,"num_keys_recovered":60,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":["7","4","6"],"object_location_counts":[{"shards":"4,6,7","objects":26},{"shards":"5,6,7","objects":36},{"shards":"6,7","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"}]},{"pgid":"3.c","version":"265'484","reported_seq":2106,"reported_epoch":296,"state":"active+recovering+remapped","last_fresh":"2022-05-01T04:30:20.384354+0000","last_change":"2022-05-01T04:30:19.827029+0000","last_active":"2022-05-01T04:30:20.384354+0000","last_peered":"2022-05-01T04:30:20.384354+0000","last_clean":"2022-05-01T04:29:48.965884+0000","last_became_active":"2022-05-01T04:30:03.989010+0000","last_became_peered":"2022-05-01T04:30:03.989010+0000","last_unstale":"2022-05-01T04:30:20.384354+0000","last_undegraded":"2022-05-01T04:30:20.384354+0000","last_fullsized":"2022-05-01T04:30:20.384354+0000","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"249'466","last_scrub_stamp":"2022-05-01T04:29:36.465699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.465699+0000","objects_scrubbed":62,"log_size":484,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:52.684317+0000","scrub_duration":0.81548162000000002,"objects_trimmed":1,"snaptrim_duration":0.72789094899999995,"stat_sum":{"num_bytes":167437493,"num_objects":63,"num_object_clones":7,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":91,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":2,"num_read":271,"num_read_kb":161213,"num_write":425,"num_write_kb":112139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":374094922,"num_keys_recovered":40,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[0,3,6],"avail_no_missing":["0","1","6"],"object_location_counts":[{"shards":"0,1,3,6","objects":27},{"shards":"0,1,6","objects":32},{"shards":"0,3,6","objects":4}],"blocked_by":[],"up_primary":5,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.b","version":"261'397","reported_seq":1739,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277855+0000","last_change":"2022-05-01T04:30:07.810362+0000","last_active":"2022-05-01T04:30:19.277855+0000","last_peered":"2022-05-01T04:30:19.277855+0000","last_clean":"2022-05-01T04:30:19.277855+0000","last_became_active":"2022-05-01T04:30:07.195503+0000","last_became_peered":"2022-05-01T04:30:07.195503+0000","last_unstale":"2022-05-01T04:30:19.277855+0000","last_undegraded":"2022-05-01T04:30:19.277855+0000","last_fullsized":"2022-05-01T04:30:19.277855+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"248'389","last_scrub_stamp":"2022-05-01T04:29:39.348483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.348483+0000","objects_scrubbed":68,"log_size":397,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:42.553069+0000","scrub_duration":1.05234216,"objects_trimmed":0,"snaptrim_duration":0.61416249099999998,"stat_sum":{"num_bytes":179141560,"num_objects":68,"num_object_clones":8,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":206,"num_read_kb":69949,"num_write":398,"num_write_kb":107432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":339541664,"num_keys_recovered":220,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.a","version":"272'477","reported_seq":1738,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.238444+0000","last_change":"2022-05-01T04:29:58.990005+0000","last_active":"2022-05-01T04:30:19.238444+0000","last_peered":"2022-05-01T04:30:19.238444+0000","last_clean":"2022-05-01T04:30:19.238444+0000","last_became_active":"2022-05-01T04:29:08.175363+0000","last_became_peered":"2022-05-01T04:29:08.175363+0000","last_unstale":"2022-05-01T04:30:19.238444+0000","last_undegraded":"2022-05-01T04:30:19.238444+0000","last_fullsized":"2022-05-01T04:30:19.238444+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"247'454","last_scrub_stamp":"2022-05-01T04:29:39.093953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.093953+0000","objects_scrubbed":70,"log_size":477,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:46.460212+0000","scrub_duration":1.3648651510000001,"objects_trimmed":0,"snaptrim_duration":0.15573891400000001,"stat_sum":{"num_bytes":197706553,"num_objects":71,"num_object_clones":8,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":2,"num_read":262,"num_read_kb":159904,"num_write":471,"num_write_kb":128600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":193253880,"num_keys_recovered":160,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.9","version":"276'505","reported_seq":1339,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.255437+0000","last_change":"2022-05-01T04:30:02.707698+0000","last_active":"2022-05-01T04:30:19.255437+0000","last_peered":"2022-05-01T04:30:19.255437+0000","last_clean":"2022-05-01T04:30:19.255437+0000","last_became_active":"2022-05-01T04:29:59.090857+0000","last_became_peered":"2022-05-01T04:29:59.090857+0000","last_unstale":"2022-05-01T04:30:19.255437+0000","last_undegraded":"2022-05-01T04:30:19.255437+0000","last_fullsized":"2022-05-01T04:30:19.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":505,"ondisk_log_size":505,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.71138417200000004,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":113,"num_read_kb":82075,"num_write":204,"num_write_kb":57353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.8","version":"273'465","reported_seq":2265,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277718+0000","last_change":"2022-05-01T04:30:08.055718+0000","last_active":"2022-05-01T04:30:19.277718+0000","last_peered":"2022-05-01T04:30:19.277718+0000","last_clean":"2022-05-01T04:30:19.277718+0000","last_became_active":"2022-05-01T04:30:00.189790+0000","last_became_peered":"2022-05-01T04:30:00.189790+0000","last_unstale":"2022-05-01T04:30:19.277718+0000","last_undegraded":"2022-05-01T04:30:19.277718+0000","last_fullsized":"2022-05-01T04:30:19.277718+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.101109292,"stat_sum":{"num_bytes":96164905,"num_objects":39,"num_object_clones":10,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":116,"num_read_kb":48609,"num_write":276,"num_write_kb":64534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":252683112,"num_keys_recovered":230,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177759+0000","last_change":"2022-05-01T04:29:49.104235+0000","last_active":"2022-05-01T04:30:19.177759+0000","last_peered":"2022-05-01T04:30:19.177759+0000","last_clean":"2022-05-01T04:30:19.177759+0000","last_became_active":"2022-05-01T04:28:42.075951+0000","last_became_peered":"2022-05-01T04:28:42.075951+0000","last_unstale":"2022-05-01T04:30:19.177759+0000","last_undegraded":"2022-05-01T04:30:19.177759+0000","last_fullsized":"2022-05-01T04:30:19.177759+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:00.204819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:00.204819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'465","reported_seq":1972,"reported_epoch":296,"state":"peering","last_fresh":"2022-05-01T04:30:20.075325+0000","last_change":"2022-05-01T04:30:20.075325+0000","last_active":"2022-05-01T04:29:57.787070+0000","last_peered":"2022-05-01T04:29:57.436823+0000","last_clean":"2022-05-01T04:29:48.904733+0000","last_became_active":"2022-05-01T04:29:52.471792+0000","last_became_peered":"2022-05-01T04:29:52.471792+0000","last_unstale":"2022-05-01T04:30:20.075325+0000","last_undegraded":"2022-05-01T04:30:20.075325+0000","last_fullsized":"2022-05-01T04:30:20.075325+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0.407825406,"stat_sum":{"num_bytes":79997672,"num_objects":31,"num_object_clones":5,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":103,"num_read_kb":29450,"num_write":243,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":203448551,"num_keys_recovered":150,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.238636+0000","last_change":"2022-05-01T04:30:02.996712+0000","last_active":"2022-05-01T04:30:19.238636+0000","last_peered":"2022-05-01T04:30:19.238636+0000","last_clean":"2022-05-01T04:30:19.238636+0000","last_became_active":"2022-05-01T04:30:02.896021+0000","last_became_peered":"2022-05-01T04:30:02.896021+0000","last_unstale":"2022-05-01T04:30:19.238636+0000","last_undegraded":"2022-05-01T04:30:19.238636+0000","last_fullsized":"2022-05-01T04:30:19.238636+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:52.422661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:52.422661+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:05.375337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"275'566","reported_seq":1415,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155577+0000","last_change":"2022-05-01T04:30:02.778149+0000","last_active":"2022-05-01T04:30:19.155577+0000","last_peered":"2022-05-01T04:30:19.155577+0000","last_clean":"2022-05-01T04:30:19.155577+0000","last_became_active":"2022-05-01T04:29:59.089639+0000","last_became_peered":"2022-05-01T04:29:59.089639+0000","last_unstale":"2022-05-01T04:30:19.155577+0000","last_undegraded":"2022-05-01T04:30:19.155577+0000","last_fullsized":"2022-05-01T04:30:19.155577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0.89342225399999997,"stat_sum":{"num_bytes":102081757,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":127,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":386,"reported_epoch":294,"state":"active+clean","last_fresh":"2022-05-01T04:30:17.986898+0000","last_change":"2022-05-01T04:29:51.118516+0000","last_active":"2022-05-01T04:30:17.986898+0000","last_peered":"2022-05-01T04:30:17.986898+0000","last_clean":"2022-05-01T04:30:17.986898+0000","last_became_active":"2022-05-01T04:29:51.118117+0000","last_became_peered":"2022-05-01T04:29:51.118117+0000","last_unstale":"2022-05-01T04:30:17.986898+0000","last_undegraded":"2022-05-01T04:30:17.986898+0000","last_fullsized":"2022-05-01T04:30:17.986898+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:40.698524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:40.698524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:45.889971+0000","scrub_duration":0.50325435799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"273'490","reported_seq":1597,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177829+0000","last_change":"2022-05-01T04:29:58.989879+0000","last_active":"2022-05-01T04:30:19.177829+0000","last_peered":"2022-05-01T04:30:19.177829+0000","last_clean":"2022-05-01T04:30:19.177829+0000","last_became_active":"2022-05-01T04:29:58.888029+0000","last_became_peered":"2022-05-01T04:29:58.888029+0000","last_unstale":"2022-05-01T04:30:19.177829+0000","last_undegraded":"2022-05-01T04:30:19.177829+0000","last_fullsized":"2022-05-01T04:30:19.177829+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0.00046417000000000002,"stat_sum":{"num_bytes":93110778,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":103,"num_read_kb":46934,"num_write":215,"num_write_kb":63006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":83574846,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.183000+0000","last_change":"2022-05-01T04:30:02.982397+0000","last_active":"2022-05-01T04:30:19.183000+0000","last_peered":"2022-05-01T04:30:19.183000+0000","last_clean":"2022-05-01T04:30:19.183000+0000","last_became_active":"2022-05-01T04:30:02.982092+0000","last_became_peered":"2022-05-01T04:30:02.982092+0000","last_unstale":"2022-05-01T04:30:19.183000+0000","last_undegraded":"2022-05-01T04:30:19.183000+0000","last_fullsized":"2022-05-01T04:30:19.183000+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:24.617265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:24.617265+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.402921694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'117","reported_seq":258,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155690+0000","last_change":"2022-05-01T04:30:16.239307+0000","last_active":"2022-05-01T04:30:19.155690+0000","last_peered":"2022-05-01T04:30:19.155690+0000","last_clean":"2022-05-01T04:30:19.155690+0000","last_became_active":"2022-05-01T04:30:16.238972+0000","last_became_peered":"2022-05-01T04:30:16.238972+0000","last_unstale":"2022-05-01T04:30:19.155690+0000","last_undegraded":"2022-05-01T04:30:19.155690+0000","last_fullsized":"2022-05-01T04:30:19.155690+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2022-05-01T04:28:00.739540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:15.316890+0000","last_clean_scrub_stamp":"2022-05-01T04:28:00.739540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"273'535","reported_seq":1734,"reported_epoch":296,"state":"active+recovering+undersized+remapped","last_fresh":"2022-05-01T04:30:20.123730+0000","last_change":"2022-05-01T04:30:20.328949+0000","last_active":"2022-05-01T04:30:20.123730+0000","last_peered":"2022-05-01T04:30:20.123730+0000","last_clean":"2022-05-01T04:29:46.967195+0000","last_became_active":"2022-05-01T04:30:03.895066+0000","last_became_peered":"2022-05-01T04:30:03.895066+0000","last_unstale":"2022-05-01T04:30:20.123730+0000","last_undegraded":"2022-05-01T04:30:03.791995+0000","last_fullsized":"2022-05-01T04:30:03.788182+0000","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":230,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":30,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0.40853271600000002,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":7,"num_object_copies":129,"num_objects_missing_on_primary":52,"num_objects_missing":52,"num_objects_degraded":0,"num_objects_misplaced":74,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":1,"num_read":140,"num_read_kb":72872,"num_write":290,"num_write_kb":74976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":109105320,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,6],"avail_no_missing":["1","4","6"],"object_location_counts":[{"shards":"1,3,4,6","objects":8},{"shards":"1,4,6","objects":33},{"shards":"3,6","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.255829+0000","last_change":"2022-05-01T04:30:16.267571+0000","last_active":"2022-05-01T04:30:19.255829+0000","last_peered":"2022-05-01T04:30:19.255829+0000","last_clean":"2022-05-01T04:30:19.255829+0000","last_became_active":"2022-05-01T04:30:16.267154+0000","last_became_peered":"2022-05-01T04:30:16.267154+0000","last_unstale":"2022-05-01T04:30:19.255829+0000","last_undegraded":"2022-05-01T04:30:19.255829+0000","last_fullsized":"2022-05-01T04:30:19.255829+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:12.658835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:12.658835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.304165821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"294'453","reported_seq":1765,"reported_epoch":295,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:19.057308+0000","last_change":"2022-05-01T04:30:18.886977+0000","last_active":"2022-05-01T04:30:19.057308+0000","last_peered":"2022-05-01T04:30:19.057308+0000","last_clean":"2022-05-01T04:30:19.057308+0000","last_became_active":"2022-05-01T04:30:06.174043+0000","last_became_peered":"2022-05-01T04:30:06.174043+0000","last_unstale":"2022-05-01T04:30:19.057308+0000","last_undegraded":"2022-05-01T04:30:19.057308+0000","last_fullsized":"2022-05-01T04:30:19.057308+0000","mapping_epoch":281,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":453,"ondisk_log_size":453,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":24,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.76321735999999996,"stat_sum":{"num_bytes":95657071,"num_objects":38,"num_object_clones":8,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":120,"num_read_kb":76397,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":141204132,"num_keys_recovered":40,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":317,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155906+0000","last_change":"2022-05-01T04:29:49.588507+0000","last_active":"2022-05-01T04:30:19.155906+0000","last_peered":"2022-05-01T04:30:19.155906+0000","last_clean":"2022-05-01T04:30:19.155906+0000","last_became_active":"2022-05-01T04:25:17.351886+0000","last_became_peered":"2022-05-01T04:25:17.351886+0000","last_unstale":"2022-05-01T04:30:19.155906+0000","last_undegraded":"2022-05-01T04:30:19.155906+0000","last_fullsized":"2022-05-01T04:30:19.155906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:49.588383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.588383+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:54.942702+0000","scrub_duration":0.30376289400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'361","reported_seq":1781,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177815+0000","last_change":"2022-05-01T04:30:13.312203+0000","last_active":"2022-05-01T04:30:19.177815+0000","last_peered":"2022-05-01T04:30:19.177815+0000","last_clean":"2022-05-01T04:30:19.177815+0000","last_became_active":"2022-05-01T04:30:13.311320+0000","last_became_peered":"2022-05-01T04:30:13.311320+0000","last_unstale":"2022-05-01T04:30:19.177815+0000","last_undegraded":"2022-05-01T04:30:19.177815+0000","last_fullsized":"2022-05-01T04:30:19.177815+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0.00086617699999999998,"stat_sum":{"num_bytes":83569377,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":178,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":177664904,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.7","version":"273'533","reported_seq":1998,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.377978+0000","last_change":"2022-05-01T04:30:05.888096+0000","last_active":"2022-05-01T04:30:19.377978+0000","last_peered":"2022-05-01T04:30:19.377978+0000","last_clean":"2022-05-01T04:30:19.377978+0000","last_became_active":"2022-05-01T04:29:59.991809+0000","last_became_peered":"2022-05-01T04:29:59.991809+0000","last_unstale":"2022-05-01T04:30:19.377978+0000","last_undegraded":"2022-05-01T04:30:19.377978+0000","last_fullsized":"2022-05-01T04:30:19.377978+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":281,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":533,"ondisk_log_size":533,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0.40617742299999998,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":11,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":194369701,"num_keys_recovered":70,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.178048+0000","last_change":"2022-05-01T04:28:42.261677+0000","last_active":"2022-05-01T04:30:19.178048+0000","last_peered":"2022-05-01T04:30:19.178048+0000","last_clean":"2022-05-01T04:30:19.178048+0000","last_became_active":"2022-05-01T04:28:42.261299+0000","last_became_peered":"2022-05-01T04:28:42.261299+0000","last_unstale":"2022-05-01T04:30:19.178048+0000","last_undegraded":"2022-05-01T04:30:19.178048+0000","last_fullsized":"2022-05-01T04:30:19.178048+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:48.745287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.745287+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":375,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.150747+0000","last_change":"2022-05-01T04:29:05.171169+0000","last_active":"2022-05-01T04:30:19.150747+0000","last_peered":"2022-05-01T04:30:19.150747+0000","last_clean":"2022-05-01T04:30:19.150747+0000","last_became_active":"2022-05-01T04:29:05.170684+0000","last_became_peered":"2022-05-01T04:29:05.170684+0000","last_unstale":"2022-05-01T04:30:19.150747+0000","last_undegraded":"2022-05-01T04:30:19.150747+0000","last_fullsized":"2022-05-01T04:30:19.150747+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:47.562100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:47.562100+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.30425882100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"277'573","reported_seq":1925,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.157470+0000","last_change":"2022-05-01T04:30:03.710494+0000","last_active":"2022-05-01T04:30:19.157470+0000","last_peered":"2022-05-01T04:30:19.157470+0000","last_clean":"2022-05-01T04:30:19.157470+0000","last_became_active":"2022-05-01T04:29:58.986844+0000","last_became_peered":"2022-05-01T04:29:58.986844+0000","last_unstale":"2022-05-01T04:30:19.157470+0000","last_undegraded":"2022-05-01T04:30:19.157470+0000","last_fullsized":"2022-05-01T04:30:19.157470+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":573,"ondisk_log_size":573,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.91696671600000002,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":112,"num_read_kb":54635,"num_write":200,"num_write_kb":69190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967345,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":26,"stat_sum":{"num_bytes":3094612737,"num_objects":1166,"num_object_clones":201,"num_object_copies":3498,"num_objects_missing_on_primary":82,"num_objects_missing":82,"num_objects_degraded":133,"num_objects_misplaced":309,"num_objects_unfound":0,"num_objects_dirty":1166,"num_whiteouts":30,"num_read":3712,"num_read_kb":1765464,"num_write":7466,"num_write_kb":2036181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3548,"num_bytes_recovered":3906462674,"num_keys_recovered":1880,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5410938880,"data_stored":5655074692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":654892,"internal_metadata":0},"log_size":12881,"ondisk_log_size":12881,"up":78,"acting":76,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":2115712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":870964,"kb_used_data":833388,"kb_used_omap":0,"kb_used_meta":37568,"kb_avail":93500876,"statfs":{"total":96636764160,"available":95744897024,"internally_reserved":0,"allocated":853389312,"data_stored":896292243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":38469632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":12.237,"5min":37.633000000000003,"15min":61.872999999999998},"min":{"1min":0.51800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":72.403999999999996,"5min":518.15200000000004,"15min":518.15200000000004},"last":5.5860000000000003},{"interface":"front","average":{"1min":5.0730000000000004,"5min":5.4240000000000004,"15min":8.3490000000000002},"min":{"1min":0.53000000000000003,"5min":0.433,"15min":0.433},"max":{"1min":65.225999999999999,"5min":99.054000000000002,"15min":99.054000000000002},"last":3.1640000000000001}]},{"osd":1,"last update":"Sun May 1 04:29:37 2022","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.77200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86199999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":3.6469999999999998},{"interface":"front","average":{"1min":16.597999999999999,"5min":10.374000000000001,"15min":9.3369999999999997},"min":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":88.078000000000003,"5min":88.078000000000003,"15min":88.078000000000003},"last":3.7829999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":11.132,"5min":15.377000000000001,"15min":26.102},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":176.274,"5min":252.857,"15min":252.857},"last":0.58599999999999997},{"interface":"front","average":{"1min":11.837,"5min":26.882999999999999,"15min":47.584000000000003},"min":{"1min":0.70699999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":72.778000000000006,"5min":310.839,"15min":310.839},"last":3.7109999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":1.401,"15min":1.131},"min":{"1min":0.70899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":40.189999999999998,"5min":40.189999999999998,"15min":40.189999999999998},"last":5.2359999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1140000000000001,"15min":1.1499999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5600000000000001,"5min":3.585,"15min":3.585},"last":9.1560000000000006}]},{"osd":4,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":3.673,"15min":3.3029999999999999},"min":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.391,"5min":100.727,"15min":100.727},"last":0.55800000000000005},{"interface":"front","average":{"1min":7.3159999999999998,"5min":18.145,"15min":27.129999999999999},"min":{"1min":0.78400000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":108.63200000000001,"5min":252.94900000000001,"15min":252.94900000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":11.952,"5min":16.052,"15min":25.853999999999999},"min":{"1min":0.88700000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":72.542000000000002,"5min":301.91000000000003,"15min":301.91000000000003},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.095,"5min":6.4960000000000004,"15min":11.42},"min":{"1min":0.79800000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3720000000000001,"5min":159.309,"15min":159.309},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":6.5549999999999997,"5min":15.954000000000001,"15min":28.488},"min":{"1min":0.872,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":92.481999999999999,"5min":294.37,"15min":294.37},"last":0.77100000000000002},{"interface":"front","average":{"1min":6.5700000000000003,"5min":25.222000000000001,"15min":47.006},"min":{"1min":1.0089999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":92.453999999999994,"5min":294.82299999999998,"15min":294.82299999999998},"last":0.874}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":781112,"kb_used_data":744432,"kb_used_omap":0,"kb_used_meta":36672,"kb_avail":93590728,"statfs":{"total":96636764160,"available":95836905472,"internally_reserved":0,"allocated":762298368,"data_stored":793548305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37552128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":12.117000000000001,"5min":20.341999999999999,"15min":40.899000000000001},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":146.00800000000001,"5min":474.91300000000001,"15min":474.91300000000001},"last":1.147},{"interface":"front","average":{"1min":16.079999999999998,"5min":14.685,"15min":24.908999999999999},"min":{"1min":0.53400000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":146.03,"5min":296.67500000000001,"15min":296.67500000000001},"last":1.0580000000000001}]},{"osd":1,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":10.571,"5min":2.8530000000000002,"15min":1.5669999999999999},"min":{"1min":0.64600000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":100.899,"5min":100.899,"15min":100.899},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.702,"5min":2.8900000000000001,"15min":3.0880000000000001},"min":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":13.907,"5min":49.499000000000002,"15min":49.499000000000002},"last":1.405}]},{"osd":2,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":12.288,"15min":31.699000000000002},"min":{"1min":0.65600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":37.988999999999997,"5min":384.75700000000001,"15min":384.75700000000001},"last":3.6579999999999999},{"interface":"front","average":{"1min":4.9180000000000001,"5min":7.1749999999999998,"15min":16.774000000000001},"min":{"1min":0.66200000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":74.480999999999995,"5min":160.499,"15min":160.499},"last":1.6220000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:12 2022","interfaces":[{"interface":"back","average":{"1min":5.1210000000000004,"5min":6.2729999999999997,"15min":6.0990000000000002},"min":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":39.613999999999997,"5min":93.191999999999993,"15min":93.191999999999993},"last":88.484999999999999},{"interface":"front","average":{"1min":5.5700000000000003,"5min":2.5150000000000001,"15min":1.544},"min":{"1min":0.81699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":45.993000000000002,"5min":49.615000000000002,"15min":49.615000000000002},"last":8.5380000000000003}]},{"osd":4,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":9.2210000000000001,"15min":28.965},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.736,"5min":384.22199999999998,"15min":384.22199999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":17.77,"5min":14.365,"15min":32.424999999999997},"min":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":167.744,"5min":290.24200000000002,"15min":290.24200000000002},"last":0.94899999999999995}]},{"osd":5,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":9.2119999999999997,"15min":20.93},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":33.787999999999997,"5min":276.17000000000002,"15min":276.17000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":4.8029999999999999,"5min":13.064,"15min":40.137999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":69.587999999999994,"5min":384.64299999999997,"15min":384.64299999999997},"last":1.0149999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":8.8539999999999992,"5min":26.236999999999998,"15min":76.006},"min":{"1min":0.88500000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":74.135000000000005,"5min":670.42999999999995,"15min":670.42999999999995},"last":1.181},{"interface":"front","average":{"1min":2.778,"5min":4.8630000000000004,"15min":2.327},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":33.892000000000003,"5min":94.379999999999995,"15min":94.379999999999995},"last":0.97699999999999998}]}]},{"osd":1,"up_from":134,"seq":575525617699,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":817664,"kb_used_data":774520,"kb_used_omap":652,"kb_used_meta":42483,"kb_avail":93554176,"statfs":{"total":96636764160,"available":95799476224,"internally_reserved":0,"allocated":793108480,"data_stored":827588588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":668200,"internal_metadata":43503064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":13.711,"5min":10.115,"15min":9.5150000000000006},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":99.966999999999999,"5min":176.80000000000001,"15min":176.80000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":8.9359999999999999,"5min":9.1989999999999998,"15min":9.2430000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":79.738,"5min":176.886,"15min":176.886},"last":0.99099999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":8.2460000000000004,"5min":4.4459999999999997,"15min":3.8119999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":100.336,"5min":100.336,"15min":100.336},"last":0.89800000000000002},{"interface":"front","average":{"1min":3.2919999999999998,"5min":1.343,"15min":1.018},"min":{"1min":0.63900000000000001,"5min":0.625,"15min":0.625},"max":{"1min":34.151000000000003,"5min":34.151000000000003,"15min":34.151000000000003},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":8.3409999999999993,"5min":2.544,"15min":1.5780000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":100.11499999999999,"5min":100.11499999999999,"15min":100.11499999999999},"last":1.036},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.6559999999999999,"15min":1.3400000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":34.658000000000001,"5min":34.658000000000001,"15min":34.658000000000001},"last":1.133}]},{"osd":4,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":9.782,"5min":9.6500000000000004,"15min":9.6280000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":89.364000000000004,"5min":92.572000000000003,"15min":92.572000000000003},"last":90.158000000000001},{"interface":"front","average":{"1min":11.432,"5min":3.1389999999999998,"15min":1.7569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":58.978000000000002,"5min":58.978000000000002,"15min":58.978000000000002},"last":0.86699999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":1.736,"15min":1.4139999999999999},"min":{"1min":0.88900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":34.417999999999999,"5min":34.417999999999999,"15min":34.417999999999999},"last":1.282},{"interface":"front","average":{"1min":8.2729999999999997,"5min":2.5369999999999999,"15min":1.581},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":59.185000000000002,"5min":59.185000000000002,"15min":59.185000000000002},"last":0.97699999999999998}]},{"osd":6,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":13.271000000000001,"5min":3.7170000000000001,"15min":2.125},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":69.930999999999997,"5min":69.930999999999997,"15min":69.930999999999997},"last":1.052},{"interface":"front","average":{"1min":8.6340000000000003,"5min":2.8380000000000001,"15min":1.8720000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":100.20099999999999,"5min":100.20099999999999,"15min":100.20099999999999},"last":1.3200000000000001}]},{"osd":7,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":12.922000000000001,"5min":6.2359999999999998,"15min":5.1219999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":64.167000000000002,"5min":69.519000000000005,"15min":69.519000000000005},"last":1.167},{"interface":"front","average":{"1min":8.6799999999999997,"5min":2.9199999999999999,"15min":1.96},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":100.27,"5min":100.27,"15min":100.27},"last":1.2230000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":900552,"kb_used_data":861696,"kb_used_omap":0,"kb_used_meta":38848,"kb_avail":93471288,"statfs":{"total":96636764160,"available":95714598912,"internally_reserved":0,"allocated":882376704,"data_stored":926887646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39780352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 1 04:29:37 2022","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.625,"15min":5.0279999999999996},"min":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":25.649000000000001,"5min":94.671999999999997,"15min":94.671999999999997},"last":1.274},{"interface":"front","average":{"1min":15.130000000000001,"5min":4.6319999999999997,"15min":2.8820000000000001},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":218.80099999999999,"5min":218.80099999999999,"15min":218.80099999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":3.411,"5min":7.8899999999999997,"15min":11.317},"min":{"1min":0.58699999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":48.067,"5min":106.374,"15min":106.374},"last":1.228},{"interface":"front","average":{"1min":13.252000000000001,"5min":29.773,"15min":51.216000000000001},"min":{"1min":0.67400000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":95.516999999999996,"5min":497.91500000000002,"15min":497.91500000000002},"last":1.472}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":3.3580000000000001,"15min":2.4969999999999999},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.528,"5min":176.02699999999999,"15min":176.02699999999999},"last":1.827},{"interface":"front","average":{"1min":6.5469999999999997,"5min":2.7210000000000001,"15min":2.2480000000000002},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":48.159999999999997,"5min":48.159999999999997,"15min":48.159999999999997},"last":1.379}]},{"osd":4,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":13.605,"5min":16.038,"15min":23.190000000000001},"min":{"1min":0.85799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":176.16900000000001,"5min":248.709,"15min":248.709},"last":1.587},{"interface":"front","average":{"1min":25.143999999999998,"5min":26.859000000000002,"15min":36.008000000000003},"min":{"1min":0.76500000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":249.125,"5min":315.69400000000002,"15min":315.69400000000002},"last":1.4930000000000001}]},{"osd":5,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":33.139000000000003,"15min":55.725000000000001},"min":{"1min":0.81399999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.8779999999999999,"5min":540.08900000000006,"15min":540.08900000000006},"last":66.656999999999996},{"interface":"front","average":{"1min":11.036,"5min":13.048,"15min":14.032},"min":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":176.32599999999999,"5min":176.32599999999999,"15min":176.32599999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":29.782,"5min":22.654,"15min":32.274000000000001},"min":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":222.18299999999999,"5min":240.36600000000001,"15min":240.36600000000001},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.304,"5min":40.305999999999997,"15min":67.299999999999997},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.996,"5min":498.05399999999997,"15min":498.05399999999997},"last":2.456}]},{"osd":7,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":8.7680000000000007,"5min":64.995999999999995,"15min":123.136},"min":{"1min":0.88200000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":93.771000000000001,"5min":1663.876,"15min":1663.876},"last":2.3029999999999999},{"interface":"front","average":{"1min":11.15,"5min":56.536999999999999,"15min":106.17},"min":{"1min":1.016,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":176.261,"5min":844.65300000000002,"15min":844.65300000000002},"last":2.0129999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344540,"kb_used_data":316628,"kb_used_omap":0,"kb_used_meta":27904,"kb_avail":94027300,"statfs":{"total":96636764160,"available":96283955200,"internally_reserved":0,"allocated":324227072,"data_stored":339798606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28573696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":7.5739999999999998,"5min":3.2999999999999998,"15min":1.6240000000000001},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.443},"max":{"1min":66.424000000000007,"5min":72.322000000000003,"15min":72.322000000000003},"last":7.242},{"interface":"front","average":{"1min":11.119,"5min":37.843000000000004,"15min":63.07},"min":{"1min":0.51200000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":91.519000000000005,"5min":465.05200000000002,"15min":465.05200000000002},"last":2.927}]},{"osd":1,"last update":"Sun May 1 04:29:39 2022","interfaces":[{"interface":"back","average":{"1min":18.872,"5min":18.231000000000002,"15min":18.123999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":84.466999999999999,"5min":153.101,"15min":153.101},"last":1.8069999999999999},{"interface":"front","average":{"1min":8.1769999999999996,"5min":2.3620000000000001,"15min":1.393},"min":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":117.398,"5min":117.398,"15min":117.398},"last":2.0579999999999998}]},{"osd":3,"last update":"Sun May 1 04:30:08 2022","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.212,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.390000000000001,"5min":21.312000000000001,"15min":21.312000000000001},"last":101.03100000000001},{"interface":"front","average":{"1min":1.034,"5min":0.93799999999999994,"15min":0.90600000000000003},"min":{"1min":0.73999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":2.8079999999999998}]},{"osd":4,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":2.234,"5min":8.4920000000000009,"15min":14.210000000000001},"min":{"1min":0.874,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":21.434000000000001,"5min":147.17099999999999,"15min":147.17099999999999},"last":2.1890000000000001},{"interface":"front","average":{"1min":8.3149999999999995,"5min":19.849,"15min":34.643999999999998},"min":{"1min":1.032,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":72.075000000000003,"5min":240.71000000000001,"15min":240.71000000000001},"last":2.4199999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":8.907,"5min":14.784000000000001,"15min":15.452999999999999},"min":{"1min":0.85199999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":153.203,"5min":260.42099999999999,"15min":260.42099999999999},"last":13.206},{"interface":"front","average":{"1min":2.4009999999999998,"5min":7.548,"15min":12.875999999999999},"min":{"1min":1.012,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":21.504000000000001,"5min":196.74799999999999,"15min":196.74799999999999},"last":2.3290000000000002}]},{"osd":6,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":11.903,"15min":21.797000000000001},"min":{"1min":0.98999999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2999999999999998,"5min":146.161,"15min":146.161},"last":2.5750000000000002},{"interface":"front","average":{"1min":13.718,"5min":24.753,"15min":36.780999999999999},"min":{"1min":1.0309999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":161.85599999999999,"5min":269.53100000000001,"15min":269.53100000000001},"last":13.034000000000001}]},{"osd":7,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5589999999999999,"15min":1.7649999999999999},"min":{"1min":1.069,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.1720000000000002,"5min":11.654999999999999,"15min":11.654999999999999},"last":2.6930000000000001},{"interface":"front","average":{"1min":13.727,"5min":13.403,"15min":16.937000000000001},"min":{"1min":1.111,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":155.268,"5min":160.547,"15min":160.547},"last":13.332000000000001}]}]},{"osd":3,"up_from":105,"seq":450971566121,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530208,"kb_used_data":509400,"kb_used_omap":2,"kb_used_meta":20797,"kb_avail":93841632,"statfs":{"total":96636764160,"available":96093831168,"internally_reserved":0,"allocated":521625600,"data_stored":527555785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":21296315},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":4.7389999999999999,"15min":6.298},"min":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":73.262,"15min":73.262},"last":0.94199999999999995},{"interface":"front","average":{"1min":7.7329999999999997,"5min":6.2919999999999998,"15min":7.1989999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":72.561000000000007,"5min":97.546999999999997,"15min":97.546999999999997},"last":1.121}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":3.3540000000000001,"5min":1.3680000000000001,"15min":1.0369999999999999},"min":{"1min":0.69199999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":51.892000000000003,"5min":51.892000000000003,"15min":51.892000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":5.0890000000000004,"5min":1.716,"15min":1.1539999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":51.715000000000003,"5min":51.715000000000003,"15min":51.715000000000003},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":0.94399999999999995},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.841,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":5.4009999999999998,"5min":4.351,"15min":4.7690000000000001},"min":{"1min":0.748,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":73.284000000000006,"5min":83.582999999999998,"15min":83.582999999999998},"last":1.032}]},{"osd":4,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":14.065,"5min":6.859,"15min":4.4889999999999999},"min":{"1min":0.80500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":88.811000000000007,"5min":97.501999999999995,"15min":97.501999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.3220000000000001,"15min":2.8300000000000001},"min":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7150000000000001,"5min":42.081000000000003,"15min":42.081000000000003},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3029999999999999,"15min":1.284},"min":{"1min":1.0660000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.885,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":5.4340000000000002,"5min":4.4109999999999996,"15min":3.9750000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":72.870000000000005,"5min":91.775999999999996,"15min":91.775999999999996},"last":0.91500000000000004}]},{"osd":6,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":2.681,"15min":1.7549999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":60.124000000000002,"5min":78.131,"15min":78.131},"last":1.321},{"interface":"front","average":{"1min":3.6890000000000001,"5min":4.7919999999999998,"15min":4.3760000000000003},"min":{"1min":1.0840000000000001,"5min":1.014,"15min":1.014},"max":{"1min":39.942999999999998,"5min":89.192999999999998,"15min":89.192999999999998},"last":1.2889999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":7.8170000000000002,"5min":2.6709999999999998,"15min":1.8169999999999999},"min":{"1min":0.98599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":73.015000000000001,"5min":73.015000000000001,"15min":73.015000000000001},"last":1.012},{"interface":"front","average":{"1min":6.5549999999999997,"5min":3.1709999999999998,"15min":1.954},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":89.414000000000001,"5min":89.414000000000001,"15min":89.414000000000001},"last":1.1870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1106868,"kb_used_data":1056940,"kb_used_omap":0,"kb_used_meta":49920,"kb_avail":93264972,"statfs":{"total":96636764160,"available":95503331328,"internally_reserved":0,"allocated":1082306560,"data_stored":1139940750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":51118080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":12.122,"5min":17.731999999999999,"15min":24.044},"min":{"1min":0.46899999999999997,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":129.07599999999999,"5min":257.822,"15min":257.822},"last":78.052999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":13.398,"15min":22.884},"min":{"1min":0.51600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":256.291,"15min":256.291},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":4.1289999999999996,"5min":5.9720000000000004,"15min":6.2789999999999999},"min":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":69.811999999999998,"5min":91.667000000000002,"15min":91.667000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":17.847000000000001,"5min":4.6870000000000003,"15min":2.4929999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":129.15799999999999,"5min":129.15799999999999,"15min":129.15799999999999},"last":1.0740000000000001}]},{"osd":2,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":13.859,"15min":21.893999999999998},"min":{"1min":0.60199999999999998,"5min":0.505,"15min":0.505},"max":{"1min":45.573,"5min":256.45999999999998,"15min":256.45999999999998},"last":1.008},{"interface":"front","average":{"1min":8.9290000000000003,"5min":10.433999999999999,"15min":16.033999999999999},"min":{"1min":0.77200000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":91.593000000000004,"5min":174.048,"15min":174.048},"last":1.038}]},{"osd":3,"last update":"Sun May 1 04:30:11 2022","interfaces":[{"interface":"back","average":{"1min":6.1619999999999999,"5min":4.6959999999999997,"15min":4.4619999999999997},"min":{"1min":0.80700000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":97.203999999999994,"5min":97.203999999999994,"15min":97.203999999999994},"last":1.208},{"interface":"front","average":{"1min":1.0349999999999999,"5min":3.8929999999999998,"15min":3.2010000000000001},"min":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3260000000000001,"5min":91.527000000000001,"15min":91.527000000000001},"last":1.3129999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":6.3840000000000003,"5min":17.690999999999999,"15min":24.939},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":44.625,"5min":159.648,"15min":159.648},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":17.940999999999999,"15min":31.800999999999998},"min":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2470000000000001,"5min":256.18799999999999,"15min":256.18799999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":17.603000000000002,"5min":12.807,"15min":17.817},"min":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":91.289000000000001,"5min":174.274,"15min":174.274},"last":1.181},{"interface":"front","average":{"1min":6.5199999999999996,"5min":18.015999999999998,"15min":26.024000000000001},"min":{"1min":0.86199999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":44.703000000000003,"5min":231.74799999999999,"15min":231.74799999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":28.369,"15min":52.451000000000001},"min":{"1min":0.85999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.516,"5min":652.226,"15min":652.226},"last":1.2789999999999999},{"interface":"front","average":{"1min":13.464,"5min":30.495999999999999,"15min":49.872999999999998},"min":{"1min":0.85299999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":91.421999999999997,"5min":376.32900000000001,"15min":376.32900000000001},"last":106.176}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266936,"kb_used_data":221744,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94104904,"statfs":{"total":96636764160,"available":96363421696,"internally_reserved":0,"allocated":227065856,"data_stored":227583021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":3.8239999999999998,"5min":22.074999999999999,"15min":35.737000000000002},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":48.405999999999999,"5min":334.69799999999998,"15min":334.69799999999998},"last":4.9119999999999999},{"interface":"front","average":{"1min":4.0570000000000004,"5min":15.731999999999999,"15min":22.18},"min":{"1min":0.77300000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":48.375999999999998,"5min":282.01999999999998,"15min":282.01999999999998},"last":4.9900000000000002}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":7.569,"5min":2.2519999999999998,"15min":1.3660000000000001},"min":{"1min":0.622,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":97.450000000000003,"5min":97.450000000000003,"15min":97.450000000000003},"last":4.3899999999999997},{"interface":"front","average":{"1min":8.4730000000000008,"5min":2.3879999999999999,"15min":1.3740000000000001},"min":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":58.759,"5min":58.759,"15min":58.759},"last":1.3939999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":2.7890000000000001,"15min":4.0099999999999998},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.2599999999999998,"5min":82.424999999999997,"15min":82.424999999999997},"last":1.052},{"interface":"front","average":{"1min":0.91900000000000004,"5min":5.452,"15min":9.968},"min":{"1min":0.69499999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.325,"5min":150.518,"15min":150.518},"last":4.3239999999999998}]},{"osd":3,"last update":"Sun May 1 04:30:10 2022","interfaces":[{"interface":"back","average":{"1min":5.3099999999999996,"5min":1.879,"15min":1.3069999999999999},"min":{"1min":0.751,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":110.706,"5min":110.706,"15min":110.706},"last":4.5140000000000002},{"interface":"front","average":{"1min":7.556,"5min":2.3849999999999998,"15min":1.486},"min":{"1min":0.84699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":76.444000000000003,"5min":76.444000000000003,"15min":76.444000000000003},"last":99.159999999999997}]},{"osd":4,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":3.2810000000000001,"5min":21.321999999999999,"15min":39.951000000000001},"min":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":45.170000000000002,"5min":385.29300000000001,"15min":385.29300000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.48,"5min":13.676,"15min":20.757999999999999},"min":{"1min":0.68200000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":11.239000000000001,"5min":189.869,"15min":189.869},"last":0.83699999999999997}]},{"osd":6,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":18.375,"5min":18.841999999999999,"15min":30.875},"min":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":173.755,"5min":332.26299999999998,"15min":332.26299999999998},"last":4.25},{"interface":"front","average":{"1min":6.577,"5min":11.333,"15min":19.437000000000001},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":60.741999999999997,"5min":295.99299999999999,"15min":295.99299999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":53.643999999999998,"15min":101.39},"min":{"1min":0.83099999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.321,"5min":1543.201,"15min":1543.201},"last":0.90800000000000003},{"interface":"front","average":{"1min":3.4769999999999999,"5min":7.6059999999999999,"15min":13.260999999999999},"min":{"1min":0.97999999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":44.923999999999999,"5min":150.71100000000001,"15min":150.71100000000001},"last":4.452}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":885415936,"data_stored":931792676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":789708800,"data_stored":826088549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":652007,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":320839680,"data_stored":338303778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":528502784,"data_stored":536261159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1080651776,"data_stored":1140181288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":232603648,"data_stored":234980026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":720662528,"data_stored":750115991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":852553728,"data_stored":897351225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-01T10:42:30.848 WARNING:scrape:Ignoring malparsed backtrace: dumped all , 2022-05-01T04:30:51.050 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2022-05-01T04:30:49.284987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3034072875,"num_objects":1140,"num_object_clones":186,"num_object_copies":3420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":28,"num_read":3100,"num_read_kb":1354332,"num_write":6217,"num_write_kb":1638045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3293,"num_bytes_recovered":3515279523,"num_keys_recovered":1981,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13078,"ondisk_log_size":13078,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4882300,"kb_used_data":4569916,"kb_used_omap":655,"kb_used_meta":311664,"kb_avail":750092420,"statfs":{"total":773094113280,"available":768094638080,"internally_reserved":0,"allocated":4679593984,"data_stored":4869698937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":671085,"internal_metadata":319144595},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-56420173,"num_objects":-25,"num_object_clones":-11,"num_object_copies":-75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":-2,"num_read":-615,"num_read_kb":-329157,"num_write":-1204,"num_write_kb":-343199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-649,"num_bytes_recovered":-739472948,"num_keys_recovered":-330,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002032"},"pg_stats":[{"pgid":"3.19","version":"272'501","reported_seq":1338,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794886+0000","last_change":"2022-05-01T04:30:36.658256+0000","last_active":"2022-05-01T04:30:42.794886+0000","last_peered":"2022-05-01T04:30:42.794886+0000","last_clean":"2022-05-01T04:30:42.794886+0000","last_became_active":"2022-05-01T04:30:11.294414+0000","last_became_peered":"2022-05-01T04:30:11.294414+0000","last_unstale":"2022-05-01T04:30:42.794886+0000","last_undegraded":"2022-05-01T04:30:42.794886+0000","last_fullsized":"2022-05-01T04:30:42.794886+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":5,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":501,"ondisk_log_size":501,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.205175364,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":114,"num_read_kb":82076,"num_write":204,"num_write_kb":57354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":40234521,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.18","version":"273'465","reported_seq":2345,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971260+0000","last_change":"2022-05-01T04:30:15.339106+0000","last_active":"2022-05-01T04:30:42.971260+0000","last_peered":"2022-05-01T04:30:42.971260+0000","last_clean":"2022-05-01T04:30:42.971260+0000","last_became_active":"2022-05-01T04:30:15.336684+0000","last_became_peered":"2022-05-01T04:30:15.336684+0000","last_unstale":"2022-05-01T04:30:42.971260+0000","last_undegraded":"2022-05-01T04:30:42.971260+0000","last_fullsized":"2022-05-01T04:30:42.971260+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":5,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.001352624,"stat_sum":{"num_bytes":96164905,"num_objects":40,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":2,"num_read":116,"num_read_kb":48609,"num_write":277,"num_write_kb":64535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":249,"num_bytes_recovered":275012362,"num_keys_recovered":150,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.17","version":"305'541","reported_seq":2031,"reported_epoch":305,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:44.138602+0000","last_change":"2022-05-01T04:30:41.229899+0000","last_active":"2022-05-01T04:30:44.138602+0000","last_peered":"2022-05-01T04:30:44.138602+0000","last_clean":"2022-05-01T04:30:44.138602+0000","last_became_active":"2022-05-01T04:30:07.303342+0000","last_became_peered":"2022-05-01T04:30:07.303342+0000","last_unstale":"2022-05-01T04:30:44.138602+0000","last_undegraded":"2022-05-01T04:30:44.138602+0000","last_fullsized":"2022-05-01T04:30:44.138602+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":541,"ondisk_log_size":541,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":12,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":207854617,"num_keys_recovered":90,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'571","reported_seq":1935,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.071933+0000","last_change":"2022-05-01T04:30:21.386607+0000","last_active":"2022-05-01T04:30:43.071933+0000","last_peered":"2022-05-01T04:30:43.071933+0000","last_clean":"2022-05-01T04:30:43.071933+0000","last_became_active":"2022-05-01T04:30:21.278471+0000","last_became_peered":"2022-05-01T04:30:21.278471+0000","last_unstale":"2022-05-01T04:30:43.071933+0000","last_undegraded":"2022-05-01T04:30:43.071933+0000","last_fullsized":"2022-05-01T04:30:43.071933+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":297,"parent":"0.0","parent_split_bits":5,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":571,"ondisk_log_size":571,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.102919052,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":113,"num_read_kb":54635,"num_write":201,"num_write_kb":69191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967346,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.15","version":"300'475","reported_seq":2264,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886295+0000","last_change":"2022-05-01T04:30:38.186202+0000","last_active":"2022-05-01T04:30:42.886295+0000","last_peered":"2022-05-01T04:30:42.886295+0000","last_clean":"2022-05-01T04:30:42.886295+0000","last_became_active":"2022-05-01T04:30:17.351913+0000","last_became_peered":"2022-05-01T04:30:17.351913+0000","last_unstale":"2022-05-01T04:30:42.886295+0000","last_undegraded":"2022-05-01T04:30:42.886295+0000","last_fullsized":"2022-05-01T04:30:42.886295+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":475,"ondisk_log_size":475,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0.31212725699999999,"stat_sum":{"num_bytes":74400612,"num_objects":29,"num_object_clones":3,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":104,"num_read_kb":29450,"num_write":244,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":247163307,"num_keys_recovered":230,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.14","version":"264'361","reported_seq":1637,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794291+0000","last_change":"2022-05-01T04:30:13.108744+0000","last_active":"2022-05-01T04:30:42.794291+0000","last_peered":"2022-05-01T04:30:42.794291+0000","last_clean":"2022-05-01T04:30:42.794291+0000","last_became_active":"2022-05-01T04:30:13.107986+0000","last_became_peered":"2022-05-01T04:30:13.107986+0000","last_unstale":"2022-05-01T04:30:42.794291+0000","last_undegraded":"2022-05-01T04:30:42.794291+0000","last_fullsized":"2022-05-01T04:30:42.794291+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":5,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83569378,"num_objects":30,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":179,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":132378397,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.13","version":"299'572","reported_seq":1407,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886038+0000","last_change":"2022-05-01T04:30:26.931140+0000","last_active":"2022-05-01T04:30:42.886038+0000","last_peered":"2022-05-01T04:30:42.886038+0000","last_clean":"2022-05-01T04:30:42.886038+0000","last_became_active":"2022-05-01T04:30:20.285780+0000","last_became_peered":"2022-05-01T04:30:20.285780+0000","last_unstale":"2022-05-01T04:30:42.886038+0000","last_undegraded":"2022-05-01T04:30:42.886038+0000","last_fullsized":"2022-05-01T04:30:42.886038+0000","mapping_epoch":295,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":296,"parent":"0.0","parent_split_bits":5,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":572,"ondisk_log_size":572,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":1.706369295,"stat_sum":{"num_bytes":102081758,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":128,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":56033723,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.12","version":"300'547","reported_seq":2075,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:45.067414+0000","last_change":"2022-05-01T04:30:45.067267+0000","last_active":"2022-05-01T04:30:45.067414+0000","last_peered":"2022-05-01T04:30:45.067414+0000","last_clean":"2022-05-01T04:30:45.067414+0000","last_became_active":"2022-05-01T04:30:07.095952+0000","last_became_peered":"2022-05-01T04:30:07.095952+0000","last_unstale":"2022-05-01T04:30:45.067414+0000","last_undegraded":"2022-05-01T04:30:45.067414+0000","last_fullsized":"2022-05-01T04:30:45.067414+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"300'547","last_scrub_stamp":"2022-05-01T04:30:45.067056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:45.067056+0000","objects_scrubbed":45,"log_size":547,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:48.642649+0000","scrub_duration":0.41387814099999998,"objects_trimmed":0,"snaptrim_duration":0.29937229199999998,"stat_sum":{"num_bytes":119129063,"num_objects":45,"num_object_clones":6,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.11","version":"294'459","reported_seq":2012,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.885825+0000","last_change":"2022-05-01T04:30:20.820375+0000","last_active":"2022-05-01T04:30:42.885825+0000","last_peered":"2022-05-01T04:30:42.885825+0000","last_clean":"2022-05-01T04:30:42.885825+0000","last_became_active":"2022-05-01T04:30:16.337078+0000","last_became_peered":"2022-05-01T04:30:16.337078+0000","last_unstale":"2022-05-01T04:30:42.885825+0000","last_undegraded":"2022-05-01T04:30:42.885825+0000","last_fullsized":"2022-05-01T04:30:42.885825+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":459,"ondisk_log_size":459,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.75287199800000004,"stat_sum":{"num_bytes":95657072,"num_objects":39,"num_object_clones":8,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":121,"num_read_kb":76398,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":183552292,"num_keys_recovered":160,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.10","version":"306'494","reported_seq":1770,"reported_epoch":306,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:45.217681+0000","last_change":"2022-05-01T04:30:45.217681+0000","last_active":"2022-05-01T04:30:45.217681+0000","last_peered":"2022-05-01T04:30:45.217681+0000","last_clean":"2022-05-01T04:30:45.217681+0000","last_became_active":"2022-05-01T04:30:25.327719+0000","last_became_peered":"2022-05-01T04:30:25.327719+0000","last_unstale":"2022-05-01T04:30:45.217681+0000","last_undegraded":"2022-05-01T04:30:45.217681+0000","last_fullsized":"2022-05-01T04:30:45.217681+0000","mapping_epoch":299,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"305'492","last_scrub_stamp":"2022-05-01T04:30:44.966852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.966852+0000","objects_scrubbed":31,"log_size":494,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":9,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:06.496639+0000","scrub_duration":0.313975106,"objects_trimmed":0,"snaptrim_duration":1.37659145,"stat_sum":{"num_bytes":90587458,"num_objects":31,"num_object_clones":3,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.f","version":"277'540","reported_seq":1311,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886800+0000","last_change":"2022-05-01T04:30:16.500449+0000","last_active":"2022-05-01T04:30:42.886800+0000","last_peered":"2022-05-01T04:30:42.886800+0000","last_clean":"2022-05-01T04:30:42.886800+0000","last_became_active":"2022-05-01T04:30:16.399454+0000","last_became_peered":"2022-05-01T04:30:16.399454+0000","last_unstale":"2022-05-01T04:30:42.886800+0000","last_undegraded":"2022-05-01T04:30:42.886800+0000","last_fullsized":"2022-05-01T04:30:42.886800+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'412","last_scrub_stamp":"2022-05-01T04:28:16.288822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:16.288822+0000","objects_scrubbed":63,"log_size":540,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81907881800000004,"objects_trimmed":0,"snaptrim_duration":0.72566574800000005,"stat_sum":{"num_bytes":198947307,"num_objects":70,"num_object_clones":8,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":2,"num_read":226,"num_read_kb":100373,"num_write":447,"num_write_kb":118211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":2944186,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.e","version":"276'657","reported_seq":1965,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886057+0000","last_change":"2022-05-01T04:30:02.666116+0000","last_active":"2022-05-01T04:30:42.886057+0000","last_peered":"2022-05-01T04:30:42.886057+0000","last_clean":"2022-05-01T04:30:42.886057+0000","last_became_active":"2022-05-01T04:29:15.968177+0000","last_became_peered":"2022-05-01T04:29:15.968177+0000","last_unstale":"2022-05-01T04:30:42.886057+0000","last_undegraded":"2022-05-01T04:30:42.886057+0000","last_fullsized":"2022-05-01T04:30:42.886057+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'588","last_scrub_stamp":"2022-05-01T04:29:37.821007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.821007+0000","objects_scrubbed":80,"log_size":657,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.62661968000000001,"objects_trimmed":0,"snaptrim_duration":0.88139935800000002,"stat_sum":{"num_bytes":238859551,"num_objects":88,"num_object_clones":14,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":2,"num_read":259,"num_read_kb":84476,"num_write":573,"num_write_kb":169626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":228132670,"num_keys_recovered":80,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.d","version":"304'452","reported_seq":1559,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.466858+0000","last_change":"2022-05-01T04:30:43.466858+0000","last_active":"2022-05-01T04:30:43.466858+0000","last_peered":"2022-05-01T04:30:43.466858+0000","last_clean":"2022-05-01T04:30:43.466858+0000","last_became_active":"2022-05-01T04:30:17.429652+0000","last_became_peered":"2022-05-01T04:30:17.429652+0000","last_unstale":"2022-05-01T04:30:43.466858+0000","last_undegraded":"2022-05-01T04:30:43.466858+0000","last_fullsized":"2022-05-01T04:30:43.466858+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":0,"last_scrub":"304'452","last_scrub_stamp":"2022-05-01T04:30:43.262739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.262739+0000","objects_scrubbed":64,"log_size":452,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:08.333726+0000","scrub_duration":0.92506281099999998,"objects_trimmed":0,"snaptrim_duration":0.50948584399999997,"stat_sum":{"num_bytes":171885785,"num_objects":64,"num_object_clones":10,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":1,"num_read":184,"num_read_kb":90112,"num_write":428,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":115470720,"num_keys_recovered":180,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.c","version":"306'496","reported_seq":2106,"reported_epoch":306,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:45.425481+0000","last_change":"2022-05-01T04:30:45.425481+0000","last_active":"2022-05-01T04:30:45.425481+0000","last_peered":"2022-05-01T04:30:45.425481+0000","last_clean":"2022-05-01T04:30:45.425481+0000","last_became_active":"2022-05-01T04:30:39.013083+0000","last_became_peered":"2022-05-01T04:30:39.013083+0000","last_unstale":"2022-05-01T04:30:45.425481+0000","last_undegraded":"2022-05-01T04:30:45.425481+0000","last_fullsized":"2022-05-01T04:30:45.425481+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"249'466","last_scrub_stamp":"2022-05-01T04:29:36.465699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.465699+0000","objects_scrubbed":62,"log_size":496,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81548162000000002,"objects_trimmed":0,"snaptrim_duration":1.142217163,"stat_sum":{"num_bytes":167437493,"num_objects":63,"num_object_clones":7,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":2,"num_read":271,"num_read_kb":161213,"num_write":425,"num_write_kb":112139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":431,"num_bytes_recovered":451139640,"num_keys_recovered":91,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.b","version":"261'397","reported_seq":1750,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971191+0000","last_change":"2022-05-01T04:30:07.810362+0000","last_active":"2022-05-01T04:30:42.971191+0000","last_peered":"2022-05-01T04:30:42.971191+0000","last_clean":"2022-05-01T04:30:42.971191+0000","last_became_active":"2022-05-01T04:30:07.195503+0000","last_became_peered":"2022-05-01T04:30:07.195503+0000","last_unstale":"2022-05-01T04:30:42.971191+0000","last_undegraded":"2022-05-01T04:30:42.971191+0000","last_fullsized":"2022-05-01T04:30:42.971191+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"248'389","last_scrub_stamp":"2022-05-01T04:29:39.348483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.348483+0000","objects_scrubbed":68,"log_size":397,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.05234216,"objects_trimmed":0,"snaptrim_duration":0.61416249099999998,"stat_sum":{"num_bytes":179141560,"num_objects":68,"num_object_clones":8,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":206,"num_read_kb":69949,"num_write":398,"num_write_kb":107432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":339541664,"num_keys_recovered":220,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.a","version":"272'477","reported_seq":1749,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886252+0000","last_change":"2022-05-01T04:29:58.990005+0000","last_active":"2022-05-01T04:30:42.886252+0000","last_peered":"2022-05-01T04:30:42.886252+0000","last_clean":"2022-05-01T04:30:42.886252+0000","last_became_active":"2022-05-01T04:29:08.175363+0000","last_became_peered":"2022-05-01T04:29:08.175363+0000","last_unstale":"2022-05-01T04:30:42.886252+0000","last_undegraded":"2022-05-01T04:30:42.886252+0000","last_fullsized":"2022-05-01T04:30:42.886252+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"247'454","last_scrub_stamp":"2022-05-01T04:29:39.093953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.093953+0000","objects_scrubbed":70,"log_size":477,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:46.460212+0000","scrub_duration":1.3648651510000001,"objects_trimmed":0,"snaptrim_duration":0.15573891400000001,"stat_sum":{"num_bytes":197706553,"num_objects":71,"num_object_clones":8,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":2,"num_read":262,"num_read_kb":159904,"num_write":471,"num_write_kb":128600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":193253880,"num_keys_recovered":160,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.9","version":"276'505","reported_seq":1361,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.894496+0000","last_change":"2022-05-01T04:30:40.000604+0000","last_active":"2022-05-01T04:30:42.894496+0000","last_peered":"2022-05-01T04:30:42.894496+0000","last_clean":"2022-05-01T04:30:42.894496+0000","last_became_active":"2022-05-01T04:29:59.090857+0000","last_became_peered":"2022-05-01T04:29:59.090857+0000","last_unstale":"2022-05-01T04:30:42.894496+0000","last_undegraded":"2022-05-01T04:30:42.894496+0000","last_fullsized":"2022-05-01T04:30:42.894496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"276'505","last_scrub_stamp":"2022-05-01T04:30:40.000406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:40.000406+0000","objects_scrubbed":33,"log_size":505,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:40.973401+0000","scrub_duration":1.1692613220000001,"objects_trimmed":0,"snaptrim_duration":0.71138417200000004,"stat_sum":{"num_bytes":88684995,"num_objects":33,"num_object_clones":4,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.8","version":"273'465","reported_seq":2276,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971123+0000","last_change":"2022-05-01T04:30:08.055718+0000","last_active":"2022-05-01T04:30:42.971123+0000","last_peered":"2022-05-01T04:30:42.971123+0000","last_clean":"2022-05-01T04:30:42.971123+0000","last_became_active":"2022-05-01T04:30:00.189790+0000","last_became_peered":"2022-05-01T04:30:00.189790+0000","last_unstale":"2022-05-01T04:30:42.971123+0000","last_undegraded":"2022-05-01T04:30:42.971123+0000","last_fullsized":"2022-05-01T04:30:42.971123+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.101109292,"stat_sum":{"num_bytes":96164905,"num_objects":39,"num_object_clones":10,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":116,"num_read_kb":48609,"num_write":276,"num_write_kb":64534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":252683112,"num_keys_recovered":230,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.097278+0000","last_change":"2022-05-01T04:30:43.097130+0000","last_active":"2022-05-01T04:30:43.097278+0000","last_peered":"2022-05-01T04:30:43.097278+0000","last_clean":"2022-05-01T04:30:43.097278+0000","last_became_active":"2022-05-01T04:28:42.075951+0000","last_became_peered":"2022-05-01T04:28:42.075951+0000","last_unstale":"2022-05-01T04:30:43.097278+0000","last_undegraded":"2022-05-01T04:30:43.097278+0000","last_fullsized":"2022-05-01T04:30:43.097278+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:43.097017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.097017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:12.069270+0000","scrub_duration":0.562521787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"300'475","reported_seq":2132,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971873+0000","last_change":"2022-05-01T04:30:30.786613+0000","last_active":"2022-05-01T04:30:42.971873+0000","last_peered":"2022-05-01T04:30:42.971873+0000","last_clean":"2022-05-01T04:30:42.971873+0000","last_became_active":"2022-05-01T04:30:21.445664+0000","last_became_peered":"2022-05-01T04:30:21.445664+0000","last_unstale":"2022-05-01T04:30:42.971873+0000","last_undegraded":"2022-05-01T04:30:42.971873+0000","last_fullsized":"2022-05-01T04:30:42.971873+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":297,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":475,"ondisk_log_size":475,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":5.6648302790000002,"stat_sum":{"num_bytes":78914214,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":1,"num_read":103,"num_read_kb":29450,"num_write":243,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":241573064,"num_keys_recovered":170,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.098496+0000","last_change":"2022-05-01T04:30:02.996712+0000","last_active":"2022-05-01T04:30:43.098496+0000","last_peered":"2022-05-01T04:30:43.098496+0000","last_clean":"2022-05-01T04:30:43.098496+0000","last_became_active":"2022-05-01T04:30:02.896021+0000","last_became_peered":"2022-05-01T04:30:02.896021+0000","last_unstale":"2022-05-01T04:30:43.098496+0000","last_undegraded":"2022-05-01T04:30:43.098496+0000","last_fullsized":"2022-05-01T04:30:43.098496+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:52.422661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:52.422661+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:05.375337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"275'566","reported_seq":1429,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794267+0000","last_change":"2022-05-01T04:30:35.848139+0000","last_active":"2022-05-01T04:30:42.794267+0000","last_peered":"2022-05-01T04:30:42.794267+0000","last_clean":"2022-05-01T04:30:42.794267+0000","last_became_active":"2022-05-01T04:29:59.089639+0000","last_became_peered":"2022-05-01T04:29:59.089639+0000","last_unstale":"2022-05-01T04:30:42.794267+0000","last_undegraded":"2022-05-01T04:30:42.794267+0000","last_fullsized":"2022-05-01T04:30:42.794267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0.89342225399999997,"stat_sum":{"num_bytes":102081757,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":127,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":397,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.020574+0000","last_change":"2022-05-01T04:29:51.118516+0000","last_active":"2022-05-01T04:30:43.020574+0000","last_peered":"2022-05-01T04:30:43.020574+0000","last_clean":"2022-05-01T04:30:43.020574+0000","last_became_active":"2022-05-01T04:29:51.118117+0000","last_became_peered":"2022-05-01T04:29:51.118117+0000","last_unstale":"2022-05-01T04:30:43.020574+0000","last_undegraded":"2022-05-01T04:30:43.020574+0000","last_fullsized":"2022-05-01T04:30:43.020574+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:40.698524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:40.698524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:45.889971+0000","scrub_duration":0.50325435799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"273'490","reported_seq":1611,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.895251+0000","last_change":"2022-05-01T04:30:33.642210+0000","last_active":"2022-05-01T04:30:42.895251+0000","last_peered":"2022-05-01T04:30:42.895251+0000","last_clean":"2022-05-01T04:30:42.895251+0000","last_became_active":"2022-05-01T04:29:58.888029+0000","last_became_peered":"2022-05-01T04:29:58.888029+0000","last_unstale":"2022-05-01T04:30:42.895251+0000","last_undegraded":"2022-05-01T04:30:42.895251+0000","last_fullsized":"2022-05-01T04:30:42.895251+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0.00046417000000000002,"stat_sum":{"num_bytes":93110778,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":103,"num_read_kb":46934,"num_write":215,"num_write_kb":63006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":83574846,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.071675+0000","last_change":"2022-05-01T04:30:41.934135+0000","last_active":"2022-05-01T04:30:43.071675+0000","last_peered":"2022-05-01T04:30:43.071675+0000","last_clean":"2022-05-01T04:30:43.071675+0000","last_became_active":"2022-05-01T04:30:02.982092+0000","last_became_peered":"2022-05-01T04:30:02.982092+0000","last_unstale":"2022-05-01T04:30:43.071675+0000","last_undegraded":"2022-05-01T04:30:43.071675+0000","last_fullsized":"2022-05-01T04:30:43.071675+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:41.933990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:41.933990+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:45.211294+0000","scrub_duration":0.30281493700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'117","reported_seq":271,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.885606+0000","last_change":"2022-05-01T04:30:35.384860+0000","last_active":"2022-05-01T04:30:42.885606+0000","last_peered":"2022-05-01T04:30:42.885606+0000","last_clean":"2022-05-01T04:30:42.885606+0000","last_became_active":"2022-05-01T04:30:16.238972+0000","last_became_peered":"2022-05-01T04:30:16.238972+0000","last_unstale":"2022-05-01T04:30:42.885606+0000","last_undegraded":"2022-05-01T04:30:42.885606+0000","last_fullsized":"2022-05-01T04:30:42.885606+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2022-05-01T04:28:00.739540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:15.316890+0000","last_clean_scrub_stamp":"2022-05-01T04:28:00.739540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"273'535","reported_seq":2048,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971294+0000","last_change":"2022-05-01T04:30:37.327909+0000","last_active":"2022-05-01T04:30:42.971294+0000","last_peered":"2022-05-01T04:30:42.971294+0000","last_clean":"2022-05-01T04:30:42.971294+0000","last_became_active":"2022-05-01T04:30:37.005571+0000","last_became_peered":"2022-05-01T04:30:37.005571+0000","last_unstale":"2022-05-01T04:30:42.971294+0000","last_undegraded":"2022-05-01T04:30:42.971294+0000","last_fullsized":"2022-05-01T04:30:42.971294+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0.32170438600000001,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":7,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":1,"num_read":140,"num_read_kb":72872,"num_write":290,"num_write_kb":74976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":166104272,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.985883+0000","last_change":"2022-05-01T04:30:38.332044+0000","last_active":"2022-05-01T04:30:42.985883+0000","last_peered":"2022-05-01T04:30:42.985883+0000","last_clean":"2022-05-01T04:30:42.985883+0000","last_became_active":"2022-05-01T04:30:16.267154+0000","last_became_peered":"2022-05-01T04:30:16.267154+0000","last_unstale":"2022-05-01T04:30:42.985883+0000","last_undegraded":"2022-05-01T04:30:42.985883+0000","last_fullsized":"2022-05-01T04:30:42.985883+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:12.658835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:12.658835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.304165821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"294'453","reported_seq":1881,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:44.651118+0000","last_change":"2022-05-01T04:30:44.651012+0000","last_active":"2022-05-01T04:30:44.651118+0000","last_peered":"2022-05-01T04:30:44.651118+0000","last_clean":"2022-05-01T04:30:44.651118+0000","last_became_active":"2022-05-01T04:30:06.174043+0000","last_became_peered":"2022-05-01T04:30:06.174043+0000","last_unstale":"2022-05-01T04:30:44.651118+0000","last_undegraded":"2022-05-01T04:30:44.651118+0000","last_fullsized":"2022-05-01T04:30:44.651118+0000","mapping_epoch":281,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'453","last_scrub_stamp":"2022-05-01T04:30:44.650869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.650869+0000","objects_scrubbed":28,"log_size":453,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:47.041633+0000","scrub_duration":1.0091338110000001,"objects_trimmed":0,"snaptrim_duration":0.466307156,"stat_sum":{"num_bytes":71326779,"num_objects":28,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886488+0000","last_change":"2022-05-01T04:29:49.588507+0000","last_active":"2022-05-01T04:30:42.886488+0000","last_peered":"2022-05-01T04:30:42.886488+0000","last_clean":"2022-05-01T04:30:42.886488+0000","last_became_active":"2022-05-01T04:25:17.351886+0000","last_became_peered":"2022-05-01T04:25:17.351886+0000","last_unstale":"2022-05-01T04:30:42.886488+0000","last_undegraded":"2022-05-01T04:30:42.886488+0000","last_fullsized":"2022-05-01T04:30:42.886488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:49.588383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.588383+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:54.942702+0000","scrub_duration":0.30376289400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'361","reported_seq":1795,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.795559+0000","last_change":"2022-05-01T04:30:37.735039+0000","last_active":"2022-05-01T04:30:42.795559+0000","last_peered":"2022-05-01T04:30:42.795559+0000","last_clean":"2022-05-01T04:30:42.795559+0000","last_became_active":"2022-05-01T04:30:13.311320+0000","last_became_peered":"2022-05-01T04:30:13.311320+0000","last_unstale":"2022-05-01T04:30:42.795559+0000","last_undegraded":"2022-05-01T04:30:42.795559+0000","last_fullsized":"2022-05-01T04:30:42.795559+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0.00086617699999999998,"stat_sum":{"num_bytes":83569377,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":178,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":177664904,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.7","version":"273'533","reported_seq":2020,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:44.251951+0000","last_change":"2022-05-01T04:30:44.251861+0000","last_active":"2022-05-01T04:30:44.251951+0000","last_peered":"2022-05-01T04:30:44.251951+0000","last_clean":"2022-05-01T04:30:44.251951+0000","last_became_active":"2022-05-01T04:29:59.991809+0000","last_became_peered":"2022-05-01T04:29:59.991809+0000","last_unstale":"2022-05-01T04:30:44.251951+0000","last_undegraded":"2022-05-01T04:30:44.251951+0000","last_fullsized":"2022-05-01T04:30:44.251951+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":281,"parent":"0.0","parent_split_bits":0,"last_scrub":"273'533","last_scrub_stamp":"2022-05-01T04:30:44.251736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.251736+0000","objects_scrubbed":46,"log_size":533,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:13.952725+0000","scrub_duration":0.57039800500000004,"objects_trimmed":0,"snaptrim_duration":0.40617742299999998,"stat_sum":{"num_bytes":119043437,"num_objects":46,"num_object_clones":12,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794919+0000","last_change":"2022-05-01T04:30:29.747580+0000","last_active":"2022-05-01T04:30:42.794919+0000","last_peered":"2022-05-01T04:30:42.794919+0000","last_clean":"2022-05-01T04:30:42.794919+0000","last_became_active":"2022-05-01T04:28:42.261299+0000","last_became_peered":"2022-05-01T04:28:42.261299+0000","last_unstale":"2022-05-01T04:30:42.794919+0000","last_undegraded":"2022-05-01T04:30:42.794919+0000","last_fullsized":"2022-05-01T04:30:42.794919+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:48.745287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.745287+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":395,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.865335+0000","last_change":"2022-05-01T04:30:43.865062+0000","last_active":"2022-05-01T04:30:43.865335+0000","last_peered":"2022-05-01T04:30:43.865335+0000","last_clean":"2022-05-01T04:30:43.865335+0000","last_became_active":"2022-05-01T04:29:05.170684+0000","last_became_peered":"2022-05-01T04:29:05.170684+0000","last_unstale":"2022-05-01T04:30:43.865335+0000","last_undegraded":"2022-05-01T04:30:43.865335+0000","last_fullsized":"2022-05-01T04:30:43.865335+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:43.864934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.864934+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:06.201732+0000","scrub_duration":0.204585195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"277'573","reported_seq":1947,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.103309+0000","last_change":"2022-05-01T04:30:43.103199+0000","last_active":"2022-05-01T04:30:43.103309+0000","last_peered":"2022-05-01T04:30:43.103309+0000","last_clean":"2022-05-01T04:30:43.103309+0000","last_became_active":"2022-05-01T04:29:58.986844+0000","last_became_peered":"2022-05-01T04:29:58.986844+0000","last_unstale":"2022-05-01T04:30:43.103309+0000","last_undegraded":"2022-05-01T04:30:43.103309+0000","last_fullsized":"2022-05-01T04:30:43.103309+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'573","last_scrub_stamp":"2022-05-01T04:30:43.103081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.103081+0000","objects_scrubbed":26,"log_size":573,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:09.192011+0000","scrub_duration":0.413295617,"objects_trimmed":0,"snaptrim_duration":0.91696671600000002,"stat_sum":{"num_bytes":65937440,"num_objects":26,"num_object_clones":6,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":26,"stat_sum":{"num_bytes":3033482507,"num_objects":1138,"num_object_clones":186,"num_object_copies":3414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":28,"num_read":2984,"num_read_kb":1354232,"num_write":6058,"num_write_kb":1635629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3293,"num_bytes_recovered":3515279523,"num_keys_recovered":1981,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4649717760,"data_stored":4855667241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":654892,"internal_metadata":0},"log_size":12961,"ondisk_log_size":12961,"up":78,"acting":78,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":2115712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":803700,"kb_used_data":760236,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":93568140,"statfs":{"total":96636764160,"available":95813775360,"internally_reserved":0,"allocated":778481664,"data_stored":807990595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":10.657,"5min":24.966000000000001,"15min":57.649999999999999},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":85.858999999999995,"5min":518.15200000000004,"15min":518.15200000000004},"last":1.143},{"interface":"front","average":{"1min":2.96,"5min":4.0540000000000003,"15min":7.8920000000000003},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":40.087000000000003,"5min":99.054000000000002,"15min":99.054000000000002},"last":1.175}]},{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":4.6619999999999999,"5min":1.5369999999999999,"15min":1.0309999999999999},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":62.966999999999999,"5min":62.966999999999999,"15min":62.966999999999999},"last":1.111},{"interface":"front","average":{"1min":7.3620000000000001,"5min":10.083,"15min":9.2400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":98.472999999999999,"5min":98.472999999999999,"15min":98.472999999999999},"last":1.244}]},{"osd":2,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":3.3980000000000001,"5min":9.7639999999999993,"15min":24.231000000000002},"min":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":48.801000000000002,"5min":252.857,"15min":252.857},"last":1.026},{"interface":"front","average":{"1min":5.5060000000000002,"5min":16.396999999999998,"15min":44.088999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":41.975000000000001,"5min":310.839,"15min":310.839},"last":1.0609999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":1.401,"15min":1.131},"min":{"1min":0.70899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":40.189999999999998,"5min":40.189999999999998,"15min":40.189999999999998},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1140000000000001,"15min":1.1499999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5600000000000001,"5min":3.585,"15min":3.585},"last":1.21}]},{"osd":4,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":3.927,"5min":3.835,"15min":3.3570000000000002},"min":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":40.259999999999998,"5min":100.727,"15min":100.727},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.028,"5min":12.026,"15min":25.09},"min":{"1min":0.67000000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4450000000000001,"5min":252.94900000000001,"15min":252.94900000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.3410000000000002,"5min":10.968999999999999,"15min":24.16},"min":{"1min":0.63,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":42.119999999999997,"5min":301.91000000000003,"15min":301.91000000000003},"last":0.95099999999999996},{"interface":"front","average":{"1min":6.9429999999999996,"5min":5.1079999999999997,"15min":10.957000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":72.120999999999995,"5min":159.309,"15min":159.309},"last":0.97799999999999998}]},{"osd":6,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":6.9029999999999996,"5min":10.384,"15min":26.631},"min":{"1min":0.77100000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":69.748999999999995,"5min":294.37,"15min":294.37},"last":1.2809999999999999},{"interface":"front","average":{"1min":4.8680000000000003,"5min":14.615,"15min":43.470999999999997},"min":{"1min":0.874,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":69.724000000000004,"5min":294.82299999999998,"15min":294.82299999999998},"last":1.3069999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592860,"kb_used_data":555540,"kb_used_omap":0,"kb_used_meta":37312,"kb_avail":93778980,"statfs":{"total":96636764160,"available":96029675520,"internally_reserved":0,"allocated":568872960,"data_stored":588717970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":38207488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":12.117000000000001,"5min":20.341999999999999,"15min":40.899000000000001},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":146.00800000000001,"5min":474.91300000000001,"15min":474.91300000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":16.079999999999998,"5min":14.685,"15min":24.908999999999999},"min":{"1min":0.53400000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":146.03,"5min":296.67500000000001,"15min":296.67500000000001},"last":1.214}]},{"osd":1,"last update":"Sun May 1 04:30:41 2022","interfaces":[{"interface":"back","average":{"1min":4.9189999999999996,"5min":3.6520000000000001,"15min":1.833},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":74.247,"5min":100.899,"15min":100.899},"last":0.998},{"interface":"front","average":{"1min":4.1319999999999997,"5min":3.0790000000000002,"15min":3.1509999999999998},"min":{"1min":0.65900000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":58.203000000000003,"5min":58.203000000000003,"15min":58.203000000000003},"last":1.4670000000000001}]},{"osd":2,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":12.288,"15min":31.699000000000002},"min":{"1min":0.65600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":37.988999999999997,"5min":384.75700000000001,"15min":384.75700000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":4.9180000000000001,"5min":7.1749999999999998,"15min":16.774000000000001},"min":{"1min":0.66200000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":74.480999999999995,"5min":160.499,"15min":160.499},"last":1.6240000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:12 2022","interfaces":[{"interface":"back","average":{"1min":5.1210000000000004,"5min":6.2729999999999997,"15min":6.0990000000000002},"min":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":39.613999999999997,"5min":93.191999999999993,"15min":93.191999999999993},"last":1.3660000000000001},{"interface":"front","average":{"1min":5.5700000000000003,"5min":2.5150000000000001,"15min":1.544},"min":{"1min":0.81699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":45.993000000000002,"5min":49.615000000000002,"15min":49.615000000000002},"last":1.3300000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":9.2210000000000001,"15min":28.965},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.736,"5min":384.22199999999998,"15min":384.22199999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":17.77,"5min":14.365,"15min":32.424999999999997},"min":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":167.744,"5min":290.24200000000002,"15min":290.24200000000002},"last":1.391}]},{"osd":5,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":9.2119999999999997,"15min":20.93},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":33.787999999999997,"5min":276.17000000000002,"15min":276.17000000000002},"last":1.272},{"interface":"front","average":{"1min":4.8029999999999999,"5min":13.064,"15min":40.137999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":69.587999999999994,"5min":384.64299999999997,"15min":384.64299999999997},"last":1.657}]},{"osd":7,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":8.8539999999999992,"5min":26.236999999999998,"15min":76.006},"min":{"1min":0.88500000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":74.135000000000005,"5min":670.42999999999995,"15min":670.42999999999995},"last":1.538},{"interface":"front","average":{"1min":2.778,"5min":4.8630000000000004,"15min":2.327},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":33.892000000000003,"5min":94.379999999999995,"15min":94.379999999999995},"last":1.5209999999999999}]}]},{"osd":1,"up_from":134,"seq":575525617704,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583412,"kb_used_data":540012,"kb_used_omap":652,"kb_used_meta":42739,"kb_avail":93788428,"statfs":{"total":96636764160,"available":96039350272,"internally_reserved":0,"allocated":552972288,"data_stored":578843183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":668200,"internal_metadata":43765208},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":7.4340000000000002,"5min":9.7579999999999991,"15min":9.3960000000000008},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":152.63800000000001,"5min":176.80000000000001,"15min":176.80000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":7.5279999999999996,"15min":8.6859999999999999},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1599999999999999,"5min":176.886,"15min":176.886},"last":1.0620000000000001}]},{"osd":2,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":9.1899999999999995,"5min":5.5839999999999996,"15min":4.1920000000000002},"min":{"1min":0.67300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":153.50700000000001,"5min":153.50700000000001,"15min":153.50700000000001},"last":1.028},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.339,"15min":1.0169999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2410000000000001,"5min":34.151000000000003,"15min":34.151000000000003},"last":1.2230000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":7.7270000000000003,"5min":3.8700000000000001,"15min":2.02},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":153.66499999999999,"5min":153.66499999999999,"15min":153.66499999999999},"last":1.444},{"interface":"front","average":{"1min":1.095,"5min":1.6379999999999999,"15min":1.3340000000000001},"min":{"1min":0.85099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3799999999999999,"5min":34.658000000000001,"15min":34.658000000000001},"last":1.3799999999999999}]},{"osd":4,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":11.423,"5min":10.010999999999999,"15min":9.7490000000000006},"min":{"1min":0.86799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":93.575000000000003,"5min":93.575000000000003,"15min":93.575000000000003},"last":1.532},{"interface":"front","average":{"1min":20.222000000000001,"5min":6.9699999999999998,"15min":3.0339999999999998},"min":{"1min":0.86699999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":182.101,"5min":182.101,"15min":182.101},"last":1.1000000000000001}]},{"osd":5,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.7270000000000001,"15min":1.411},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7390000000000001,"5min":34.417999999999999,"15min":34.417999999999999},"last":1.7390000000000001},{"interface":"front","average":{"1min":12.800000000000001,"5min":4.8769999999999998,"15min":2.3610000000000002},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":87.403000000000006,"5min":87.403000000000006,"15min":87.403000000000006},"last":1.4139999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":8.4019999999999992,"5min":5.1319999999999997,"15min":2.5960000000000001},"min":{"1min":0.90400000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":87.778999999999996,"5min":87.778999999999996,"15min":87.778999999999996},"last":1.605},{"interface":"front","average":{"1min":8.5630000000000006,"5min":4.2729999999999997,"15min":2.351},"min":{"1min":0.96199999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":153.84700000000001,"5min":153.84700000000001,"15min":153.84700000000001},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":16.396000000000001,"5min":8.6020000000000003,"15min":5.9100000000000001},"min":{"1min":1.0569999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":182.24700000000001,"5min":182.24700000000001,"15min":182.24700000000001},"last":1.8680000000000001},{"interface":"front","average":{"1min":10.667,"5min":4.758,"15min":2.573},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":153.999,"5min":153.999,"15min":153.999},"last":1.8320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":613588,"kb_used_data":572940,"kb_used_omap":0,"kb_used_meta":40640,"kb_avail":93758252,"statfs":{"total":96636764160,"available":96008450048,"internally_reserved":0,"allocated":586690560,"data_stored":614157248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41615360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":3.8290000000000002,"15min":4.7629999999999999},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":9.2599999999999998,"5min":94.671999999999997,"15min":94.671999999999997},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3979999999999999,"5min":4.5099999999999998,"15min":2.8420000000000001},"min":{"1min":0.61799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.3369999999999997,"5min":218.80099999999999,"15min":218.80099999999999},"last":1.161}]},{"osd":2,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":6.1109999999999998,"15min":10.724},"min":{"1min":0.60699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":37.590000000000003,"5min":106.374,"15min":106.374},"last":0.998},{"interface":"front","average":{"1min":3.9159999999999999,"5min":18.167999999999999,"15min":47.347999999999999},"min":{"1min":0.67000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":62.494999999999997,"5min":497.91500000000002,"15min":497.91500000000002},"last":1.2090000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":3.3580000000000001,"15min":2.4969999999999999},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.528,"5min":176.02699999999999,"15min":176.02699999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":6.5469999999999997,"5min":2.7210000000000001,"15min":2.2480000000000002},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":48.159999999999997,"5min":48.159999999999997,"15min":48.159999999999997},"last":1.256}]},{"osd":4,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":5.4749999999999996,"5min":11.779,"15min":21.771000000000001},"min":{"1min":0.78800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":91.885999999999996,"5min":248.709,"15min":248.709},"last":1.8400000000000001},{"interface":"front","average":{"1min":10.771000000000001,"5min":20.896000000000001,"15min":34.020000000000003},"min":{"1min":0.92400000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":94.790000000000006,"5min":315.69400000000002,"15min":315.69400000000002},"last":1.7769999999999999}]},{"osd":5,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":5.2300000000000004,"5min":20.780999999999999,"15min":51.606000000000002},"min":{"1min":0.97599999999999998,"5min":0.622,"15min":0.622},"max":{"1min":66.656999999999996,"5min":540.08900000000006,"15min":540.08900000000006},"last":1.7549999999999999},{"interface":"front","average":{"1min":3.895,"5min":10.922000000000001,"15min":13.324},"min":{"1min":0.93600000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":55.593000000000004,"5min":176.32599999999999,"15min":176.32599999999999},"last":1.9419999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":7.5250000000000004,"5min":16.742000000000001,"15min":30.303999999999998},"min":{"1min":0.88100000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":62.244999999999997,"5min":240.36600000000001,"15min":240.36600000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":24.437000000000001,"15min":62.009999999999998},"min":{"1min":1.151,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.456,"5min":498.05399999999997,"15min":498.05399999999997},"last":1.964}]},{"osd":7,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":34.844000000000001,"15min":113.08499999999999},"min":{"1min":1.129,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3029999999999999,"5min":1663.876,"15min":1663.876},"last":1.865},{"interface":"front","average":{"1min":7.1310000000000002,"5min":31.765999999999998,"15min":97.912999999999997},"min":{"1min":1.157,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":101.224,"5min":844.65300000000002,"15min":844.65300000000002},"last":2.0299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255172,"kb_used_data":227004,"kb_used_omap":0,"kb_used_meta":28160,"kb_avail":94116668,"statfs":{"total":96636764160,"available":96375468032,"internally_reserved":0,"allocated":232452096,"data_stored":245001212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28835840},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":3.6150000000000002,"5min":3.8660000000000001,"15min":1.8120000000000001},"min":{"1min":0.54200000000000004,"5min":0.443,"15min":0.443},"max":{"1min":54.290999999999997,"5min":72.322000000000003,"15min":72.322000000000003},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.419,"5min":22.989999999999998,"15min":58.119},"min":{"1min":0.52900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":9.8650000000000002,"5min":465.05200000000002,"15min":465.05200000000002},"last":0.89100000000000001}]},{"osd":1,"last update":"Sun May 1 04:30:41 2022","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":14.868,"15min":17.003},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":9.3889999999999993,"5min":153.101,"15min":153.101},"last":0.92700000000000005},{"interface":"front","average":{"1min":3.2469999999999999,"5min":2.8300000000000001,"15min":1.5489999999999999},"min":{"1min":0.621,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":52.039000000000001,"5min":117.398,"15min":117.398},"last":1.145}]},{"osd":3,"last update":"Sun May 1 04:30:08 2022","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.212,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.390000000000001,"5min":21.312000000000001,"15min":21.312000000000001},"last":1.29},{"interface":"front","average":{"1min":1.034,"5min":0.93799999999999994,"15min":0.90600000000000003},"min":{"1min":0.73999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0760000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":2.7200000000000002,"5min":5.6219999999999999,"15min":13.254},"min":{"1min":0.88300000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":35.039999999999999,"5min":147.17099999999999,"15min":147.17099999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":2.2959999999999998,"5min":11.9,"15min":31.994},"min":{"1min":0.89200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":26.298999999999999,"5min":240.71000000000001,"15min":240.71000000000001},"last":1.206}]},{"osd":5,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":11.964,"15min":14.513},"min":{"1min":0.85799999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":13.206,"5min":260.42099999999999,"15min":260.42099999999999},"last":1.383},{"interface":"front","average":{"1min":1.4139999999999999,"5min":4.7229999999999999,"15min":11.933999999999999},"min":{"1min":0.98199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.492,"5min":196.74799999999999,"15min":196.74799999999999},"last":1.655}]},{"osd":6,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":10.991,"5min":8.7520000000000007,"15min":20.745999999999999},"min":{"1min":0.82799999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":174.387,"5min":174.387,"15min":174.387},"last":1.353},{"interface":"front","average":{"1min":1.7849999999999999,"5min":16.550999999999998,"15min":34.046999999999997},"min":{"1min":0.93000000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":13.034000000000001,"5min":269.53100000000001,"15min":269.53100000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.4970000000000001,"15min":1.744},"min":{"1min":1.0289999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":4.008,"5min":11.654999999999999,"15min":11.654999999999999},"last":1.464},{"interface":"front","average":{"1min":1.873,"5min":10.037000000000001,"15min":15.815},"min":{"1min":1.05,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":13.332000000000001,"5min":160.547,"15min":160.547},"last":1.623}]}]},{"osd":3,"up_from":105,"seq":450971566126,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":695516,"kb_used_data":665620,"kb_used_omap":2,"kb_used_meta":29885,"kb_avail":93676324,"statfs":{"total":96636764160,"available":95924555776,"internally_reserved":0,"allocated":681594880,"data_stored":700583997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":30602427},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":4.7389999999999999,"15min":6.298},"min":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":73.262,"15min":73.262},"last":0.63900000000000001},{"interface":"front","average":{"1min":7.7329999999999997,"5min":6.2919999999999998,"15min":7.1989999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":72.561000000000007,"5min":97.546999999999997,"15min":97.546999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun May 1 04:30:40 2022","interfaces":[{"interface":"back","average":{"1min":6.1150000000000002,"5min":2.4169999999999998,"15min":1.387},"min":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":79.268000000000001,"5min":79.268000000000001,"15min":79.268000000000001},"last":0.749},{"interface":"front","average":{"1min":3.6040000000000001,"5min":2.262,"15min":1.3360000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":42.411000000000001,"5min":51.715000000000003,"15min":51.715000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":0.94399999999999995},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.841,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":5.4009999999999998,"5min":4.351,"15min":4.7690000000000001},"min":{"1min":0.748,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":73.284000000000006,"5min":83.582999999999998,"15min":83.582999999999998},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":14.065,"5min":6.859,"15min":4.4889999999999999},"min":{"1min":0.80500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":88.811000000000007,"5min":97.501999999999995,"15min":97.501999999999995},"last":1.018},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.3220000000000001,"15min":2.8300000000000001},"min":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7150000000000001,"5min":42.081000000000003,"15min":42.081000000000003},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3029999999999999,"15min":1.284},"min":{"1min":1.0660000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.885,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.353},{"interface":"front","average":{"1min":5.4340000000000002,"5min":4.4109999999999996,"15min":3.9750000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":72.870000000000005,"5min":91.775999999999996,"15min":91.775999999999996},"last":1.27}]},{"osd":6,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":2.681,"15min":1.7549999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":60.124000000000002,"5min":78.131,"15min":78.131},"last":1.1279999999999999},{"interface":"front","average":{"1min":3.6890000000000001,"5min":4.7919999999999998,"15min":4.3760000000000003},"min":{"1min":1.0840000000000001,"5min":1.014,"15min":1.014},"max":{"1min":39.942999999999998,"5min":89.192999999999998,"15min":89.192999999999998},"last":1.246}]},{"osd":7,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":7.8170000000000002,"5min":2.6709999999999998,"15min":1.8169999999999999},"min":{"1min":0.98599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":73.015000000000001,"5min":73.015000000000001,"15min":73.015000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":6.5549999999999997,"5min":3.1709999999999998,"15min":1.954},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":89.414000000000001,"5min":89.414000000000001,"15min":89.414000000000001},"last":1.389}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":833920,"kb_used_data":778360,"kb_used_omap":0,"kb_used_meta":55552,"kb_avail":93537920,"statfs":{"total":96636764160,"available":95782830080,"internally_reserved":0,"allocated":797040640,"data_stored":838331730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56885248},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":5.0339999999999998,"5min":13.298999999999999,"15min":22.567},"min":{"1min":0.499,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":78.052999999999997,"5min":257.822,"15min":257.822},"last":0.63},{"interface":"front","average":{"1min":7.0049999999999999,"5min":9.2729999999999997,"15min":21.509},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":58.395000000000003,"5min":256.291,"15min":256.291},"last":1.171}]},{"osd":1,"last update":"Sun May 1 04:30:42 2022","interfaces":[{"interface":"back","average":{"1min":4.0570000000000004,"5min":5.4969999999999999,"15min":6.1210000000000004},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":66.712999999999994,"5min":91.667000000000002,"15min":91.667000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":4.5990000000000002,"15min":2.464},"min":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.284,"5min":129.15799999999999,"15min":129.15799999999999},"last":0.92400000000000004}]},{"osd":2,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":8.8599999999999994,"15min":20.228000000000002},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.2669999999999999,"5min":256.45999999999998,"15min":256.45999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":6.8630000000000004,"15min":14.843},"min":{"1min":0.74099999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":174.048,"15min":174.048},"last":1.111}]},{"osd":3,"last update":"Sun May 1 04:30:11 2022","interfaces":[{"interface":"back","average":{"1min":6.1619999999999999,"5min":4.6959999999999997,"15min":4.4619999999999997},"min":{"1min":0.80700000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":97.203999999999994,"5min":97.203999999999994,"15min":97.203999999999994},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":3.8929999999999998,"15min":3.2010000000000001},"min":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3260000000000001,"5min":91.527000000000001,"15min":91.527000000000001},"last":1.256}]},{"osd":5,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.4220000000000002,"5min":12.462999999999999,"15min":23.196999999999999},"min":{"1min":0.65500000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":27.620000000000001,"5min":159.648,"15min":159.648},"last":1.077},{"interface":"front","average":{"1min":1.0940000000000001,"5min":10.414,"15min":29.292000000000002},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4350000000000001,"5min":256.18799999999999,"15min":256.18799999999999},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.8769999999999998,"5min":9.3179999999999996,"15min":16.654},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":34.543999999999997,"5min":174.274,"15min":174.274},"last":1.3540000000000001},{"interface":"front","average":{"1min":5.2380000000000004,"5min":13.058,"15min":24.372},"min":{"1min":0.91600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":54.326999999999998,"5min":231.74799999999999,"15min":231.74799999999999},"last":1.206}]},{"osd":7,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":15.888,"15min":48.289999999999999},"min":{"1min":0.998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":16.422000000000001,"5min":652.226,"15min":652.226},"last":1.381},{"interface":"front","average":{"1min":9.3469999999999995,"5min":20.452999999999999,"15min":46.524999999999999},"min":{"1min":0.94799999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":106.176,"5min":376.32900000000001,"15min":376.32900000000001},"last":1.4530000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":470204,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":481488896,"data_stored":496073002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.6230000000000002,"5min":14.685,"15min":33.274000000000001},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":63.991999999999997,"5min":334.69799999999998,"15min":334.69799999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":13.112,"5min":13.273,"15min":21.361000000000001},"min":{"1min":0.76800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":106.07899999999999,"5min":282.01999999999998,"15min":282.01999999999998},"last":1.0940000000000001}]},{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":5.5499999999999998,"5min":3.177,"15min":1.6739999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":110.831,"5min":110.831,"15min":110.831},"last":0.98099999999999998},{"interface":"front","average":{"1min":4.25,"5min":3.0640000000000001,"15min":1.599},"min":{"1min":0.69599999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":40.506,"5min":58.759,"15min":58.759},"last":1.014}]},{"osd":2,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":8.2409999999999997,"5min":3.5129999999999999,"15min":4.2510000000000003},"min":{"1min":0.58399999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":106.206,"5min":106.206,"15min":106.206},"last":0.93700000000000006},{"interface":"front","average":{"1min":5.3499999999999996,"5min":4.0759999999999996,"15min":9.5099999999999998},"min":{"1min":0.66700000000000004,"5min":0.621,"15min":0.621},"max":{"1min":110.908,"5min":150.518,"15min":150.518},"last":1.4159999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:10 2022","interfaces":[{"interface":"back","average":{"1min":5.3099999999999996,"5min":1.879,"15min":1.3069999999999999},"min":{"1min":0.751,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":110.706,"5min":110.706,"15min":110.706},"last":1.2},{"interface":"front","average":{"1min":7.556,"5min":2.3849999999999998,"15min":1.486},"min":{"1min":0.84699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":76.444000000000003,"5min":76.444000000000003,"15min":76.444000000000003},"last":1.1319999999999999}]},{"osd":4,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":11.669,"15min":36.732999999999997},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4339999999999999,"5min":385.29300000000001,"15min":385.29300000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":11.545999999999999,"5min":11.125,"15min":19.908000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":106.327,"5min":189.869,"15min":189.869},"last":1.2490000000000001}]},{"osd":6,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":12.663,"15min":28.815000000000001},"min":{"1min":0.80700000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":110.61199999999999,"5min":332.26299999999998,"15min":332.26299999999998},"last":1.327},{"interface":"front","average":{"1min":1.827,"5min":7,"15min":17.992999999999999},"min":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":17.824000000000002,"5min":295.99299999999999,"15min":295.99299999999999},"last":1.2310000000000001}]},{"osd":7,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":12.597,"5min":31.109999999999999,"15min":93.878},"min":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":152.393,"5min":1543.201,"15min":1543.201},"last":1.5629999999999999},{"interface":"front","average":{"1min":9.4559999999999995,"5min":6.2789999999999999,"15min":12.819000000000001},"min":{"1min":0.89100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":110.771,"5min":150.71100000000001,"15min":150.71100000000001},"last":1.488}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":582623232,"data_stored":612072706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":549437440,"data_stored":577287569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":652007,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":228917248,"data_stored":243445598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":678060032,"data_stored":699028383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":793505792,"data_stored":836776116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":477954048,"data_stored":494517388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":564805632,"data_stored":586633428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":774414336,"data_stored":805906053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-05-01T04:30:51.074 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-01T10:42:30.887 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:56.855 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2022-05-01T04:30:44.650869+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=44, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:30:56.856 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-05-01T04:29:49.588383+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=29, tm_sec=49, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:30:56.856 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2022-05-01T04:28:11.783670+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=28, tm_sec=11, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) 2022-05-01T10:42:30.888 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:31:37.605 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2022-05-01T04:29:39.348483+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=29, tm_sec=39, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:31:37.607 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2022-05-01T04:30:48.005729+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=48, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:31:37.607 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2022-05-01T04:30:43.097017+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=43, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) 2022-05-01T10:42:30.888 WARNING:scrape:Ignoring malparsed backtrace: raise CommandCrashedError(command=self.command) , teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --balance-reads --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' , 2022-05-01T04:32:18.690 INFO:teuthology.misc:Shutting down mds daemons... 2022-05-01T10:42:30.888 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:32:22.368 DEBUG:teuthology.orchestra.run.smithi061:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2022-05-01T04:32:22.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2022-05-01T04:32:51.327 INFO:tasks.ceph:Archiving logs... 2022-05-01T10:42:30.889 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:33:23.756 INFO:teuthology.task.internal:Transferring binaries for coredumps... , 2022-05-01T04:33:23.798 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/rfriedma-2022-04-30_17:51:41-rados:thrash-wip-rf-80cls-v1-distro-basic-smithi/6816343/remote/smithi061/coredump/1651379397.97363.core.gz: gzip compressed data, was "1651379397.97363.core", last modified: Sun May 1 04:33:05 2022, max compression , 2022-05-01T10:42:31.105 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-11854-g7e2ba75f (7e2ba75f07d12b6d8e925d4291e3d3c5168d80cb) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f59310de114] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f59310de335] 2022-05-01T10:42:31.106 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 165.34371991500001, , 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.79822107499999995, , 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:31.106 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", , 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:27:13.021813+0000", 2022-05-01T10:42:31.106 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "commit_sent", , 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:27:15.429554+0000", 2022-05-01T10:42:31.107 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:27:14.821435+0000", , 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 163.54397385499999, , 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.61002250300000005, 2022-05-01T10:42:31.107 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.463 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.463 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "dispatched", 2022-05-01T10:42:31.107 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting_for_map not empty", 2022-05-01T10:42:31.107 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.503 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.503 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:31.108 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", 2022-05-01T10:42:31.108 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.108 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.569 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.569 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for degraded object", 2022-05-01T10:42:31.108 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:31.108 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.109 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.601 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.602 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for subops from 6,7", 2022-05-01T10:42:31.109 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.109 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "description": "osd_op(client.4455.0:7064 3.5 3:a09ddd8e:::smithi06197363-888:head [write 1929332~491206] snapc c8=[c8,c6,c5,c4,c3,c1,be,b5,b4,b0,ac,a8,a2] ondisk+write+known_if_redirected+supports_pool_eio e244)", , 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:29:27.804769+0000", , 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 30.560639985999998, 2022-05-01T10:42:31.109 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.110 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 5.7226999999999999e-05 , 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.110 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5339809390000001, , 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { , 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2022-05-01T10:42:31.110 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", , 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 140 , 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2022-05-01T10:42:31.110 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", , 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.254057+0000", , 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9273000000000002e-05 2022-05-01T10:42:31.111 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.889696+0000", , 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.63557935899999995 2022-05-01T10:42:31.111 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:36.308535+0000", , 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.143439328 2022-05-01T10:42:31.111 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:36.532607+0000", , 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.22404791199999999 2022-05-01T10:42:31.111 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 256.59385050200001, , 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.451711459, , 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2022-05-01T10:42:31.112 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.273 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.274 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", , 2022-05-01T04:29:59.274 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 2885 2022-05-01T10:42:31.112 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", , 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.150976+0000", 2022-05-01T10:42:31.112 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.823546+0000", 2022-05-01T10:42:31.112 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.924465+0000", 2022-05-01T10:42:31.113 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.320 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:50.640007+0000", 2022-05-01T10:42:31.113 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:50.640570+0000", 2022-05-01T10:42:31.113 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.101230+0000", 2022-05-01T10:42:31.113 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.113 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2022-05-01T10:42:31.114 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for degraded object", 2022-05-01T10:42:31.114 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.778 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, , 2022-05-01T04:29:59.778 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ , 2022-05-01T04:29:59.779 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.114 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.788 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.789 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", , 2022-05-01T04:29:59.789 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.258436+0000", 2022-05-01T10:42:31.114 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.259144+0000", 2022-05-01T10:42:31.115 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", , 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.259193+0000", 2022-05-01T10:42:31.115 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.331931+0000", 2022-05-01T10:42:31.115 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.847377+0000", 2022-05-01T10:42:31.115 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2,3", , 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:52.042695+0000", 2022-05-01T10:42:31.116 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.849 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:29:59.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:52.457260+0000", 2022-05-01T10:42:31.116 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2022-05-01T04:25:49.424986+0000", , 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 250.35124122400001, , 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6264513410000001, 2022-05-01T10:42:31.116 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.116 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ , 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2022-05-01T10:42:31.116 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2022-05-01T10:42:31.117 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2022-05-01T10:42:31.117 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2022-05-01T10:42:31.117 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2022-05-01T10:42:31.117 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.982 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 6,7", 2022-05-01T10:42:31.118 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2022-05-01T10:42:31.118 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:31.118 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.015 INFO:teuthology.orchestra.run.smithi136.stdout: } , 2022-05-01T04:30:00.016 INFO:teuthology.orchestra.run.smithi136.stdout: ] , 2022-05-01T04:30:00.016 INFO:teuthology.orchestra.run.smithi136.stdout: } 2022-05-01T10:42:31.118 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.422013+0000", , 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.40178407399999999 2022-05-01T10:42:31.119 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.448 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 272.10812970900002, , 2022-05-01T04:30:00.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1152526899999999, , 2022-05-01T04:30:00.449 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2022-05-01T10:42:31.119 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.307854+0000", 2022-05-01T10:42:31.119 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.475 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.476 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", , 2022-05-01T04:30:00.476 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.307960+0000", 2022-05-01T10:42:31.119 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.523043+0000", 2022-05-01T10:42:31.120 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.928874+0000", 2022-05-01T10:42:31.120 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.120 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2022-05-01T10:42:31.120 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.532 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.532 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 1,4", 2022-05-01T10:42:31.121 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2022-05-01T10:42:31.121 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:31.121 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: } , 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: ] , 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: } 2022-05-01T10:42:31.121 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4455.0:1778 3.a 3:53a403a1:::smithi06197363-398:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e24)", , 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2022-05-01T04:25:36.695333+0000", , 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 263.72001420200002, 2022-05-01T10:42:31.122 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 , 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.122 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.99999 , 2022-05-01T04:30:00.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.122 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.101112457 , 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.122 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7070999999999997e-05 , 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.122 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.821119+0000", , 2022-05-01T04:30:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6906e-05 2022-05-01T10:42:31.123 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:42.446962+0000", , 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.52507275200000003 2022-05-01T10:42:31.123 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:42.450351+0000", , 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9092999999999996e-05 2022-05-01T10:42:31.123 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.561503+0000", , 2022-05-01T04:30:01.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0105489990000001 2022-05-01T10:42:31.123 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", , 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.866227+0000", , 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000105265 2022-05-01T10:42:31.124 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:30:01.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.866671+0000", , 2022-05-01T04:30:01.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1624000000000005e-05 2022-05-01T10:42:31.124 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", , 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.582716+0000", 2022-05-01T10:42:31.124 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.197 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.198 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:30:01.198 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.582989+0000", 2022-05-01T10:42:31.124 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", , 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.583036+0000", 2022-05-01T10:42:31.125 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.459659+0000", 2022-05-01T10:42:31.125 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.459820+0000", 2022-05-01T10:42:31.125 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.869578+0000", 2022-05-01T10:42:31.125 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.870154+0000", 2022-05-01T10:42:31.126 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:44.477163+0000", 2022-05-01T10:42:31.126 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", , 2022-05-01T04:30:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:44.576950+0000", 2022-05-01T10:42:31.126 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:30:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:30:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.126 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ , 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2022-05-01T10:42:31.127 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2022-05-01T10:42:31.127 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 1.8369999999999999e-05 , 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.127 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.100218394 , 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.127 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.786 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:52.881169+0000", , 2022-05-01T04:30:01.787 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 1.9573e-05 , 2022-05-01T04:30:01.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-05-01T10:42:31.128 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "throttled", , 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:57.746561+0000", , 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 2022-05-01T10:42:31.128 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 3.7012903449999999, , 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.2022516, , 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:31.128 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", , 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:58.569471+0000", 2022-05-01T10:42:31.128 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:31.129 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.00045464499999999999 , 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.129 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:59.998668+0000", , 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-05-01T10:42:31.129 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.10288931900000001, , 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { , 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "flag_point": "started", 2022-05-01T10:42:31.129 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", , 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:30:00.993658+0000", , 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.0014074020000000001 2022-05-01T10:42:31.130 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:30:01.503016+0000", 2022-05-01T10:42:31.130 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.402 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 30.478786020000001, , 2022-05-01T04:30:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.41085582700000001, , 2022-05-01T04:30:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:31.130 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "dispatched", , 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:31.918835+0000", 2022-05-01T10:42:31.130 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", , 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:32.019048+0000", 2022-05-01T10:42:31.131 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for blocked object", , 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:32.368585+0000", 2022-05-01T10:42:31.131 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "op_commit", , 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.083575+0000", 2022-05-01T10:42:31.131 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.192148+0000", 2022-05-01T10:42:31.131 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.491318+0000", 2022-05-01T10:42:31.132 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: "events": [ , 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "initiated", 2022-05-01T10:42:31.132 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client_info": { , 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client": "client.4455", , 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.132 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:29:42.789238+0000", , 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 19.608178676000001, , 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.40311962699999998, 2022-05-01T10:42:31.132 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "header_read", 2022-05-01T10:42:31.133 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "throttled", 2022-05-01T10:42:31.133 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "header_read", 2022-05-01T10:42:31.133 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.598 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.598 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "all_read", 2022-05-01T10:42:31.133 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.134 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:31.134 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", 2022-05-01T10:42:31.134 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:30:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.134 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:13.025 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 , reweighted osd.7 to 1 (10000) , 2022-05-01T04:30:14.038 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2022-05-01T10:42:31.142 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:23.813 INFO:teuthology.orchestra.run.smithi061.stdout: , dumped all , 2022-05-01T04:30:23.825 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2022-05-01T04:30:23.278784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3095203105,"num_objects":1168,"num_object_clones":201,"num_object_copies":3504,"num_objects_missing_on_primary":82,"num_objects_missing":82,"num_objects_degraded":133,"num_objects_misplaced":309,"num_objects_unfound":0,"num_objects_dirty":1168,"num_whiteouts":30,"num_read":3828,"num_read_kb":1765564,"num_write":7625,"num_write_kb":2038597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3548,"num_bytes_recovered":3906462674,"num_keys_recovered":1880,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12998,"ondisk_log_size":12998,"up":105,"acting":103,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5618844,"kb_used_data":5318748,"kb_used_omap":655,"kb_used_meta":299376,"kb_avail":749355876,"statfs":{"total":773094113280,"available":767340417024,"internally_reserved":0,"allocated":5446397952,"data_stored":5679194944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":671085,"internal_metadata":306561683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-74,"num_objects_missing":-74,"num_objects_degraded":-142,"num_objects_misplaced":-72,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-39,"num_bytes_recovered":-47056945,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225277"},"pg_stats":[{"pgid":"3.19","version":"272'501","reported_seq":1324,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177697+0000","last_change":"2022-05-01T04:30:11.500632+0000","last_active":"2022-05-01T04:30:19.177697+0000","last_peered":"2022-05-01T04:30:19.177697+0000","last_clean":"2022-05-01T04:30:19.177697+0000","last_became_active":"2022-05-01T04:30:11.294414+0000","last_became_peered":"2022-05-01T04:30:11.294414+0000","last_unstale":"2022-05-01T04:30:19.177697+0000","last_undegraded":"2022-05-01T04:30:19.177697+0000","last_fullsized":"2022-05-01T04:30:19.177697+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":5,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":501,"ondisk_log_size":501,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.205175364,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":114,"num_read_kb":82076,"num_write":204,"num_write_kb":57354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":40234521,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.18","version":"273'465","reported_seq":2334,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277719+0000","last_change":"2022-05-01T04:30:15.339106+0000","last_active":"2022-05-01T04:30:19.277719+0000","last_peered":"2022-05-01T04:30:19.277719+0000","last_clean":"2022-05-01T04:30:19.277719+0000","last_became_active":"2022-05-01T04:30:15.336684+0000","last_became_peered":"2022-05-01T04:30:15.336684+0000","last_unstale":"2022-05-01T04:30:19.277719+0000","last_undegraded":"2022-05-01T04:30:19.277719+0000","last_fullsized":"2022-05-01T04:30:19.277719+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":5,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.001352624,"stat_sum":{"num_bytes":96164905,"num_objects":40,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":2,"num_read":116,"num_read_kb":48609,"num_write":277,"num_write_kb":64535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":249,"num_bytes_recovered":275012362,"num_keys_recovered":150,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.17","version":"273'533","reported_seq":1864,"reported_epoch":295,"state":"active+recovery_wait+degraded","last_fresh":"2022-05-01T04:30:19.057547+0000","last_change":"2022-05-01T04:30:07.304715+0000","last_active":"2022-05-01T04:30:19.057547+0000","last_peered":"2022-05-01T04:30:19.057547+0000","last_clean":"2022-05-01T04:29:49.419159+0000","last_became_active":"2022-05-01T04:30:07.303342+0000","last_became_peered":"2022-05-01T04:30:07.303342+0000","last_unstale":"2022-05-01T04:30:19.057547+0000","last_undegraded":"2022-05-01T04:30:06.968327+0000","last_fullsized":"2022-05-01T04:30:19.057547+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":533,"ondisk_log_size":533,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":12,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":90,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":145444603,"num_keys_recovered":30,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":["0","4","7"],"object_location_counts":[{"shards":"0,3,4,7","objects":18},{"shards":"0,3,5","objects":-1},{"shards":"0,4,7","objects":26},{"shards":"0,7","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"1"}]},{"pgid":"3.16","version":"275'571","reported_seq":1900,"reported_epoch":296,"state":"peering","last_fresh":"2022-05-01T04:30:20.074891+0000","last_change":"2022-05-01T04:30:20.075228+0000","last_active":"2022-05-01T04:29:59.794431+0000","last_peered":"2022-05-01T04:29:59.192384+0000","last_clean":"2022-05-01T04:29:59.192384+0000","last_became_active":"2022-05-01T04:29:59.190893+0000","last_became_peered":"2022-05-01T04:29:59.190893+0000","last_unstale":"2022-05-01T04:30:20.074891+0000","last_undegraded":"2022-05-01T04:30:20.074891+0000","last_fullsized":"2022-05-01T04:30:20.074891+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":5,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":571,"ondisk_log_size":571,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.00047920800000000001,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":113,"num_read_kb":54635,"num_write":201,"num_write_kb":69191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967346,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1,3,4,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.15","version":"261'465","reported_seq":1966,"reported_epoch":296,"state":"active+recovering","last_fresh":"2022-05-01T04:30:20.587146+0000","last_change":"2022-05-01T04:30:19.922879+0000","last_active":"2022-05-01T04:30:20.587146+0000","last_peered":"2022-05-01T04:30:20.587146+0000","last_clean":"2022-05-01T04:29:44.969856+0000","last_became_active":"2022-05-01T04:30:17.351913+0000","last_became_peered":"2022-05-01T04:30:17.351913+0000","last_unstale":"2022-05-01T04:30:20.587146+0000","last_undegraded":"2022-05-01T04:30:20.587146+0000","last_fullsized":"2022-05-01T04:30:20.587146+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":33,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79997673,"num_objects":32,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":60,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":1,"num_read":104,"num_read_kb":29450,"num_write":244,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":208364605,"num_keys_recovered":150,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":["7","2","6"],"object_location_counts":[{"shards":"2,6,7","objects":30},{"shards":"3,4,7","objects":2}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"264'361","reported_seq":1626,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155646+0000","last_change":"2022-05-01T04:30:13.108744+0000","last_active":"2022-05-01T04:30:19.155646+0000","last_peered":"2022-05-01T04:30:19.155646+0000","last_clean":"2022-05-01T04:30:19.155646+0000","last_became_active":"2022-05-01T04:30:13.107986+0000","last_became_peered":"2022-05-01T04:30:13.107986+0000","last_unstale":"2022-05-01T04:30:19.155646+0000","last_undegraded":"2022-05-01T04:30:19.155646+0000","last_fullsized":"2022-05-01T04:30:19.155646+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":5,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83569378,"num_objects":30,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":179,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":132378397,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.13","version":"296'566","reported_seq":1353,"reported_epoch":296,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:20.480444+0000","last_change":"2022-05-01T04:30:20.287148+0000","last_active":"2022-05-01T04:30:20.480444+0000","last_peered":"2022-05-01T04:30:20.480444+0000","last_clean":"2022-05-01T04:30:20.480444+0000","last_became_active":"2022-05-01T04:30:20.285780+0000","last_became_peered":"2022-05-01T04:30:20.285780+0000","last_unstale":"2022-05-01T04:30:20.480444+0000","last_undegraded":"2022-05-01T04:30:20.480444+0000","last_fullsized":"2022-05-01T04:30:20.480444+0000","mapping_epoch":295,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":296,"parent":"0.0","parent_split_bits":5,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":10,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102081758,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":128,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":56033723,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"2"}]},{"pgid":"3.12","version":"273'535","reported_seq":1795,"reported_epoch":296,"state":"active+recovering+degraded","last_fresh":"2022-05-01T04:30:20.481519+0000","last_change":"2022-05-01T04:30:20.378621+0000","last_active":"2022-05-01T04:30:20.481519+0000","last_peered":"2022-05-01T04:30:20.481519+0000","last_clean":"2022-05-01T04:29:46.967195+0000","last_became_active":"2022-05-01T04:30:07.095952+0000","last_became_peered":"2022-05-01T04:30:07.095952+0000","last_unstale":"2022-05-01T04:30:20.481519+0000","last_undegraded":"2022-05-01T04:30:20.304415+0000","last_fullsized":"2022-05-01T04:30:20.481519+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":230,"parent":"0.0","parent_split_bits":5,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":30,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":8,"num_object_copies":129,"num_objects_missing_on_primary":30,"num_objects_missing":30,"num_objects_degraded":0,"num_objects_misplaced":63,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":2,"num_read":142,"num_read_kb":77693,"num_write":291,"num_write_kb":74977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":130444559,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":["1","4","6"],"object_location_counts":[{"shards":"0,1,4,6","objects":1},{"shards":"0,1,4,6,7","objects":1},{"shards":"0,3,7","objects":21},{"shards":"1,4,6","objects":20}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"}]},{"pgid":"3.11","version":"294'459","reported_seq":1935,"reported_epoch":295,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:19.155957+0000","last_change":"2022-05-01T04:30:16.442516+0000","last_active":"2022-05-01T04:30:19.155957+0000","last_peered":"2022-05-01T04:30:19.155957+0000","last_clean":"2022-05-01T04:30:19.155957+0000","last_became_active":"2022-05-01T04:30:16.337078+0000","last_became_peered":"2022-05-01T04:30:16.337078+0000","last_unstale":"2022-05-01T04:30:19.155957+0000","last_undegraded":"2022-05-01T04:30:19.155957+0000","last_fullsized":"2022-05-01T04:30:19.155957+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":459,"ondisk_log_size":459,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":17,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.0044887349999999998,"stat_sum":{"num_bytes":95657072,"num_objects":39,"num_object_clones":8,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":121,"num_read_kb":76398,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":183552292,"num_keys_recovered":160,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"3"}]},{"pgid":"3.10","version":"273'490","reported_seq":1683,"reported_epoch":296,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2022-05-01T04:30:20.474618+0000","last_change":"2022-05-01T04:30:20.224873+0000","last_active":"2022-05-01T04:30:20.474618+0000","last_peered":"2022-05-01T04:30:20.474618+0000","last_clean":"2022-05-01T04:29:56.885986+0000","last_became_active":"2022-05-01T04:30:02.988629+0000","last_became_peered":"2022-05-01T04:30:02.988629+0000","last_unstale":"2022-05-01T04:30:20.474618+0000","last_undegraded":"2022-05-01T04:30:20.165835+0000","last_fullsized":"2022-05-01T04:30:02.785753+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":5,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93110779,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":21,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":104,"num_read_kb":46934,"num_write":216,"num_write_kb":63007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":114601618,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0],"avail_no_missing":["6","1","2"],"object_location_counts":[{"shards":"0,6","objects":26},{"shards":"1,2,5,6","objects":1},{"shards":"1,2,6","objects":10}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.f","version":"277'540","reported_seq":1300,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.256155+0000","last_change":"2022-05-01T04:30:16.500449+0000","last_active":"2022-05-01T04:30:19.256155+0000","last_peered":"2022-05-01T04:30:19.256155+0000","last_clean":"2022-05-01T04:30:19.256155+0000","last_became_active":"2022-05-01T04:30:16.399454+0000","last_became_peered":"2022-05-01T04:30:16.399454+0000","last_unstale":"2022-05-01T04:30:19.256155+0000","last_undegraded":"2022-05-01T04:30:19.256155+0000","last_fullsized":"2022-05-01T04:30:19.256155+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'412","last_scrub_stamp":"2022-05-01T04:28:16.288822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:16.288822+0000","objects_scrubbed":63,"log_size":540,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81907881800000004,"objects_trimmed":0,"snaptrim_duration":0.72566574800000005,"stat_sum":{"num_bytes":198947307,"num_objects":70,"num_object_clones":8,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":2,"num_read":226,"num_read_kb":100373,"num_write":447,"num_write_kb":118211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":2944186,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.e","version":"276'657","reported_seq":1954,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.156852+0000","last_change":"2022-05-01T04:30:02.666116+0000","last_active":"2022-05-01T04:30:19.156852+0000","last_peered":"2022-05-01T04:30:19.156852+0000","last_clean":"2022-05-01T04:30:19.156852+0000","last_became_active":"2022-05-01T04:29:15.968177+0000","last_became_peered":"2022-05-01T04:29:15.968177+0000","last_unstale":"2022-05-01T04:30:19.156852+0000","last_undegraded":"2022-05-01T04:30:19.156852+0000","last_fullsized":"2022-05-01T04:30:19.156852+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'588","last_scrub_stamp":"2022-05-01T04:29:37.821007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.821007+0000","objects_scrubbed":80,"log_size":657,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:41.870002+0000","scrub_duration":0.62661968000000001,"objects_trimmed":0,"snaptrim_duration":0.88139935800000002,"stat_sum":{"num_bytes":238859551,"num_objects":88,"num_object_clones":14,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":2,"num_read":259,"num_read_kb":84476,"num_write":573,"num_write_kb":169626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":228132670,"num_keys_recovered":80,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.d","version":"273'434","reported_seq":1401,"reported_epoch":295,"state":"active+recovery_wait+degraded","last_fresh":"2022-05-01T04:30:19.156101+0000","last_change":"2022-05-01T04:30:17.631154+0000","last_active":"2022-05-01T04:30:19.156101+0000","last_peered":"2022-05-01T04:30:19.156101+0000","last_clean":"2022-05-01T04:29:49.001379+0000","last_became_active":"2022-05-01T04:30:17.429652+0000","last_became_peered":"2022-05-01T04:30:17.429652+0000","last_unstale":"2022-05-01T04:30:19.156101+0000","last_undegraded":"2022-05-01T04:30:17.148995+0000","last_fullsized":"2022-05-01T04:30:19.156101+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'315","last_scrub_stamp":"2022-05-01T04:28:14.235007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:14.235007+0000","objects_scrubbed":59,"log_size":434,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.154700571,"objects_trimmed":0,"snaptrim_duration":0.40905342099999997,"stat_sum":{"num_bytes":173196488,"num_objects":65,"num_object_clones":11,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":43,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":1,"num_read":184,"num_read_kb":90112,"num_write":428,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":78443415,"num_keys_recovered":60,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":["7","4","6"],"object_location_counts":[{"shards":"4,6,7","objects":26},{"shards":"5,6,7","objects":36},{"shards":"6,7","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"}]},{"pgid":"3.c","version":"265'484","reported_seq":2106,"reported_epoch":296,"state":"active+recovering+remapped","last_fresh":"2022-05-01T04:30:20.384354+0000","last_change":"2022-05-01T04:30:19.827029+0000","last_active":"2022-05-01T04:30:20.384354+0000","last_peered":"2022-05-01T04:30:20.384354+0000","last_clean":"2022-05-01T04:29:48.965884+0000","last_became_active":"2022-05-01T04:30:03.989010+0000","last_became_peered":"2022-05-01T04:30:03.989010+0000","last_unstale":"2022-05-01T04:30:20.384354+0000","last_undegraded":"2022-05-01T04:30:20.384354+0000","last_fullsized":"2022-05-01T04:30:20.384354+0000","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"249'466","last_scrub_stamp":"2022-05-01T04:29:36.465699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.465699+0000","objects_scrubbed":62,"log_size":484,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:52.684317+0000","scrub_duration":0.81548162000000002,"objects_trimmed":1,"snaptrim_duration":0.72789094899999995,"stat_sum":{"num_bytes":167437493,"num_objects":63,"num_object_clones":7,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":91,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":2,"num_read":271,"num_read_kb":161213,"num_write":425,"num_write_kb":112139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":374094922,"num_keys_recovered":40,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[0,3,6],"avail_no_missing":["0","1","6"],"object_location_counts":[{"shards":"0,1,3,6","objects":27},{"shards":"0,1,6","objects":32},{"shards":"0,3,6","objects":4}],"blocked_by":[],"up_primary":5,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.b","version":"261'397","reported_seq":1739,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277855+0000","last_change":"2022-05-01T04:30:07.810362+0000","last_active":"2022-05-01T04:30:19.277855+0000","last_peered":"2022-05-01T04:30:19.277855+0000","last_clean":"2022-05-01T04:30:19.277855+0000","last_became_active":"2022-05-01T04:30:07.195503+0000","last_became_peered":"2022-05-01T04:30:07.195503+0000","last_unstale":"2022-05-01T04:30:19.277855+0000","last_undegraded":"2022-05-01T04:30:19.277855+0000","last_fullsized":"2022-05-01T04:30:19.277855+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"248'389","last_scrub_stamp":"2022-05-01T04:29:39.348483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.348483+0000","objects_scrubbed":68,"log_size":397,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:42.553069+0000","scrub_duration":1.05234216,"objects_trimmed":0,"snaptrim_duration":0.61416249099999998,"stat_sum":{"num_bytes":179141560,"num_objects":68,"num_object_clones":8,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":206,"num_read_kb":69949,"num_write":398,"num_write_kb":107432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":339541664,"num_keys_recovered":220,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.a","version":"272'477","reported_seq":1738,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.238444+0000","last_change":"2022-05-01T04:29:58.990005+0000","last_active":"2022-05-01T04:30:19.238444+0000","last_peered":"2022-05-01T04:30:19.238444+0000","last_clean":"2022-05-01T04:30:19.238444+0000","last_became_active":"2022-05-01T04:29:08.175363+0000","last_became_peered":"2022-05-01T04:29:08.175363+0000","last_unstale":"2022-05-01T04:30:19.238444+0000","last_undegraded":"2022-05-01T04:30:19.238444+0000","last_fullsized":"2022-05-01T04:30:19.238444+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"247'454","last_scrub_stamp":"2022-05-01T04:29:39.093953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.093953+0000","objects_scrubbed":70,"log_size":477,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:46.460212+0000","scrub_duration":1.3648651510000001,"objects_trimmed":0,"snaptrim_duration":0.15573891400000001,"stat_sum":{"num_bytes":197706553,"num_objects":71,"num_object_clones":8,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":2,"num_read":262,"num_read_kb":159904,"num_write":471,"num_write_kb":128600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":193253880,"num_keys_recovered":160,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.9","version":"276'505","reported_seq":1339,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.255437+0000","last_change":"2022-05-01T04:30:02.707698+0000","last_active":"2022-05-01T04:30:19.255437+0000","last_peered":"2022-05-01T04:30:19.255437+0000","last_clean":"2022-05-01T04:30:19.255437+0000","last_became_active":"2022-05-01T04:29:59.090857+0000","last_became_peered":"2022-05-01T04:29:59.090857+0000","last_unstale":"2022-05-01T04:30:19.255437+0000","last_undegraded":"2022-05-01T04:30:19.255437+0000","last_fullsized":"2022-05-01T04:30:19.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":505,"ondisk_log_size":505,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.71138417200000004,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":113,"num_read_kb":82075,"num_write":204,"num_write_kb":57353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.8","version":"273'465","reported_seq":2265,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277718+0000","last_change":"2022-05-01T04:30:08.055718+0000","last_active":"2022-05-01T04:30:19.277718+0000","last_peered":"2022-05-01T04:30:19.277718+0000","last_clean":"2022-05-01T04:30:19.277718+0000","last_became_active":"2022-05-01T04:30:00.189790+0000","last_became_peered":"2022-05-01T04:30:00.189790+0000","last_unstale":"2022-05-01T04:30:19.277718+0000","last_undegraded":"2022-05-01T04:30:19.277718+0000","last_fullsized":"2022-05-01T04:30:19.277718+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.101109292,"stat_sum":{"num_bytes":96164905,"num_objects":39,"num_object_clones":10,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":116,"num_read_kb":48609,"num_write":276,"num_write_kb":64534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":252683112,"num_keys_recovered":230,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177759+0000","last_change":"2022-05-01T04:29:49.104235+0000","last_active":"2022-05-01T04:30:19.177759+0000","last_peered":"2022-05-01T04:30:19.177759+0000","last_clean":"2022-05-01T04:30:19.177759+0000","last_became_active":"2022-05-01T04:28:42.075951+0000","last_became_peered":"2022-05-01T04:28:42.075951+0000","last_unstale":"2022-05-01T04:30:19.177759+0000","last_undegraded":"2022-05-01T04:30:19.177759+0000","last_fullsized":"2022-05-01T04:30:19.177759+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:00.204819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:00.204819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'465","reported_seq":1972,"reported_epoch":296,"state":"peering","last_fresh":"2022-05-01T04:30:20.075325+0000","last_change":"2022-05-01T04:30:20.075325+0000","last_active":"2022-05-01T04:29:57.787070+0000","last_peered":"2022-05-01T04:29:57.436823+0000","last_clean":"2022-05-01T04:29:48.904733+0000","last_became_active":"2022-05-01T04:29:52.471792+0000","last_became_peered":"2022-05-01T04:29:52.471792+0000","last_unstale":"2022-05-01T04:30:20.075325+0000","last_undegraded":"2022-05-01T04:30:20.075325+0000","last_fullsized":"2022-05-01T04:30:20.075325+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0.407825406,"stat_sum":{"num_bytes":79997672,"num_objects":31,"num_object_clones":5,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":103,"num_read_kb":29450,"num_write":243,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":203448551,"num_keys_recovered":150,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.238636+0000","last_change":"2022-05-01T04:30:02.996712+0000","last_active":"2022-05-01T04:30:19.238636+0000","last_peered":"2022-05-01T04:30:19.238636+0000","last_clean":"2022-05-01T04:30:19.238636+0000","last_became_active":"2022-05-01T04:30:02.896021+0000","last_became_peered":"2022-05-01T04:30:02.896021+0000","last_unstale":"2022-05-01T04:30:19.238636+0000","last_undegraded":"2022-05-01T04:30:19.238636+0000","last_fullsized":"2022-05-01T04:30:19.238636+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:52.422661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:52.422661+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:05.375337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"275'566","reported_seq":1415,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155577+0000","last_change":"2022-05-01T04:30:02.778149+0000","last_active":"2022-05-01T04:30:19.155577+0000","last_peered":"2022-05-01T04:30:19.155577+0000","last_clean":"2022-05-01T04:30:19.155577+0000","last_became_active":"2022-05-01T04:29:59.089639+0000","last_became_peered":"2022-05-01T04:29:59.089639+0000","last_unstale":"2022-05-01T04:30:19.155577+0000","last_undegraded":"2022-05-01T04:30:19.155577+0000","last_fullsized":"2022-05-01T04:30:19.155577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0.89342225399999997,"stat_sum":{"num_bytes":102081757,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":127,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":386,"reported_epoch":294,"state":"active+clean","last_fresh":"2022-05-01T04:30:17.986898+0000","last_change":"2022-05-01T04:29:51.118516+0000","last_active":"2022-05-01T04:30:17.986898+0000","last_peered":"2022-05-01T04:30:17.986898+0000","last_clean":"2022-05-01T04:30:17.986898+0000","last_became_active":"2022-05-01T04:29:51.118117+0000","last_became_peered":"2022-05-01T04:29:51.118117+0000","last_unstale":"2022-05-01T04:30:17.986898+0000","last_undegraded":"2022-05-01T04:30:17.986898+0000","last_fullsized":"2022-05-01T04:30:17.986898+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:40.698524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:40.698524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:45.889971+0000","scrub_duration":0.50325435799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"273'490","reported_seq":1597,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177829+0000","last_change":"2022-05-01T04:29:58.989879+0000","last_active":"2022-05-01T04:30:19.177829+0000","last_peered":"2022-05-01T04:30:19.177829+0000","last_clean":"2022-05-01T04:30:19.177829+0000","last_became_active":"2022-05-01T04:29:58.888029+0000","last_became_peered":"2022-05-01T04:29:58.888029+0000","last_unstale":"2022-05-01T04:30:19.177829+0000","last_undegraded":"2022-05-01T04:30:19.177829+0000","last_fullsized":"2022-05-01T04:30:19.177829+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0.00046417000000000002,"stat_sum":{"num_bytes":93110778,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":103,"num_read_kb":46934,"num_write":215,"num_write_kb":63006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":83574846,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.183000+0000","last_change":"2022-05-01T04:30:02.982397+0000","last_active":"2022-05-01T04:30:19.183000+0000","last_peered":"2022-05-01T04:30:19.183000+0000","last_clean":"2022-05-01T04:30:19.183000+0000","last_became_active":"2022-05-01T04:30:02.982092+0000","last_became_peered":"2022-05-01T04:30:02.982092+0000","last_unstale":"2022-05-01T04:30:19.183000+0000","last_undegraded":"2022-05-01T04:30:19.183000+0000","last_fullsized":"2022-05-01T04:30:19.183000+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:24.617265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:24.617265+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.402921694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'117","reported_seq":258,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155690+0000","last_change":"2022-05-01T04:30:16.239307+0000","last_active":"2022-05-01T04:30:19.155690+0000","last_peered":"2022-05-01T04:30:19.155690+0000","last_clean":"2022-05-01T04:30:19.155690+0000","last_became_active":"2022-05-01T04:30:16.238972+0000","last_became_peered":"2022-05-01T04:30:16.238972+0000","last_unstale":"2022-05-01T04:30:19.155690+0000","last_undegraded":"2022-05-01T04:30:19.155690+0000","last_fullsized":"2022-05-01T04:30:19.155690+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2022-05-01T04:28:00.739540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:15.316890+0000","last_clean_scrub_stamp":"2022-05-01T04:28:00.739540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"273'535","reported_seq":1734,"reported_epoch":296,"state":"active+recovering+undersized+remapped","last_fresh":"2022-05-01T04:30:20.123730+0000","last_change":"2022-05-01T04:30:20.328949+0000","last_active":"2022-05-01T04:30:20.123730+0000","last_peered":"2022-05-01T04:30:20.123730+0000","last_clean":"2022-05-01T04:29:46.967195+0000","last_became_active":"2022-05-01T04:30:03.895066+0000","last_became_peered":"2022-05-01T04:30:03.895066+0000","last_unstale":"2022-05-01T04:30:20.123730+0000","last_undegraded":"2022-05-01T04:30:03.791995+0000","last_fullsized":"2022-05-01T04:30:03.788182+0000","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":230,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":30,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0.40853271600000002,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":7,"num_object_copies":129,"num_objects_missing_on_primary":52,"num_objects_missing":52,"num_objects_degraded":0,"num_objects_misplaced":74,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":1,"num_read":140,"num_read_kb":72872,"num_write":290,"num_write_kb":74976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":109105320,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,6],"avail_no_missing":["1","4","6"],"object_location_counts":[{"shards":"1,3,4,6","objects":8},{"shards":"1,4,6","objects":33},{"shards":"3,6","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.255829+0000","last_change":"2022-05-01T04:30:16.267571+0000","last_active":"2022-05-01T04:30:19.255829+0000","last_peered":"2022-05-01T04:30:19.255829+0000","last_clean":"2022-05-01T04:30:19.255829+0000","last_became_active":"2022-05-01T04:30:16.267154+0000","last_became_peered":"2022-05-01T04:30:16.267154+0000","last_unstale":"2022-05-01T04:30:19.255829+0000","last_undegraded":"2022-05-01T04:30:19.255829+0000","last_fullsized":"2022-05-01T04:30:19.255829+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:12.658835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:12.658835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.304165821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"294'453","reported_seq":1765,"reported_epoch":295,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:19.057308+0000","last_change":"2022-05-01T04:30:18.886977+0000","last_active":"2022-05-01T04:30:19.057308+0000","last_peered":"2022-05-01T04:30:19.057308+0000","last_clean":"2022-05-01T04:30:19.057308+0000","last_became_active":"2022-05-01T04:30:06.174043+0000","last_became_peered":"2022-05-01T04:30:06.174043+0000","last_unstale":"2022-05-01T04:30:19.057308+0000","last_undegraded":"2022-05-01T04:30:19.057308+0000","last_fullsized":"2022-05-01T04:30:19.057308+0000","mapping_epoch":281,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":453,"ondisk_log_size":453,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":24,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.76321735999999996,"stat_sum":{"num_bytes":95657071,"num_objects":38,"num_object_clones":8,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":120,"num_read_kb":76397,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":141204132,"num_keys_recovered":40,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":317,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155906+0000","last_change":"2022-05-01T04:29:49.588507+0000","last_active":"2022-05-01T04:30:19.155906+0000","last_peered":"2022-05-01T04:30:19.155906+0000","last_clean":"2022-05-01T04:30:19.155906+0000","last_became_active":"2022-05-01T04:25:17.351886+0000","last_became_peered":"2022-05-01T04:25:17.351886+0000","last_unstale":"2022-05-01T04:30:19.155906+0000","last_undegraded":"2022-05-01T04:30:19.155906+0000","last_fullsized":"2022-05-01T04:30:19.155906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:49.588383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.588383+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:54.942702+0000","scrub_duration":0.30376289400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'361","reported_seq":1781,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177815+0000","last_change":"2022-05-01T04:30:13.312203+0000","last_active":"2022-05-01T04:30:19.177815+0000","last_peered":"2022-05-01T04:30:19.177815+0000","last_clean":"2022-05-01T04:30:19.177815+0000","last_became_active":"2022-05-01T04:30:13.311320+0000","last_became_peered":"2022-05-01T04:30:13.311320+0000","last_unstale":"2022-05-01T04:30:19.177815+0000","last_undegraded":"2022-05-01T04:30:19.177815+0000","last_fullsized":"2022-05-01T04:30:19.177815+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0.00086617699999999998,"stat_sum":{"num_bytes":83569377,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":178,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":177664904,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.7","version":"273'533","reported_seq":1998,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.377978+0000","last_change":"2022-05-01T04:30:05.888096+0000","last_active":"2022-05-01T04:30:19.377978+0000","last_peered":"2022-05-01T04:30:19.377978+0000","last_clean":"2022-05-01T04:30:19.377978+0000","last_became_active":"2022-05-01T04:29:59.991809+0000","last_became_peered":"2022-05-01T04:29:59.991809+0000","last_unstale":"2022-05-01T04:30:19.377978+0000","last_undegraded":"2022-05-01T04:30:19.377978+0000","last_fullsized":"2022-05-01T04:30:19.377978+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":281,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":533,"ondisk_log_size":533,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0.40617742299999998,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":11,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":194369701,"num_keys_recovered":70,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.178048+0000","last_change":"2022-05-01T04:28:42.261677+0000","last_active":"2022-05-01T04:30:19.178048+0000","last_peered":"2022-05-01T04:30:19.178048+0000","last_clean":"2022-05-01T04:30:19.178048+0000","last_became_active":"2022-05-01T04:28:42.261299+0000","last_became_peered":"2022-05-01T04:28:42.261299+0000","last_unstale":"2022-05-01T04:30:19.178048+0000","last_undegraded":"2022-05-01T04:30:19.178048+0000","last_fullsized":"2022-05-01T04:30:19.178048+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:48.745287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.745287+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":375,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.150747+0000","last_change":"2022-05-01T04:29:05.171169+0000","last_active":"2022-05-01T04:30:19.150747+0000","last_peered":"2022-05-01T04:30:19.150747+0000","last_clean":"2022-05-01T04:30:19.150747+0000","last_became_active":"2022-05-01T04:29:05.170684+0000","last_became_peered":"2022-05-01T04:29:05.170684+0000","last_unstale":"2022-05-01T04:30:19.150747+0000","last_undegraded":"2022-05-01T04:30:19.150747+0000","last_fullsized":"2022-05-01T04:30:19.150747+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:47.562100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:47.562100+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.30425882100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"277'573","reported_seq":1925,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.157470+0000","last_change":"2022-05-01T04:30:03.710494+0000","last_active":"2022-05-01T04:30:19.157470+0000","last_peered":"2022-05-01T04:30:19.157470+0000","last_clean":"2022-05-01T04:30:19.157470+0000","last_became_active":"2022-05-01T04:29:58.986844+0000","last_became_peered":"2022-05-01T04:29:58.986844+0000","last_unstale":"2022-05-01T04:30:19.157470+0000","last_undegraded":"2022-05-01T04:30:19.157470+0000","last_fullsized":"2022-05-01T04:30:19.157470+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":573,"ondisk_log_size":573,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.91696671600000002,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":112,"num_read_kb":54635,"num_write":200,"num_write_kb":69190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967345,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":26,"stat_sum":{"num_bytes":3094612737,"num_objects":1166,"num_object_clones":201,"num_object_copies":3498,"num_objects_missing_on_primary":82,"num_objects_missing":82,"num_objects_degraded":133,"num_objects_misplaced":309,"num_objects_unfound":0,"num_objects_dirty":1166,"num_whiteouts":30,"num_read":3712,"num_read_kb":1765464,"num_write":7466,"num_write_kb":2036181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3548,"num_bytes_recovered":3906462674,"num_keys_recovered":1880,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5410938880,"data_stored":5655074692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":654892,"internal_metadata":0},"log_size":12881,"ondisk_log_size":12881,"up":78,"acting":76,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":2115712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":870964,"kb_used_data":833388,"kb_used_omap":0,"kb_used_meta":37568,"kb_avail":93500876,"statfs":{"total":96636764160,"available":95744897024,"internally_reserved":0,"allocated":853389312,"data_stored":896292243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":38469632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":12.237,"5min":37.633000000000003,"15min":61.872999999999998},"min":{"1min":0.51800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":72.403999999999996,"5min":518.15200000000004,"15min":518.15200000000004},"last":5.5860000000000003},{"interface":"front","average":{"1min":5.0730000000000004,"5min":5.4240000000000004,"15min":8.3490000000000002},"min":{"1min":0.53000000000000003,"5min":0.433,"15min":0.433},"max":{"1min":65.225999999999999,"5min":99.054000000000002,"15min":99.054000000000002},"last":3.1640000000000001}]},{"osd":1,"last update":"Sun May 1 04:29:37 2022","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.77200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86199999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":3.6469999999999998},{"interface":"front","average":{"1min":16.597999999999999,"5min":10.374000000000001,"15min":9.3369999999999997},"min":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":88.078000000000003,"5min":88.078000000000003,"15min":88.078000000000003},"last":3.7829999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":11.132,"5min":15.377000000000001,"15min":26.102},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":176.274,"5min":252.857,"15min":252.857},"last":0.58599999999999997},{"interface":"front","average":{"1min":11.837,"5min":26.882999999999999,"15min":47.584000000000003},"min":{"1min":0.70699999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":72.778000000000006,"5min":310.839,"15min":310.839},"last":3.7109999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":1.401,"15min":1.131},"min":{"1min":0.70899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":40.189999999999998,"5min":40.189999999999998,"15min":40.189999999999998},"last":5.2359999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1140000000000001,"15min":1.1499999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5600000000000001,"5min":3.585,"15min":3.585},"last":9.1560000000000006}]},{"osd":4,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":3.673,"15min":3.3029999999999999},"min":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.391,"5min":100.727,"15min":100.727},"last":0.55800000000000005},{"interface":"front","average":{"1min":7.3159999999999998,"5min":18.145,"15min":27.129999999999999},"min":{"1min":0.78400000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":108.63200000000001,"5min":252.94900000000001,"15min":252.94900000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":11.952,"5min":16.052,"15min":25.853999999999999},"min":{"1min":0.88700000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":72.542000000000002,"5min":301.91000000000003,"15min":301.91000000000003},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.095,"5min":6.4960000000000004,"15min":11.42},"min":{"1min":0.79800000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3720000000000001,"5min":159.309,"15min":159.309},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":6.5549999999999997,"5min":15.954000000000001,"15min":28.488},"min":{"1min":0.872,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":92.481999999999999,"5min":294.37,"15min":294.37},"last":0.77100000000000002},{"interface":"front","average":{"1min":6.5700000000000003,"5min":25.222000000000001,"15min":47.006},"min":{"1min":1.0089999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":92.453999999999994,"5min":294.82299999999998,"15min":294.82299999999998},"last":0.874}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":781112,"kb_used_data":744432,"kb_used_omap":0,"kb_used_meta":36672,"kb_avail":93590728,"statfs":{"total":96636764160,"available":95836905472,"internally_reserved":0,"allocated":762298368,"data_stored":793548305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37552128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":12.117000000000001,"5min":20.341999999999999,"15min":40.899000000000001},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":146.00800000000001,"5min":474.91300000000001,"15min":474.91300000000001},"last":1.147},{"interface":"front","average":{"1min":16.079999999999998,"5min":14.685,"15min":24.908999999999999},"min":{"1min":0.53400000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":146.03,"5min":296.67500000000001,"15min":296.67500000000001},"last":1.0580000000000001}]},{"osd":1,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":10.571,"5min":2.8530000000000002,"15min":1.5669999999999999},"min":{"1min":0.64600000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":100.899,"5min":100.899,"15min":100.899},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.702,"5min":2.8900000000000001,"15min":3.0880000000000001},"min":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":13.907,"5min":49.499000000000002,"15min":49.499000000000002},"last":1.405}]},{"osd":2,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":12.288,"15min":31.699000000000002},"min":{"1min":0.65600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":37.988999999999997,"5min":384.75700000000001,"15min":384.75700000000001},"last":3.6579999999999999},{"interface":"front","average":{"1min":4.9180000000000001,"5min":7.1749999999999998,"15min":16.774000000000001},"min":{"1min":0.66200000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":74.480999999999995,"5min":160.499,"15min":160.499},"last":1.6220000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:12 2022","interfaces":[{"interface":"back","average":{"1min":5.1210000000000004,"5min":6.2729999999999997,"15min":6.0990000000000002},"min":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":39.613999999999997,"5min":93.191999999999993,"15min":93.191999999999993},"last":88.484999999999999},{"interface":"front","average":{"1min":5.5700000000000003,"5min":2.5150000000000001,"15min":1.544},"min":{"1min":0.81699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":45.993000000000002,"5min":49.615000000000002,"15min":49.615000000000002},"last":8.5380000000000003}]},{"osd":4,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":9.2210000000000001,"15min":28.965},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.736,"5min":384.22199999999998,"15min":384.22199999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":17.77,"5min":14.365,"15min":32.424999999999997},"min":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":167.744,"5min":290.24200000000002,"15min":290.24200000000002},"last":0.94899999999999995}]},{"osd":5,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":9.2119999999999997,"15min":20.93},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":33.787999999999997,"5min":276.17000000000002,"15min":276.17000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":4.8029999999999999,"5min":13.064,"15min":40.137999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":69.587999999999994,"5min":384.64299999999997,"15min":384.64299999999997},"last":1.0149999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":8.8539999999999992,"5min":26.236999999999998,"15min":76.006},"min":{"1min":0.88500000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":74.135000000000005,"5min":670.42999999999995,"15min":670.42999999999995},"last":1.181},{"interface":"front","average":{"1min":2.778,"5min":4.8630000000000004,"15min":2.327},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":33.892000000000003,"5min":94.379999999999995,"15min":94.379999999999995},"last":0.97699999999999998}]}]},{"osd":1,"up_from":134,"seq":575525617699,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":817664,"kb_used_data":774520,"kb_used_omap":652,"kb_used_meta":42483,"kb_avail":93554176,"statfs":{"total":96636764160,"available":95799476224,"internally_reserved":0,"allocated":793108480,"data_stored":827588588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":668200,"internal_metadata":43503064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":13.711,"5min":10.115,"15min":9.5150000000000006},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":99.966999999999999,"5min":176.80000000000001,"15min":176.80000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":8.9359999999999999,"5min":9.1989999999999998,"15min":9.2430000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":79.738,"5min":176.886,"15min":176.886},"last":0.99099999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":8.2460000000000004,"5min":4.4459999999999997,"15min":3.8119999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":100.336,"5min":100.336,"15min":100.336},"last":0.89800000000000002},{"interface":"front","average":{"1min":3.2919999999999998,"5min":1.343,"15min":1.018},"min":{"1min":0.63900000000000001,"5min":0.625,"15min":0.625},"max":{"1min":34.151000000000003,"5min":34.151000000000003,"15min":34.151000000000003},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":8.3409999999999993,"5min":2.544,"15min":1.5780000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":100.11499999999999,"5min":100.11499999999999,"15min":100.11499999999999},"last":1.036},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.6559999999999999,"15min":1.3400000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":34.658000000000001,"5min":34.658000000000001,"15min":34.658000000000001},"last":1.133}]},{"osd":4,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":9.782,"5min":9.6500000000000004,"15min":9.6280000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":89.364000000000004,"5min":92.572000000000003,"15min":92.572000000000003},"last":90.158000000000001},{"interface":"front","average":{"1min":11.432,"5min":3.1389999999999998,"15min":1.7569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":58.978000000000002,"5min":58.978000000000002,"15min":58.978000000000002},"last":0.86699999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":1.736,"15min":1.4139999999999999},"min":{"1min":0.88900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":34.417999999999999,"5min":34.417999999999999,"15min":34.417999999999999},"last":1.282},{"interface":"front","average":{"1min":8.2729999999999997,"5min":2.5369999999999999,"15min":1.581},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":59.185000000000002,"5min":59.185000000000002,"15min":59.185000000000002},"last":0.97699999999999998}]},{"osd":6,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":13.271000000000001,"5min":3.7170000000000001,"15min":2.125},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":69.930999999999997,"5min":69.930999999999997,"15min":69.930999999999997},"last":1.052},{"interface":"front","average":{"1min":8.6340000000000003,"5min":2.8380000000000001,"15min":1.8720000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":100.20099999999999,"5min":100.20099999999999,"15min":100.20099999999999},"last":1.3200000000000001}]},{"osd":7,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":12.922000000000001,"5min":6.2359999999999998,"15min":5.1219999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":64.167000000000002,"5min":69.519000000000005,"15min":69.519000000000005},"last":1.167},{"interface":"front","average":{"1min":8.6799999999999997,"5min":2.9199999999999999,"15min":1.96},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":100.27,"5min":100.27,"15min":100.27},"last":1.2230000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":900552,"kb_used_data":861696,"kb_used_omap":0,"kb_used_meta":38848,"kb_avail":93471288,"statfs":{"total":96636764160,"available":95714598912,"internally_reserved":0,"allocated":882376704,"data_stored":926887646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39780352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 1 04:29:37 2022","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.625,"15min":5.0279999999999996},"min":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":25.649000000000001,"5min":94.671999999999997,"15min":94.671999999999997},"last":1.274},{"interface":"front","average":{"1min":15.130000000000001,"5min":4.6319999999999997,"15min":2.8820000000000001},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":218.80099999999999,"5min":218.80099999999999,"15min":218.80099999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":3.411,"5min":7.8899999999999997,"15min":11.317},"min":{"1min":0.58699999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":48.067,"5min":106.374,"15min":106.374},"last":1.228},{"interface":"front","average":{"1min":13.252000000000001,"5min":29.773,"15min":51.216000000000001},"min":{"1min":0.67400000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":95.516999999999996,"5min":497.91500000000002,"15min":497.91500000000002},"last":1.472}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":3.3580000000000001,"15min":2.4969999999999999},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.528,"5min":176.02699999999999,"15min":176.02699999999999},"last":1.827},{"interface":"front","average":{"1min":6.5469999999999997,"5min":2.7210000000000001,"15min":2.2480000000000002},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":48.159999999999997,"5min":48.159999999999997,"15min":48.159999999999997},"last":1.379}]},{"osd":4,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":13.605,"5min":16.038,"15min":23.190000000000001},"min":{"1min":0.85799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":176.16900000000001,"5min":248.709,"15min":248.709},"last":1.587},{"interface":"front","average":{"1min":25.143999999999998,"5min":26.859000000000002,"15min":36.008000000000003},"min":{"1min":0.76500000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":249.125,"5min":315.69400000000002,"15min":315.69400000000002},"last":1.4930000000000001}]},{"osd":5,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":33.139000000000003,"15min":55.725000000000001},"min":{"1min":0.81399999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.8779999999999999,"5min":540.08900000000006,"15min":540.08900000000006},"last":66.656999999999996},{"interface":"front","average":{"1min":11.036,"5min":13.048,"15min":14.032},"min":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":176.32599999999999,"5min":176.32599999999999,"15min":176.32599999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":29.782,"5min":22.654,"15min":32.274000000000001},"min":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":222.18299999999999,"5min":240.36600000000001,"15min":240.36600000000001},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.304,"5min":40.305999999999997,"15min":67.299999999999997},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.996,"5min":498.05399999999997,"15min":498.05399999999997},"last":2.456}]},{"osd":7,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":8.7680000000000007,"5min":64.995999999999995,"15min":123.136},"min":{"1min":0.88200000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":93.771000000000001,"5min":1663.876,"15min":1663.876},"last":2.3029999999999999},{"interface":"front","average":{"1min":11.15,"5min":56.536999999999999,"15min":106.17},"min":{"1min":1.016,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":176.261,"5min":844.65300000000002,"15min":844.65300000000002},"last":2.0129999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344540,"kb_used_data":316628,"kb_used_omap":0,"kb_used_meta":27904,"kb_avail":94027300,"statfs":{"total":96636764160,"available":96283955200,"internally_reserved":0,"allocated":324227072,"data_stored":339798606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28573696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":7.5739999999999998,"5min":3.2999999999999998,"15min":1.6240000000000001},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.443},"max":{"1min":66.424000000000007,"5min":72.322000000000003,"15min":72.322000000000003},"last":7.242},{"interface":"front","average":{"1min":11.119,"5min":37.843000000000004,"15min":63.07},"min":{"1min":0.51200000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":91.519000000000005,"5min":465.05200000000002,"15min":465.05200000000002},"last":2.927}]},{"osd":1,"last update":"Sun May 1 04:29:39 2022","interfaces":[{"interface":"back","average":{"1min":18.872,"5min":18.231000000000002,"15min":18.123999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":84.466999999999999,"5min":153.101,"15min":153.101},"last":1.8069999999999999},{"interface":"front","average":{"1min":8.1769999999999996,"5min":2.3620000000000001,"15min":1.393},"min":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":117.398,"5min":117.398,"15min":117.398},"last":2.0579999999999998}]},{"osd":3,"last update":"Sun May 1 04:30:08 2022","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.212,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.390000000000001,"5min":21.312000000000001,"15min":21.312000000000001},"last":101.03100000000001},{"interface":"front","average":{"1min":1.034,"5min":0.93799999999999994,"15min":0.90600000000000003},"min":{"1min":0.73999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":2.8079999999999998}]},{"osd":4,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":2.234,"5min":8.4920000000000009,"15min":14.210000000000001},"min":{"1min":0.874,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":21.434000000000001,"5min":147.17099999999999,"15min":147.17099999999999},"last":2.1890000000000001},{"interface":"front","average":{"1min":8.3149999999999995,"5min":19.849,"15min":34.643999999999998},"min":{"1min":1.032,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":72.075000000000003,"5min":240.71000000000001,"15min":240.71000000000001},"last":2.4199999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":8.907,"5min":14.784000000000001,"15min":15.452999999999999},"min":{"1min":0.85199999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":153.203,"5min":260.42099999999999,"15min":260.42099999999999},"last":13.206},{"interface":"front","average":{"1min":2.4009999999999998,"5min":7.548,"15min":12.875999999999999},"min":{"1min":1.012,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":21.504000000000001,"5min":196.74799999999999,"15min":196.74799999999999},"last":2.3290000000000002}]},{"osd":6,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":11.903,"15min":21.797000000000001},"min":{"1min":0.98999999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2999999999999998,"5min":146.161,"15min":146.161},"last":2.5750000000000002},{"interface":"front","average":{"1min":13.718,"5min":24.753,"15min":36.780999999999999},"min":{"1min":1.0309999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":161.85599999999999,"5min":269.53100000000001,"15min":269.53100000000001},"last":13.034000000000001}]},{"osd":7,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5589999999999999,"15min":1.7649999999999999},"min":{"1min":1.069,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.1720000000000002,"5min":11.654999999999999,"15min":11.654999999999999},"last":2.6930000000000001},{"interface":"front","average":{"1min":13.727,"5min":13.403,"15min":16.937000000000001},"min":{"1min":1.111,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":155.268,"5min":160.547,"15min":160.547},"last":13.332000000000001}]}]},{"osd":3,"up_from":105,"seq":450971566121,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530208,"kb_used_data":509400,"kb_used_omap":2,"kb_used_meta":20797,"kb_avail":93841632,"statfs":{"total":96636764160,"available":96093831168,"internally_reserved":0,"allocated":521625600,"data_stored":527555785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":21296315},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":4.7389999999999999,"15min":6.298},"min":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":73.262,"15min":73.262},"last":0.94199999999999995},{"interface":"front","average":{"1min":7.7329999999999997,"5min":6.2919999999999998,"15min":7.1989999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":72.561000000000007,"5min":97.546999999999997,"15min":97.546999999999997},"last":1.121}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":3.3540000000000001,"5min":1.3680000000000001,"15min":1.0369999999999999},"min":{"1min":0.69199999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":51.892000000000003,"5min":51.892000000000003,"15min":51.892000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":5.0890000000000004,"5min":1.716,"15min":1.1539999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":51.715000000000003,"5min":51.715000000000003,"15min":51.715000000000003},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":0.94399999999999995},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.841,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":5.4009999999999998,"5min":4.351,"15min":4.7690000000000001},"min":{"1min":0.748,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":73.284000000000006,"5min":83.582999999999998,"15min":83.582999999999998},"last":1.032}]},{"osd":4,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":14.065,"5min":6.859,"15min":4.4889999999999999},"min":{"1min":0.80500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":88.811000000000007,"5min":97.501999999999995,"15min":97.501999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.3220000000000001,"15min":2.8300000000000001},"min":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7150000000000001,"5min":42.081000000000003,"15min":42.081000000000003},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3029999999999999,"15min":1.284},"min":{"1min":1.0660000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.885,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":5.4340000000000002,"5min":4.4109999999999996,"15min":3.9750000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":72.870000000000005,"5min":91.775999999999996,"15min":91.775999999999996},"last":0.91500000000000004}]},{"osd":6,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":2.681,"15min":1.7549999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":60.124000000000002,"5min":78.131,"15min":78.131},"last":1.321},{"interface":"front","average":{"1min":3.6890000000000001,"5min":4.7919999999999998,"15min":4.3760000000000003},"min":{"1min":1.0840000000000001,"5min":1.014,"15min":1.014},"max":{"1min":39.942999999999998,"5min":89.192999999999998,"15min":89.192999999999998},"last":1.2889999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":7.8170000000000002,"5min":2.6709999999999998,"15min":1.8169999999999999},"min":{"1min":0.98599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":73.015000000000001,"5min":73.015000000000001,"15min":73.015000000000001},"last":1.012},{"interface":"front","average":{"1min":6.5549999999999997,"5min":3.1709999999999998,"15min":1.954},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":89.414000000000001,"5min":89.414000000000001,"15min":89.414000000000001},"last":1.1870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1106868,"kb_used_data":1056940,"kb_used_omap":0,"kb_used_meta":49920,"kb_avail":93264972,"statfs":{"total":96636764160,"available":95503331328,"internally_reserved":0,"allocated":1082306560,"data_stored":1139940750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":51118080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":12.122,"5min":17.731999999999999,"15min":24.044},"min":{"1min":0.46899999999999997,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":129.07599999999999,"5min":257.822,"15min":257.822},"last":78.052999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":13.398,"15min":22.884},"min":{"1min":0.51600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":256.291,"15min":256.291},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":4.1289999999999996,"5min":5.9720000000000004,"15min":6.2789999999999999},"min":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":69.811999999999998,"5min":91.667000000000002,"15min":91.667000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":17.847000000000001,"5min":4.6870000000000003,"15min":2.4929999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":129.15799999999999,"5min":129.15799999999999,"15min":129.15799999999999},"last":1.0740000000000001}]},{"osd":2,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":13.859,"15min":21.893999999999998},"min":{"1min":0.60199999999999998,"5min":0.505,"15min":0.505},"max":{"1min":45.573,"5min":256.45999999999998,"15min":256.45999999999998},"last":1.008},{"interface":"front","average":{"1min":8.9290000000000003,"5min":10.433999999999999,"15min":16.033999999999999},"min":{"1min":0.77200000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":91.593000000000004,"5min":174.048,"15min":174.048},"last":1.038}]},{"osd":3,"last update":"Sun May 1 04:30:11 2022","interfaces":[{"interface":"back","average":{"1min":6.1619999999999999,"5min":4.6959999999999997,"15min":4.4619999999999997},"min":{"1min":0.80700000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":97.203999999999994,"5min":97.203999999999994,"15min":97.203999999999994},"last":1.208},{"interface":"front","average":{"1min":1.0349999999999999,"5min":3.8929999999999998,"15min":3.2010000000000001},"min":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3260000000000001,"5min":91.527000000000001,"15min":91.527000000000001},"last":1.3129999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":6.3840000000000003,"5min":17.690999999999999,"15min":24.939},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":44.625,"5min":159.648,"15min":159.648},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":17.940999999999999,"15min":31.800999999999998},"min":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2470000000000001,"5min":256.18799999999999,"15min":256.18799999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":17.603000000000002,"5min":12.807,"15min":17.817},"min":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":91.289000000000001,"5min":174.274,"15min":174.274},"last":1.181},{"interface":"front","average":{"1min":6.5199999999999996,"5min":18.015999999999998,"15min":26.024000000000001},"min":{"1min":0.86199999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":44.703000000000003,"5min":231.74799999999999,"15min":231.74799999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":28.369,"15min":52.451000000000001},"min":{"1min":0.85999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.516,"5min":652.226,"15min":652.226},"last":1.2789999999999999},{"interface":"front","average":{"1min":13.464,"5min":30.495999999999999,"15min":49.872999999999998},"min":{"1min":0.85299999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":91.421999999999997,"5min":376.32900000000001,"15min":376.32900000000001},"last":106.176}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266936,"kb_used_data":221744,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94104904,"statfs":{"total":96636764160,"available":96363421696,"internally_reserved":0,"allocated":227065856,"data_stored":227583021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":3.8239999999999998,"5min":22.074999999999999,"15min":35.737000000000002},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":48.405999999999999,"5min":334.69799999999998,"15min":334.69799999999998},"last":4.9119999999999999},{"interface":"front","average":{"1min":4.0570000000000004,"5min":15.731999999999999,"15min":22.18},"min":{"1min":0.77300000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":48.375999999999998,"5min":282.01999999999998,"15min":282.01999999999998},"last":4.9900000000000002}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":7.569,"5min":2.2519999999999998,"15min":1.3660000000000001},"min":{"1min":0.622,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":97.450000000000003,"5min":97.450000000000003,"15min":97.450000000000003},"last":4.3899999999999997},{"interface":"front","average":{"1min":8.4730000000000008,"5min":2.3879999999999999,"15min":1.3740000000000001},"min":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":58.759,"5min":58.759,"15min":58.759},"last":1.3939999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":2.7890000000000001,"15min":4.0099999999999998},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.2599999999999998,"5min":82.424999999999997,"15min":82.424999999999997},"last":1.052},{"interface":"front","average":{"1min":0.91900000000000004,"5min":5.452,"15min":9.968},"min":{"1min":0.69499999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.325,"5min":150.518,"15min":150.518},"last":4.3239999999999998}]},{"osd":3,"last update":"Sun May 1 04:30:10 2022","interfaces":[{"interface":"back","average":{"1min":5.3099999999999996,"5min":1.879,"15min":1.3069999999999999},"min":{"1min":0.751,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":110.706,"5min":110.706,"15min":110.706},"last":4.5140000000000002},{"interface":"front","average":{"1min":7.556,"5min":2.3849999999999998,"15min":1.486},"min":{"1min":0.84699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":76.444000000000003,"5min":76.444000000000003,"15min":76.444000000000003},"last":99.159999999999997}]},{"osd":4,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":3.2810000000000001,"5min":21.321999999999999,"15min":39.951000000000001},"min":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":45.170000000000002,"5min":385.29300000000001,"15min":385.29300000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.48,"5min":13.676,"15min":20.757999999999999},"min":{"1min":0.68200000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":11.239000000000001,"5min":189.869,"15min":189.869},"last":0.83699999999999997}]},{"osd":6,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":18.375,"5min":18.841999999999999,"15min":30.875},"min":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":173.755,"5min":332.26299999999998,"15min":332.26299999999998},"last":4.25},{"interface":"front","average":{"1min":6.577,"5min":11.333,"15min":19.437000000000001},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":60.741999999999997,"5min":295.99299999999999,"15min":295.99299999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":53.643999999999998,"15min":101.39},"min":{"1min":0.83099999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.321,"5min":1543.201,"15min":1543.201},"last":0.90800000000000003},{"interface":"front","average":{"1min":3.4769999999999999,"5min":7.6059999999999999,"15min":13.260999999999999},"min":{"1min":0.97999999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":44.923999999999999,"5min":150.71100000000001,"15min":150.71100000000001},"last":4.452}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":885415936,"data_stored":931792676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":789708800,"data_stored":826088549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":652007,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":320839680,"data_stored":338303778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":528502784,"data_stored":536261159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1080651776,"data_stored":1140181288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":232603648,"data_stored":234980026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":720662528,"data_stored":750115991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":852553728,"data_stored":897351225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-01T10:42:31.184 WARNING:scrape:Ignoring malparsed backtrace: dumped all , 2022-05-01T04:30:51.050 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2022-05-01T04:30:49.284987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3034072875,"num_objects":1140,"num_object_clones":186,"num_object_copies":3420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":28,"num_read":3100,"num_read_kb":1354332,"num_write":6217,"num_write_kb":1638045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3293,"num_bytes_recovered":3515279523,"num_keys_recovered":1981,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13078,"ondisk_log_size":13078,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4882300,"kb_used_data":4569916,"kb_used_omap":655,"kb_used_meta":311664,"kb_avail":750092420,"statfs":{"total":773094113280,"available":768094638080,"internally_reserved":0,"allocated":4679593984,"data_stored":4869698937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":671085,"internal_metadata":319144595},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-56420173,"num_objects":-25,"num_object_clones":-11,"num_object_copies":-75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":-2,"num_read":-615,"num_read_kb":-329157,"num_write":-1204,"num_write_kb":-343199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-649,"num_bytes_recovered":-739472948,"num_keys_recovered":-330,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002032"},"pg_stats":[{"pgid":"3.19","version":"272'501","reported_seq":1338,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794886+0000","last_change":"2022-05-01T04:30:36.658256+0000","last_active":"2022-05-01T04:30:42.794886+0000","last_peered":"2022-05-01T04:30:42.794886+0000","last_clean":"2022-05-01T04:30:42.794886+0000","last_became_active":"2022-05-01T04:30:11.294414+0000","last_became_peered":"2022-05-01T04:30:11.294414+0000","last_unstale":"2022-05-01T04:30:42.794886+0000","last_undegraded":"2022-05-01T04:30:42.794886+0000","last_fullsized":"2022-05-01T04:30:42.794886+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":5,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":501,"ondisk_log_size":501,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.205175364,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":114,"num_read_kb":82076,"num_write":204,"num_write_kb":57354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":40234521,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.18","version":"273'465","reported_seq":2345,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971260+0000","last_change":"2022-05-01T04:30:15.339106+0000","last_active":"2022-05-01T04:30:42.971260+0000","last_peered":"2022-05-01T04:30:42.971260+0000","last_clean":"2022-05-01T04:30:42.971260+0000","last_became_active":"2022-05-01T04:30:15.336684+0000","last_became_peered":"2022-05-01T04:30:15.336684+0000","last_unstale":"2022-05-01T04:30:42.971260+0000","last_undegraded":"2022-05-01T04:30:42.971260+0000","last_fullsized":"2022-05-01T04:30:42.971260+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":5,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.001352624,"stat_sum":{"num_bytes":96164905,"num_objects":40,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":2,"num_read":116,"num_read_kb":48609,"num_write":277,"num_write_kb":64535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":249,"num_bytes_recovered":275012362,"num_keys_recovered":150,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.17","version":"305'541","reported_seq":2031,"reported_epoch":305,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:44.138602+0000","last_change":"2022-05-01T04:30:41.229899+0000","last_active":"2022-05-01T04:30:44.138602+0000","last_peered":"2022-05-01T04:30:44.138602+0000","last_clean":"2022-05-01T04:30:44.138602+0000","last_became_active":"2022-05-01T04:30:07.303342+0000","last_became_peered":"2022-05-01T04:30:07.303342+0000","last_unstale":"2022-05-01T04:30:44.138602+0000","last_undegraded":"2022-05-01T04:30:44.138602+0000","last_fullsized":"2022-05-01T04:30:44.138602+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":541,"ondisk_log_size":541,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":12,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":207854617,"num_keys_recovered":90,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'571","reported_seq":1935,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.071933+0000","last_change":"2022-05-01T04:30:21.386607+0000","last_active":"2022-05-01T04:30:43.071933+0000","last_peered":"2022-05-01T04:30:43.071933+0000","last_clean":"2022-05-01T04:30:43.071933+0000","last_became_active":"2022-05-01T04:30:21.278471+0000","last_became_peered":"2022-05-01T04:30:21.278471+0000","last_unstale":"2022-05-01T04:30:43.071933+0000","last_undegraded":"2022-05-01T04:30:43.071933+0000","last_fullsized":"2022-05-01T04:30:43.071933+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":297,"parent":"0.0","parent_split_bits":5,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":571,"ondisk_log_size":571,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.102919052,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":113,"num_read_kb":54635,"num_write":201,"num_write_kb":69191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967346,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.15","version":"300'475","reported_seq":2264,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886295+0000","last_change":"2022-05-01T04:30:38.186202+0000","last_active":"2022-05-01T04:30:42.886295+0000","last_peered":"2022-05-01T04:30:42.886295+0000","last_clean":"2022-05-01T04:30:42.886295+0000","last_became_active":"2022-05-01T04:30:17.351913+0000","last_became_peered":"2022-05-01T04:30:17.351913+0000","last_unstale":"2022-05-01T04:30:42.886295+0000","last_undegraded":"2022-05-01T04:30:42.886295+0000","last_fullsized":"2022-05-01T04:30:42.886295+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":475,"ondisk_log_size":475,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0.31212725699999999,"stat_sum":{"num_bytes":74400612,"num_objects":29,"num_object_clones":3,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":104,"num_read_kb":29450,"num_write":244,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":247163307,"num_keys_recovered":230,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.14","version":"264'361","reported_seq":1637,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794291+0000","last_change":"2022-05-01T04:30:13.108744+0000","last_active":"2022-05-01T04:30:42.794291+0000","last_peered":"2022-05-01T04:30:42.794291+0000","last_clean":"2022-05-01T04:30:42.794291+0000","last_became_active":"2022-05-01T04:30:13.107986+0000","last_became_peered":"2022-05-01T04:30:13.107986+0000","last_unstale":"2022-05-01T04:30:42.794291+0000","last_undegraded":"2022-05-01T04:30:42.794291+0000","last_fullsized":"2022-05-01T04:30:42.794291+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":5,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83569378,"num_objects":30,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":179,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":132378397,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.13","version":"299'572","reported_seq":1407,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886038+0000","last_change":"2022-05-01T04:30:26.931140+0000","last_active":"2022-05-01T04:30:42.886038+0000","last_peered":"2022-05-01T04:30:42.886038+0000","last_clean":"2022-05-01T04:30:42.886038+0000","last_became_active":"2022-05-01T04:30:20.285780+0000","last_became_peered":"2022-05-01T04:30:20.285780+0000","last_unstale":"2022-05-01T04:30:42.886038+0000","last_undegraded":"2022-05-01T04:30:42.886038+0000","last_fullsized":"2022-05-01T04:30:42.886038+0000","mapping_epoch":295,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":296,"parent":"0.0","parent_split_bits":5,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":572,"ondisk_log_size":572,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":1.706369295,"stat_sum":{"num_bytes":102081758,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":128,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":56033723,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.12","version":"300'547","reported_seq":2075,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:45.067414+0000","last_change":"2022-05-01T04:30:45.067267+0000","last_active":"2022-05-01T04:30:45.067414+0000","last_peered":"2022-05-01T04:30:45.067414+0000","last_clean":"2022-05-01T04:30:45.067414+0000","last_became_active":"2022-05-01T04:30:07.095952+0000","last_became_peered":"2022-05-01T04:30:07.095952+0000","last_unstale":"2022-05-01T04:30:45.067414+0000","last_undegraded":"2022-05-01T04:30:45.067414+0000","last_fullsized":"2022-05-01T04:30:45.067414+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"300'547","last_scrub_stamp":"2022-05-01T04:30:45.067056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:45.067056+0000","objects_scrubbed":45,"log_size":547,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:48.642649+0000","scrub_duration":0.41387814099999998,"objects_trimmed":0,"snaptrim_duration":0.29937229199999998,"stat_sum":{"num_bytes":119129063,"num_objects":45,"num_object_clones":6,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.11","version":"294'459","reported_seq":2012,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.885825+0000","last_change":"2022-05-01T04:30:20.820375+0000","last_active":"2022-05-01T04:30:42.885825+0000","last_peered":"2022-05-01T04:30:42.885825+0000","last_clean":"2022-05-01T04:30:42.885825+0000","last_became_active":"2022-05-01T04:30:16.337078+0000","last_became_peered":"2022-05-01T04:30:16.337078+0000","last_unstale":"2022-05-01T04:30:42.885825+0000","last_undegraded":"2022-05-01T04:30:42.885825+0000","last_fullsized":"2022-05-01T04:30:42.885825+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":459,"ondisk_log_size":459,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.75287199800000004,"stat_sum":{"num_bytes":95657072,"num_objects":39,"num_object_clones":8,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":121,"num_read_kb":76398,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":183552292,"num_keys_recovered":160,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.10","version":"306'494","reported_seq":1770,"reported_epoch":306,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:45.217681+0000","last_change":"2022-05-01T04:30:45.217681+0000","last_active":"2022-05-01T04:30:45.217681+0000","last_peered":"2022-05-01T04:30:45.217681+0000","last_clean":"2022-05-01T04:30:45.217681+0000","last_became_active":"2022-05-01T04:30:25.327719+0000","last_became_peered":"2022-05-01T04:30:25.327719+0000","last_unstale":"2022-05-01T04:30:45.217681+0000","last_undegraded":"2022-05-01T04:30:45.217681+0000","last_fullsized":"2022-05-01T04:30:45.217681+0000","mapping_epoch":299,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"305'492","last_scrub_stamp":"2022-05-01T04:30:44.966852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.966852+0000","objects_scrubbed":31,"log_size":494,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":9,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:06.496639+0000","scrub_duration":0.313975106,"objects_trimmed":0,"snaptrim_duration":1.37659145,"stat_sum":{"num_bytes":90587458,"num_objects":31,"num_object_clones":3,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.f","version":"277'540","reported_seq":1311,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886800+0000","last_change":"2022-05-01T04:30:16.500449+0000","last_active":"2022-05-01T04:30:42.886800+0000","last_peered":"2022-05-01T04:30:42.886800+0000","last_clean":"2022-05-01T04:30:42.886800+0000","last_became_active":"2022-05-01T04:30:16.399454+0000","last_became_peered":"2022-05-01T04:30:16.399454+0000","last_unstale":"2022-05-01T04:30:42.886800+0000","last_undegraded":"2022-05-01T04:30:42.886800+0000","last_fullsized":"2022-05-01T04:30:42.886800+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'412","last_scrub_stamp":"2022-05-01T04:28:16.288822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:16.288822+0000","objects_scrubbed":63,"log_size":540,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81907881800000004,"objects_trimmed":0,"snaptrim_duration":0.72566574800000005,"stat_sum":{"num_bytes":198947307,"num_objects":70,"num_object_clones":8,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":2,"num_read":226,"num_read_kb":100373,"num_write":447,"num_write_kb":118211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":2944186,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.e","version":"276'657","reported_seq":1965,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886057+0000","last_change":"2022-05-01T04:30:02.666116+0000","last_active":"2022-05-01T04:30:42.886057+0000","last_peered":"2022-05-01T04:30:42.886057+0000","last_clean":"2022-05-01T04:30:42.886057+0000","last_became_active":"2022-05-01T04:29:15.968177+0000","last_became_peered":"2022-05-01T04:29:15.968177+0000","last_unstale":"2022-05-01T04:30:42.886057+0000","last_undegraded":"2022-05-01T04:30:42.886057+0000","last_fullsized":"2022-05-01T04:30:42.886057+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'588","last_scrub_stamp":"2022-05-01T04:29:37.821007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.821007+0000","objects_scrubbed":80,"log_size":657,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.62661968000000001,"objects_trimmed":0,"snaptrim_duration":0.88139935800000002,"stat_sum":{"num_bytes":238859551,"num_objects":88,"num_object_clones":14,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":2,"num_read":259,"num_read_kb":84476,"num_write":573,"num_write_kb":169626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":228132670,"num_keys_recovered":80,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.d","version":"304'452","reported_seq":1559,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.466858+0000","last_change":"2022-05-01T04:30:43.466858+0000","last_active":"2022-05-01T04:30:43.466858+0000","last_peered":"2022-05-01T04:30:43.466858+0000","last_clean":"2022-05-01T04:30:43.466858+0000","last_became_active":"2022-05-01T04:30:17.429652+0000","last_became_peered":"2022-05-01T04:30:17.429652+0000","last_unstale":"2022-05-01T04:30:43.466858+0000","last_undegraded":"2022-05-01T04:30:43.466858+0000","last_fullsized":"2022-05-01T04:30:43.466858+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":0,"last_scrub":"304'452","last_scrub_stamp":"2022-05-01T04:30:43.262739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.262739+0000","objects_scrubbed":64,"log_size":452,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:08.333726+0000","scrub_duration":0.92506281099999998,"objects_trimmed":0,"snaptrim_duration":0.50948584399999997,"stat_sum":{"num_bytes":171885785,"num_objects":64,"num_object_clones":10,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":1,"num_read":184,"num_read_kb":90112,"num_write":428,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":115470720,"num_keys_recovered":180,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.c","version":"306'496","reported_seq":2106,"reported_epoch":306,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:45.425481+0000","last_change":"2022-05-01T04:30:45.425481+0000","last_active":"2022-05-01T04:30:45.425481+0000","last_peered":"2022-05-01T04:30:45.425481+0000","last_clean":"2022-05-01T04:30:45.425481+0000","last_became_active":"2022-05-01T04:30:39.013083+0000","last_became_peered":"2022-05-01T04:30:39.013083+0000","last_unstale":"2022-05-01T04:30:45.425481+0000","last_undegraded":"2022-05-01T04:30:45.425481+0000","last_fullsized":"2022-05-01T04:30:45.425481+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"249'466","last_scrub_stamp":"2022-05-01T04:29:36.465699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.465699+0000","objects_scrubbed":62,"log_size":496,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81548162000000002,"objects_trimmed":0,"snaptrim_duration":1.142217163,"stat_sum":{"num_bytes":167437493,"num_objects":63,"num_object_clones":7,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":2,"num_read":271,"num_read_kb":161213,"num_write":425,"num_write_kb":112139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":431,"num_bytes_recovered":451139640,"num_keys_recovered":91,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.b","version":"261'397","reported_seq":1750,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971191+0000","last_change":"2022-05-01T04:30:07.810362+0000","last_active":"2022-05-01T04:30:42.971191+0000","last_peered":"2022-05-01T04:30:42.971191+0000","last_clean":"2022-05-01T04:30:42.971191+0000","last_became_active":"2022-05-01T04:30:07.195503+0000","last_became_peered":"2022-05-01T04:30:07.195503+0000","last_unstale":"2022-05-01T04:30:42.971191+0000","last_undegraded":"2022-05-01T04:30:42.971191+0000","last_fullsized":"2022-05-01T04:30:42.971191+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"248'389","last_scrub_stamp":"2022-05-01T04:29:39.348483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.348483+0000","objects_scrubbed":68,"log_size":397,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.05234216,"objects_trimmed":0,"snaptrim_duration":0.61416249099999998,"stat_sum":{"num_bytes":179141560,"num_objects":68,"num_object_clones":8,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":206,"num_read_kb":69949,"num_write":398,"num_write_kb":107432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":339541664,"num_keys_recovered":220,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.a","version":"272'477","reported_seq":1749,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886252+0000","last_change":"2022-05-01T04:29:58.990005+0000","last_active":"2022-05-01T04:30:42.886252+0000","last_peered":"2022-05-01T04:30:42.886252+0000","last_clean":"2022-05-01T04:30:42.886252+0000","last_became_active":"2022-05-01T04:29:08.175363+0000","last_became_peered":"2022-05-01T04:29:08.175363+0000","last_unstale":"2022-05-01T04:30:42.886252+0000","last_undegraded":"2022-05-01T04:30:42.886252+0000","last_fullsized":"2022-05-01T04:30:42.886252+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"247'454","last_scrub_stamp":"2022-05-01T04:29:39.093953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.093953+0000","objects_scrubbed":70,"log_size":477,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:46.460212+0000","scrub_duration":1.3648651510000001,"objects_trimmed":0,"snaptrim_duration":0.15573891400000001,"stat_sum":{"num_bytes":197706553,"num_objects":71,"num_object_clones":8,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":2,"num_read":262,"num_read_kb":159904,"num_write":471,"num_write_kb":128600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":193253880,"num_keys_recovered":160,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.9","version":"276'505","reported_seq":1361,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.894496+0000","last_change":"2022-05-01T04:30:40.000604+0000","last_active":"2022-05-01T04:30:42.894496+0000","last_peered":"2022-05-01T04:30:42.894496+0000","last_clean":"2022-05-01T04:30:42.894496+0000","last_became_active":"2022-05-01T04:29:59.090857+0000","last_became_peered":"2022-05-01T04:29:59.090857+0000","last_unstale":"2022-05-01T04:30:42.894496+0000","last_undegraded":"2022-05-01T04:30:42.894496+0000","last_fullsized":"2022-05-01T04:30:42.894496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"276'505","last_scrub_stamp":"2022-05-01T04:30:40.000406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:40.000406+0000","objects_scrubbed":33,"log_size":505,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:40.973401+0000","scrub_duration":1.1692613220000001,"objects_trimmed":0,"snaptrim_duration":0.71138417200000004,"stat_sum":{"num_bytes":88684995,"num_objects":33,"num_object_clones":4,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.8","version":"273'465","reported_seq":2276,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971123+0000","last_change":"2022-05-01T04:30:08.055718+0000","last_active":"2022-05-01T04:30:42.971123+0000","last_peered":"2022-05-01T04:30:42.971123+0000","last_clean":"2022-05-01T04:30:42.971123+0000","last_became_active":"2022-05-01T04:30:00.189790+0000","last_became_peered":"2022-05-01T04:30:00.189790+0000","last_unstale":"2022-05-01T04:30:42.971123+0000","last_undegraded":"2022-05-01T04:30:42.971123+0000","last_fullsized":"2022-05-01T04:30:42.971123+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.101109292,"stat_sum":{"num_bytes":96164905,"num_objects":39,"num_object_clones":10,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":116,"num_read_kb":48609,"num_write":276,"num_write_kb":64534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":252683112,"num_keys_recovered":230,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.097278+0000","last_change":"2022-05-01T04:30:43.097130+0000","last_active":"2022-05-01T04:30:43.097278+0000","last_peered":"2022-05-01T04:30:43.097278+0000","last_clean":"2022-05-01T04:30:43.097278+0000","last_became_active":"2022-05-01T04:28:42.075951+0000","last_became_peered":"2022-05-01T04:28:42.075951+0000","last_unstale":"2022-05-01T04:30:43.097278+0000","last_undegraded":"2022-05-01T04:30:43.097278+0000","last_fullsized":"2022-05-01T04:30:43.097278+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:43.097017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.097017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:12.069270+0000","scrub_duration":0.562521787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"300'475","reported_seq":2132,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971873+0000","last_change":"2022-05-01T04:30:30.786613+0000","last_active":"2022-05-01T04:30:42.971873+0000","last_peered":"2022-05-01T04:30:42.971873+0000","last_clean":"2022-05-01T04:30:42.971873+0000","last_became_active":"2022-05-01T04:30:21.445664+0000","last_became_peered":"2022-05-01T04:30:21.445664+0000","last_unstale":"2022-05-01T04:30:42.971873+0000","last_undegraded":"2022-05-01T04:30:42.971873+0000","last_fullsized":"2022-05-01T04:30:42.971873+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":297,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":475,"ondisk_log_size":475,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":5.6648302790000002,"stat_sum":{"num_bytes":78914214,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":1,"num_read":103,"num_read_kb":29450,"num_write":243,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":241573064,"num_keys_recovered":170,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.098496+0000","last_change":"2022-05-01T04:30:02.996712+0000","last_active":"2022-05-01T04:30:43.098496+0000","last_peered":"2022-05-01T04:30:43.098496+0000","last_clean":"2022-05-01T04:30:43.098496+0000","last_became_active":"2022-05-01T04:30:02.896021+0000","last_became_peered":"2022-05-01T04:30:02.896021+0000","last_unstale":"2022-05-01T04:30:43.098496+0000","last_undegraded":"2022-05-01T04:30:43.098496+0000","last_fullsized":"2022-05-01T04:30:43.098496+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:52.422661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:52.422661+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:05.375337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"275'566","reported_seq":1429,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794267+0000","last_change":"2022-05-01T04:30:35.848139+0000","last_active":"2022-05-01T04:30:42.794267+0000","last_peered":"2022-05-01T04:30:42.794267+0000","last_clean":"2022-05-01T04:30:42.794267+0000","last_became_active":"2022-05-01T04:29:59.089639+0000","last_became_peered":"2022-05-01T04:29:59.089639+0000","last_unstale":"2022-05-01T04:30:42.794267+0000","last_undegraded":"2022-05-01T04:30:42.794267+0000","last_fullsized":"2022-05-01T04:30:42.794267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0.89342225399999997,"stat_sum":{"num_bytes":102081757,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":127,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":397,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.020574+0000","last_change":"2022-05-01T04:29:51.118516+0000","last_active":"2022-05-01T04:30:43.020574+0000","last_peered":"2022-05-01T04:30:43.020574+0000","last_clean":"2022-05-01T04:30:43.020574+0000","last_became_active":"2022-05-01T04:29:51.118117+0000","last_became_peered":"2022-05-01T04:29:51.118117+0000","last_unstale":"2022-05-01T04:30:43.020574+0000","last_undegraded":"2022-05-01T04:30:43.020574+0000","last_fullsized":"2022-05-01T04:30:43.020574+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:40.698524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:40.698524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:45.889971+0000","scrub_duration":0.50325435799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"273'490","reported_seq":1611,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.895251+0000","last_change":"2022-05-01T04:30:33.642210+0000","last_active":"2022-05-01T04:30:42.895251+0000","last_peered":"2022-05-01T04:30:42.895251+0000","last_clean":"2022-05-01T04:30:42.895251+0000","last_became_active":"2022-05-01T04:29:58.888029+0000","last_became_peered":"2022-05-01T04:29:58.888029+0000","last_unstale":"2022-05-01T04:30:42.895251+0000","last_undegraded":"2022-05-01T04:30:42.895251+0000","last_fullsized":"2022-05-01T04:30:42.895251+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0.00046417000000000002,"stat_sum":{"num_bytes":93110778,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":103,"num_read_kb":46934,"num_write":215,"num_write_kb":63006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":83574846,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.071675+0000","last_change":"2022-05-01T04:30:41.934135+0000","last_active":"2022-05-01T04:30:43.071675+0000","last_peered":"2022-05-01T04:30:43.071675+0000","last_clean":"2022-05-01T04:30:43.071675+0000","last_became_active":"2022-05-01T04:30:02.982092+0000","last_became_peered":"2022-05-01T04:30:02.982092+0000","last_unstale":"2022-05-01T04:30:43.071675+0000","last_undegraded":"2022-05-01T04:30:43.071675+0000","last_fullsized":"2022-05-01T04:30:43.071675+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:41.933990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:41.933990+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:45.211294+0000","scrub_duration":0.30281493700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'117","reported_seq":271,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.885606+0000","last_change":"2022-05-01T04:30:35.384860+0000","last_active":"2022-05-01T04:30:42.885606+0000","last_peered":"2022-05-01T04:30:42.885606+0000","last_clean":"2022-05-01T04:30:42.885606+0000","last_became_active":"2022-05-01T04:30:16.238972+0000","last_became_peered":"2022-05-01T04:30:16.238972+0000","last_unstale":"2022-05-01T04:30:42.885606+0000","last_undegraded":"2022-05-01T04:30:42.885606+0000","last_fullsized":"2022-05-01T04:30:42.885606+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2022-05-01T04:28:00.739540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:15.316890+0000","last_clean_scrub_stamp":"2022-05-01T04:28:00.739540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"273'535","reported_seq":2048,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971294+0000","last_change":"2022-05-01T04:30:37.327909+0000","last_active":"2022-05-01T04:30:42.971294+0000","last_peered":"2022-05-01T04:30:42.971294+0000","last_clean":"2022-05-01T04:30:42.971294+0000","last_became_active":"2022-05-01T04:30:37.005571+0000","last_became_peered":"2022-05-01T04:30:37.005571+0000","last_unstale":"2022-05-01T04:30:42.971294+0000","last_undegraded":"2022-05-01T04:30:42.971294+0000","last_fullsized":"2022-05-01T04:30:42.971294+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0.32170438600000001,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":7,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":1,"num_read":140,"num_read_kb":72872,"num_write":290,"num_write_kb":74976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":166104272,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.985883+0000","last_change":"2022-05-01T04:30:38.332044+0000","last_active":"2022-05-01T04:30:42.985883+0000","last_peered":"2022-05-01T04:30:42.985883+0000","last_clean":"2022-05-01T04:30:42.985883+0000","last_became_active":"2022-05-01T04:30:16.267154+0000","last_became_peered":"2022-05-01T04:30:16.267154+0000","last_unstale":"2022-05-01T04:30:42.985883+0000","last_undegraded":"2022-05-01T04:30:42.985883+0000","last_fullsized":"2022-05-01T04:30:42.985883+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:12.658835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:12.658835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.304165821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"294'453","reported_seq":1881,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:44.651118+0000","last_change":"2022-05-01T04:30:44.651012+0000","last_active":"2022-05-01T04:30:44.651118+0000","last_peered":"2022-05-01T04:30:44.651118+0000","last_clean":"2022-05-01T04:30:44.651118+0000","last_became_active":"2022-05-01T04:30:06.174043+0000","last_became_peered":"2022-05-01T04:30:06.174043+0000","last_unstale":"2022-05-01T04:30:44.651118+0000","last_undegraded":"2022-05-01T04:30:44.651118+0000","last_fullsized":"2022-05-01T04:30:44.651118+0000","mapping_epoch":281,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'453","last_scrub_stamp":"2022-05-01T04:30:44.650869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.650869+0000","objects_scrubbed":28,"log_size":453,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:47.041633+0000","scrub_duration":1.0091338110000001,"objects_trimmed":0,"snaptrim_duration":0.466307156,"stat_sum":{"num_bytes":71326779,"num_objects":28,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886488+0000","last_change":"2022-05-01T04:29:49.588507+0000","last_active":"2022-05-01T04:30:42.886488+0000","last_peered":"2022-05-01T04:30:42.886488+0000","last_clean":"2022-05-01T04:30:42.886488+0000","last_became_active":"2022-05-01T04:25:17.351886+0000","last_became_peered":"2022-05-01T04:25:17.351886+0000","last_unstale":"2022-05-01T04:30:42.886488+0000","last_undegraded":"2022-05-01T04:30:42.886488+0000","last_fullsized":"2022-05-01T04:30:42.886488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:49.588383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.588383+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:54.942702+0000","scrub_duration":0.30376289400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'361","reported_seq":1795,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.795559+0000","last_change":"2022-05-01T04:30:37.735039+0000","last_active":"2022-05-01T04:30:42.795559+0000","last_peered":"2022-05-01T04:30:42.795559+0000","last_clean":"2022-05-01T04:30:42.795559+0000","last_became_active":"2022-05-01T04:30:13.311320+0000","last_became_peered":"2022-05-01T04:30:13.311320+0000","last_unstale":"2022-05-01T04:30:42.795559+0000","last_undegraded":"2022-05-01T04:30:42.795559+0000","last_fullsized":"2022-05-01T04:30:42.795559+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0.00086617699999999998,"stat_sum":{"num_bytes":83569377,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":178,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":177664904,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.7","version":"273'533","reported_seq":2020,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:44.251951+0000","last_change":"2022-05-01T04:30:44.251861+0000","last_active":"2022-05-01T04:30:44.251951+0000","last_peered":"2022-05-01T04:30:44.251951+0000","last_clean":"2022-05-01T04:30:44.251951+0000","last_became_active":"2022-05-01T04:29:59.991809+0000","last_became_peered":"2022-05-01T04:29:59.991809+0000","last_unstale":"2022-05-01T04:30:44.251951+0000","last_undegraded":"2022-05-01T04:30:44.251951+0000","last_fullsized":"2022-05-01T04:30:44.251951+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":281,"parent":"0.0","parent_split_bits":0,"last_scrub":"273'533","last_scrub_stamp":"2022-05-01T04:30:44.251736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.251736+0000","objects_scrubbed":46,"log_size":533,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:13.952725+0000","scrub_duration":0.57039800500000004,"objects_trimmed":0,"snaptrim_duration":0.40617742299999998,"stat_sum":{"num_bytes":119043437,"num_objects":46,"num_object_clones":12,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794919+0000","last_change":"2022-05-01T04:30:29.747580+0000","last_active":"2022-05-01T04:30:42.794919+0000","last_peered":"2022-05-01T04:30:42.794919+0000","last_clean":"2022-05-01T04:30:42.794919+0000","last_became_active":"2022-05-01T04:28:42.261299+0000","last_became_peered":"2022-05-01T04:28:42.261299+0000","last_unstale":"2022-05-01T04:30:42.794919+0000","last_undegraded":"2022-05-01T04:30:42.794919+0000","last_fullsized":"2022-05-01T04:30:42.794919+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:48.745287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.745287+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":395,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.865335+0000","last_change":"2022-05-01T04:30:43.865062+0000","last_active":"2022-05-01T04:30:43.865335+0000","last_peered":"2022-05-01T04:30:43.865335+0000","last_clean":"2022-05-01T04:30:43.865335+0000","last_became_active":"2022-05-01T04:29:05.170684+0000","last_became_peered":"2022-05-01T04:29:05.170684+0000","last_unstale":"2022-05-01T04:30:43.865335+0000","last_undegraded":"2022-05-01T04:30:43.865335+0000","last_fullsized":"2022-05-01T04:30:43.865335+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:43.864934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.864934+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:06.201732+0000","scrub_duration":0.204585195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"277'573","reported_seq":1947,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.103309+0000","last_change":"2022-05-01T04:30:43.103199+0000","last_active":"2022-05-01T04:30:43.103309+0000","last_peered":"2022-05-01T04:30:43.103309+0000","last_clean":"2022-05-01T04:30:43.103309+0000","last_became_active":"2022-05-01T04:29:58.986844+0000","last_became_peered":"2022-05-01T04:29:58.986844+0000","last_unstale":"2022-05-01T04:30:43.103309+0000","last_undegraded":"2022-05-01T04:30:43.103309+0000","last_fullsized":"2022-05-01T04:30:43.103309+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'573","last_scrub_stamp":"2022-05-01T04:30:43.103081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.103081+0000","objects_scrubbed":26,"log_size":573,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:09.192011+0000","scrub_duration":0.413295617,"objects_trimmed":0,"snaptrim_duration":0.91696671600000002,"stat_sum":{"num_bytes":65937440,"num_objects":26,"num_object_clones":6,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":26,"stat_sum":{"num_bytes":3033482507,"num_objects":1138,"num_object_clones":186,"num_object_copies":3414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":28,"num_read":2984,"num_read_kb":1354232,"num_write":6058,"num_write_kb":1635629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3293,"num_bytes_recovered":3515279523,"num_keys_recovered":1981,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4649717760,"data_stored":4855667241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":654892,"internal_metadata":0},"log_size":12961,"ondisk_log_size":12961,"up":78,"acting":78,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":2115712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":803700,"kb_used_data":760236,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":93568140,"statfs":{"total":96636764160,"available":95813775360,"internally_reserved":0,"allocated":778481664,"data_stored":807990595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":10.657,"5min":24.966000000000001,"15min":57.649999999999999},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":85.858999999999995,"5min":518.15200000000004,"15min":518.15200000000004},"last":1.143},{"interface":"front","average":{"1min":2.96,"5min":4.0540000000000003,"15min":7.8920000000000003},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":40.087000000000003,"5min":99.054000000000002,"15min":99.054000000000002},"last":1.175}]},{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":4.6619999999999999,"5min":1.5369999999999999,"15min":1.0309999999999999},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":62.966999999999999,"5min":62.966999999999999,"15min":62.966999999999999},"last":1.111},{"interface":"front","average":{"1min":7.3620000000000001,"5min":10.083,"15min":9.2400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":98.472999999999999,"5min":98.472999999999999,"15min":98.472999999999999},"last":1.244}]},{"osd":2,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":3.3980000000000001,"5min":9.7639999999999993,"15min":24.231000000000002},"min":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":48.801000000000002,"5min":252.857,"15min":252.857},"last":1.026},{"interface":"front","average":{"1min":5.5060000000000002,"5min":16.396999999999998,"15min":44.088999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":41.975000000000001,"5min":310.839,"15min":310.839},"last":1.0609999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":1.401,"15min":1.131},"min":{"1min":0.70899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":40.189999999999998,"5min":40.189999999999998,"15min":40.189999999999998},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1140000000000001,"15min":1.1499999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5600000000000001,"5min":3.585,"15min":3.585},"last":1.21}]},{"osd":4,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":3.927,"5min":3.835,"15min":3.3570000000000002},"min":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":40.259999999999998,"5min":100.727,"15min":100.727},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.028,"5min":12.026,"15min":25.09},"min":{"1min":0.67000000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4450000000000001,"5min":252.94900000000001,"15min":252.94900000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.3410000000000002,"5min":10.968999999999999,"15min":24.16},"min":{"1min":0.63,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":42.119999999999997,"5min":301.91000000000003,"15min":301.91000000000003},"last":0.95099999999999996},{"interface":"front","average":{"1min":6.9429999999999996,"5min":5.1079999999999997,"15min":10.957000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":72.120999999999995,"5min":159.309,"15min":159.309},"last":0.97799999999999998}]},{"osd":6,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":6.9029999999999996,"5min":10.384,"15min":26.631},"min":{"1min":0.77100000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":69.748999999999995,"5min":294.37,"15min":294.37},"last":1.2809999999999999},{"interface":"front","average":{"1min":4.8680000000000003,"5min":14.615,"15min":43.470999999999997},"min":{"1min":0.874,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":69.724000000000004,"5min":294.82299999999998,"15min":294.82299999999998},"last":1.3069999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592860,"kb_used_data":555540,"kb_used_omap":0,"kb_used_meta":37312,"kb_avail":93778980,"statfs":{"total":96636764160,"available":96029675520,"internally_reserved":0,"allocated":568872960,"data_stored":588717970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":38207488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":12.117000000000001,"5min":20.341999999999999,"15min":40.899000000000001},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":146.00800000000001,"5min":474.91300000000001,"15min":474.91300000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":16.079999999999998,"5min":14.685,"15min":24.908999999999999},"min":{"1min":0.53400000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":146.03,"5min":296.67500000000001,"15min":296.67500000000001},"last":1.214}]},{"osd":1,"last update":"Sun May 1 04:30:41 2022","interfaces":[{"interface":"back","average":{"1min":4.9189999999999996,"5min":3.6520000000000001,"15min":1.833},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":74.247,"5min":100.899,"15min":100.899},"last":0.998},{"interface":"front","average":{"1min":4.1319999999999997,"5min":3.0790000000000002,"15min":3.1509999999999998},"min":{"1min":0.65900000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":58.203000000000003,"5min":58.203000000000003,"15min":58.203000000000003},"last":1.4670000000000001}]},{"osd":2,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":12.288,"15min":31.699000000000002},"min":{"1min":0.65600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":37.988999999999997,"5min":384.75700000000001,"15min":384.75700000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":4.9180000000000001,"5min":7.1749999999999998,"15min":16.774000000000001},"min":{"1min":0.66200000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":74.480999999999995,"5min":160.499,"15min":160.499},"last":1.6240000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:12 2022","interfaces":[{"interface":"back","average":{"1min":5.1210000000000004,"5min":6.2729999999999997,"15min":6.0990000000000002},"min":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":39.613999999999997,"5min":93.191999999999993,"15min":93.191999999999993},"last":1.3660000000000001},{"interface":"front","average":{"1min":5.5700000000000003,"5min":2.5150000000000001,"15min":1.544},"min":{"1min":0.81699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":45.993000000000002,"5min":49.615000000000002,"15min":49.615000000000002},"last":1.3300000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":9.2210000000000001,"15min":28.965},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.736,"5min":384.22199999999998,"15min":384.22199999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":17.77,"5min":14.365,"15min":32.424999999999997},"min":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":167.744,"5min":290.24200000000002,"15min":290.24200000000002},"last":1.391}]},{"osd":5,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":9.2119999999999997,"15min":20.93},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":33.787999999999997,"5min":276.17000000000002,"15min":276.17000000000002},"last":1.272},{"interface":"front","average":{"1min":4.8029999999999999,"5min":13.064,"15min":40.137999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":69.587999999999994,"5min":384.64299999999997,"15min":384.64299999999997},"last":1.657}]},{"osd":7,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":8.8539999999999992,"5min":26.236999999999998,"15min":76.006},"min":{"1min":0.88500000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":74.135000000000005,"5min":670.42999999999995,"15min":670.42999999999995},"last":1.538},{"interface":"front","average":{"1min":2.778,"5min":4.8630000000000004,"15min":2.327},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":33.892000000000003,"5min":94.379999999999995,"15min":94.379999999999995},"last":1.5209999999999999}]}]},{"osd":1,"up_from":134,"seq":575525617704,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583412,"kb_used_data":540012,"kb_used_omap":652,"kb_used_meta":42739,"kb_avail":93788428,"statfs":{"total":96636764160,"available":96039350272,"internally_reserved":0,"allocated":552972288,"data_stored":578843183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":668200,"internal_metadata":43765208},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":7.4340000000000002,"5min":9.7579999999999991,"15min":9.3960000000000008},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":152.63800000000001,"5min":176.80000000000001,"15min":176.80000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":7.5279999999999996,"15min":8.6859999999999999},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1599999999999999,"5min":176.886,"15min":176.886},"last":1.0620000000000001}]},{"osd":2,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":9.1899999999999995,"5min":5.5839999999999996,"15min":4.1920000000000002},"min":{"1min":0.67300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":153.50700000000001,"5min":153.50700000000001,"15min":153.50700000000001},"last":1.028},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.339,"15min":1.0169999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2410000000000001,"5min":34.151000000000003,"15min":34.151000000000003},"last":1.2230000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":7.7270000000000003,"5min":3.8700000000000001,"15min":2.02},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":153.66499999999999,"5min":153.66499999999999,"15min":153.66499999999999},"last":1.444},{"interface":"front","average":{"1min":1.095,"5min":1.6379999999999999,"15min":1.3340000000000001},"min":{"1min":0.85099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3799999999999999,"5min":34.658000000000001,"15min":34.658000000000001},"last":1.3799999999999999}]},{"osd":4,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":11.423,"5min":10.010999999999999,"15min":9.7490000000000006},"min":{"1min":0.86799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":93.575000000000003,"5min":93.575000000000003,"15min":93.575000000000003},"last":1.532},{"interface":"front","average":{"1min":20.222000000000001,"5min":6.9699999999999998,"15min":3.0339999999999998},"min":{"1min":0.86699999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":182.101,"5min":182.101,"15min":182.101},"last":1.1000000000000001}]},{"osd":5,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.7270000000000001,"15min":1.411},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7390000000000001,"5min":34.417999999999999,"15min":34.417999999999999},"last":1.7390000000000001},{"interface":"front","average":{"1min":12.800000000000001,"5min":4.8769999999999998,"15min":2.3610000000000002},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":87.403000000000006,"5min":87.403000000000006,"15min":87.403000000000006},"last":1.4139999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":8.4019999999999992,"5min":5.1319999999999997,"15min":2.5960000000000001},"min":{"1min":0.90400000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":87.778999999999996,"5min":87.778999999999996,"15min":87.778999999999996},"last":1.605},{"interface":"front","average":{"1min":8.5630000000000006,"5min":4.2729999999999997,"15min":2.351},"min":{"1min":0.96199999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":153.84700000000001,"5min":153.84700000000001,"15min":153.84700000000001},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":16.396000000000001,"5min":8.6020000000000003,"15min":5.9100000000000001},"min":{"1min":1.0569999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":182.24700000000001,"5min":182.24700000000001,"15min":182.24700000000001},"last":1.8680000000000001},{"interface":"front","average":{"1min":10.667,"5min":4.758,"15min":2.573},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":153.999,"5min":153.999,"15min":153.999},"last":1.8320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":613588,"kb_used_data":572940,"kb_used_omap":0,"kb_used_meta":40640,"kb_avail":93758252,"statfs":{"total":96636764160,"available":96008450048,"internally_reserved":0,"allocated":586690560,"data_stored":614157248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41615360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":3.8290000000000002,"15min":4.7629999999999999},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":9.2599999999999998,"5min":94.671999999999997,"15min":94.671999999999997},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3979999999999999,"5min":4.5099999999999998,"15min":2.8420000000000001},"min":{"1min":0.61799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.3369999999999997,"5min":218.80099999999999,"15min":218.80099999999999},"last":1.161}]},{"osd":2,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":6.1109999999999998,"15min":10.724},"min":{"1min":0.60699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":37.590000000000003,"5min":106.374,"15min":106.374},"last":0.998},{"interface":"front","average":{"1min":3.9159999999999999,"5min":18.167999999999999,"15min":47.347999999999999},"min":{"1min":0.67000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":62.494999999999997,"5min":497.91500000000002,"15min":497.91500000000002},"last":1.2090000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":3.3580000000000001,"15min":2.4969999999999999},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.528,"5min":176.02699999999999,"15min":176.02699999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":6.5469999999999997,"5min":2.7210000000000001,"15min":2.2480000000000002},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":48.159999999999997,"5min":48.159999999999997,"15min":48.159999999999997},"last":1.256}]},{"osd":4,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":5.4749999999999996,"5min":11.779,"15min":21.771000000000001},"min":{"1min":0.78800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":91.885999999999996,"5min":248.709,"15min":248.709},"last":1.8400000000000001},{"interface":"front","average":{"1min":10.771000000000001,"5min":20.896000000000001,"15min":34.020000000000003},"min":{"1min":0.92400000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":94.790000000000006,"5min":315.69400000000002,"15min":315.69400000000002},"last":1.7769999999999999}]},{"osd":5,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":5.2300000000000004,"5min":20.780999999999999,"15min":51.606000000000002},"min":{"1min":0.97599999999999998,"5min":0.622,"15min":0.622},"max":{"1min":66.656999999999996,"5min":540.08900000000006,"15min":540.08900000000006},"last":1.7549999999999999},{"interface":"front","average":{"1min":3.895,"5min":10.922000000000001,"15min":13.324},"min":{"1min":0.93600000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":55.593000000000004,"5min":176.32599999999999,"15min":176.32599999999999},"last":1.9419999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":7.5250000000000004,"5min":16.742000000000001,"15min":30.303999999999998},"min":{"1min":0.88100000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":62.244999999999997,"5min":240.36600000000001,"15min":240.36600000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":24.437000000000001,"15min":62.009999999999998},"min":{"1min":1.151,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.456,"5min":498.05399999999997,"15min":498.05399999999997},"last":1.964}]},{"osd":7,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":34.844000000000001,"15min":113.08499999999999},"min":{"1min":1.129,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3029999999999999,"5min":1663.876,"15min":1663.876},"last":1.865},{"interface":"front","average":{"1min":7.1310000000000002,"5min":31.765999999999998,"15min":97.912999999999997},"min":{"1min":1.157,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":101.224,"5min":844.65300000000002,"15min":844.65300000000002},"last":2.0299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255172,"kb_used_data":227004,"kb_used_omap":0,"kb_used_meta":28160,"kb_avail":94116668,"statfs":{"total":96636764160,"available":96375468032,"internally_reserved":0,"allocated":232452096,"data_stored":245001212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28835840},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":3.6150000000000002,"5min":3.8660000000000001,"15min":1.8120000000000001},"min":{"1min":0.54200000000000004,"5min":0.443,"15min":0.443},"max":{"1min":54.290999999999997,"5min":72.322000000000003,"15min":72.322000000000003},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.419,"5min":22.989999999999998,"15min":58.119},"min":{"1min":0.52900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":9.8650000000000002,"5min":465.05200000000002,"15min":465.05200000000002},"last":0.89100000000000001}]},{"osd":1,"last update":"Sun May 1 04:30:41 2022","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":14.868,"15min":17.003},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":9.3889999999999993,"5min":153.101,"15min":153.101},"last":0.92700000000000005},{"interface":"front","average":{"1min":3.2469999999999999,"5min":2.8300000000000001,"15min":1.5489999999999999},"min":{"1min":0.621,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":52.039000000000001,"5min":117.398,"15min":117.398},"last":1.145}]},{"osd":3,"last update":"Sun May 1 04:30:08 2022","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.212,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.390000000000001,"5min":21.312000000000001,"15min":21.312000000000001},"last":1.29},{"interface":"front","average":{"1min":1.034,"5min":0.93799999999999994,"15min":0.90600000000000003},"min":{"1min":0.73999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0760000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":2.7200000000000002,"5min":5.6219999999999999,"15min":13.254},"min":{"1min":0.88300000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":35.039999999999999,"5min":147.17099999999999,"15min":147.17099999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":2.2959999999999998,"5min":11.9,"15min":31.994},"min":{"1min":0.89200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":26.298999999999999,"5min":240.71000000000001,"15min":240.71000000000001},"last":1.206}]},{"osd":5,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":11.964,"15min":14.513},"min":{"1min":0.85799999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":13.206,"5min":260.42099999999999,"15min":260.42099999999999},"last":1.383},{"interface":"front","average":{"1min":1.4139999999999999,"5min":4.7229999999999999,"15min":11.933999999999999},"min":{"1min":0.98199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.492,"5min":196.74799999999999,"15min":196.74799999999999},"last":1.655}]},{"osd":6,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":10.991,"5min":8.7520000000000007,"15min":20.745999999999999},"min":{"1min":0.82799999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":174.387,"5min":174.387,"15min":174.387},"last":1.353},{"interface":"front","average":{"1min":1.7849999999999999,"5min":16.550999999999998,"15min":34.046999999999997},"min":{"1min":0.93000000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":13.034000000000001,"5min":269.53100000000001,"15min":269.53100000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.4970000000000001,"15min":1.744},"min":{"1min":1.0289999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":4.008,"5min":11.654999999999999,"15min":11.654999999999999},"last":1.464},{"interface":"front","average":{"1min":1.873,"5min":10.037000000000001,"15min":15.815},"min":{"1min":1.05,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":13.332000000000001,"5min":160.547,"15min":160.547},"last":1.623}]}]},{"osd":3,"up_from":105,"seq":450971566126,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":695516,"kb_used_data":665620,"kb_used_omap":2,"kb_used_meta":29885,"kb_avail":93676324,"statfs":{"total":96636764160,"available":95924555776,"internally_reserved":0,"allocated":681594880,"data_stored":700583997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":30602427},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":4.7389999999999999,"15min":6.298},"min":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":73.262,"15min":73.262},"last":0.63900000000000001},{"interface":"front","average":{"1min":7.7329999999999997,"5min":6.2919999999999998,"15min":7.1989999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":72.561000000000007,"5min":97.546999999999997,"15min":97.546999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun May 1 04:30:40 2022","interfaces":[{"interface":"back","average":{"1min":6.1150000000000002,"5min":2.4169999999999998,"15min":1.387},"min":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":79.268000000000001,"5min":79.268000000000001,"15min":79.268000000000001},"last":0.749},{"interface":"front","average":{"1min":3.6040000000000001,"5min":2.262,"15min":1.3360000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":42.411000000000001,"5min":51.715000000000003,"15min":51.715000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":0.94399999999999995},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.841,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":5.4009999999999998,"5min":4.351,"15min":4.7690000000000001},"min":{"1min":0.748,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":73.284000000000006,"5min":83.582999999999998,"15min":83.582999999999998},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":14.065,"5min":6.859,"15min":4.4889999999999999},"min":{"1min":0.80500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":88.811000000000007,"5min":97.501999999999995,"15min":97.501999999999995},"last":1.018},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.3220000000000001,"15min":2.8300000000000001},"min":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7150000000000001,"5min":42.081000000000003,"15min":42.081000000000003},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3029999999999999,"15min":1.284},"min":{"1min":1.0660000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.885,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.353},{"interface":"front","average":{"1min":5.4340000000000002,"5min":4.4109999999999996,"15min":3.9750000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":72.870000000000005,"5min":91.775999999999996,"15min":91.775999999999996},"last":1.27}]},{"osd":6,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":2.681,"15min":1.7549999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":60.124000000000002,"5min":78.131,"15min":78.131},"last":1.1279999999999999},{"interface":"front","average":{"1min":3.6890000000000001,"5min":4.7919999999999998,"15min":4.3760000000000003},"min":{"1min":1.0840000000000001,"5min":1.014,"15min":1.014},"max":{"1min":39.942999999999998,"5min":89.192999999999998,"15min":89.192999999999998},"last":1.246}]},{"osd":7,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":7.8170000000000002,"5min":2.6709999999999998,"15min":1.8169999999999999},"min":{"1min":0.98599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":73.015000000000001,"5min":73.015000000000001,"15min":73.015000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":6.5549999999999997,"5min":3.1709999999999998,"15min":1.954},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":89.414000000000001,"5min":89.414000000000001,"15min":89.414000000000001},"last":1.389}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":833920,"kb_used_data":778360,"kb_used_omap":0,"kb_used_meta":55552,"kb_avail":93537920,"statfs":{"total":96636764160,"available":95782830080,"internally_reserved":0,"allocated":797040640,"data_stored":838331730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56885248},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":5.0339999999999998,"5min":13.298999999999999,"15min":22.567},"min":{"1min":0.499,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":78.052999999999997,"5min":257.822,"15min":257.822},"last":0.63},{"interface":"front","average":{"1min":7.0049999999999999,"5min":9.2729999999999997,"15min":21.509},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":58.395000000000003,"5min":256.291,"15min":256.291},"last":1.171}]},{"osd":1,"last update":"Sun May 1 04:30:42 2022","interfaces":[{"interface":"back","average":{"1min":4.0570000000000004,"5min":5.4969999999999999,"15min":6.1210000000000004},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":66.712999999999994,"5min":91.667000000000002,"15min":91.667000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":4.5990000000000002,"15min":2.464},"min":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.284,"5min":129.15799999999999,"15min":129.15799999999999},"last":0.92400000000000004}]},{"osd":2,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":8.8599999999999994,"15min":20.228000000000002},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.2669999999999999,"5min":256.45999999999998,"15min":256.45999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":6.8630000000000004,"15min":14.843},"min":{"1min":0.74099999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":174.048,"15min":174.048},"last":1.111}]},{"osd":3,"last update":"Sun May 1 04:30:11 2022","interfaces":[{"interface":"back","average":{"1min":6.1619999999999999,"5min":4.6959999999999997,"15min":4.4619999999999997},"min":{"1min":0.80700000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":97.203999999999994,"5min":97.203999999999994,"15min":97.203999999999994},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":3.8929999999999998,"15min":3.2010000000000001},"min":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3260000000000001,"5min":91.527000000000001,"15min":91.527000000000001},"last":1.256}]},{"osd":5,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.4220000000000002,"5min":12.462999999999999,"15min":23.196999999999999},"min":{"1min":0.65500000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":27.620000000000001,"5min":159.648,"15min":159.648},"last":1.077},{"interface":"front","average":{"1min":1.0940000000000001,"5min":10.414,"15min":29.292000000000002},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4350000000000001,"5min":256.18799999999999,"15min":256.18799999999999},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.8769999999999998,"5min":9.3179999999999996,"15min":16.654},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":34.543999999999997,"5min":174.274,"15min":174.274},"last":1.3540000000000001},{"interface":"front","average":{"1min":5.2380000000000004,"5min":13.058,"15min":24.372},"min":{"1min":0.91600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":54.326999999999998,"5min":231.74799999999999,"15min":231.74799999999999},"last":1.206}]},{"osd":7,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":15.888,"15min":48.289999999999999},"min":{"1min":0.998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":16.422000000000001,"5min":652.226,"15min":652.226},"last":1.381},{"interface":"front","average":{"1min":9.3469999999999995,"5min":20.452999999999999,"15min":46.524999999999999},"min":{"1min":0.94799999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":106.176,"5min":376.32900000000001,"15min":376.32900000000001},"last":1.4530000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":470204,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":481488896,"data_stored":496073002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.6230000000000002,"5min":14.685,"15min":33.274000000000001},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":63.991999999999997,"5min":334.69799999999998,"15min":334.69799999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":13.112,"5min":13.273,"15min":21.361000000000001},"min":{"1min":0.76800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":106.07899999999999,"5min":282.01999999999998,"15min":282.01999999999998},"last":1.0940000000000001}]},{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":5.5499999999999998,"5min":3.177,"15min":1.6739999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":110.831,"5min":110.831,"15min":110.831},"last":0.98099999999999998},{"interface":"front","average":{"1min":4.25,"5min":3.0640000000000001,"15min":1.599},"min":{"1min":0.69599999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":40.506,"5min":58.759,"15min":58.759},"last":1.014}]},{"osd":2,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":8.2409999999999997,"5min":3.5129999999999999,"15min":4.2510000000000003},"min":{"1min":0.58399999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":106.206,"5min":106.206,"15min":106.206},"last":0.93700000000000006},{"interface":"front","average":{"1min":5.3499999999999996,"5min":4.0759999999999996,"15min":9.5099999999999998},"min":{"1min":0.66700000000000004,"5min":0.621,"15min":0.621},"max":{"1min":110.908,"5min":150.518,"15min":150.518},"last":1.4159999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:10 2022","interfaces":[{"interface":"back","average":{"1min":5.3099999999999996,"5min":1.879,"15min":1.3069999999999999},"min":{"1min":0.751,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":110.706,"5min":110.706,"15min":110.706},"last":1.2},{"interface":"front","average":{"1min":7.556,"5min":2.3849999999999998,"15min":1.486},"min":{"1min":0.84699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":76.444000000000003,"5min":76.444000000000003,"15min":76.444000000000003},"last":1.1319999999999999}]},{"osd":4,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":11.669,"15min":36.732999999999997},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4339999999999999,"5min":385.29300000000001,"15min":385.29300000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":11.545999999999999,"5min":11.125,"15min":19.908000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":106.327,"5min":189.869,"15min":189.869},"last":1.2490000000000001}]},{"osd":6,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":12.663,"15min":28.815000000000001},"min":{"1min":0.80700000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":110.61199999999999,"5min":332.26299999999998,"15min":332.26299999999998},"last":1.327},{"interface":"front","average":{"1min":1.827,"5min":7,"15min":17.992999999999999},"min":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":17.824000000000002,"5min":295.99299999999999,"15min":295.99299999999999},"last":1.2310000000000001}]},{"osd":7,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":12.597,"5min":31.109999999999999,"15min":93.878},"min":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":152.393,"5min":1543.201,"15min":1543.201},"last":1.5629999999999999},{"interface":"front","average":{"1min":9.4559999999999995,"5min":6.2789999999999999,"15min":12.819000000000001},"min":{"1min":0.89100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":110.771,"5min":150.71100000000001,"15min":150.71100000000001},"last":1.488}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":582623232,"data_stored":612072706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":549437440,"data_stored":577287569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":652007,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":228917248,"data_stored":243445598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":678060032,"data_stored":699028383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":793505792,"data_stored":836776116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":477954048,"data_stored":494517388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":564805632,"data_stored":586633428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":774414336,"data_stored":805906053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-05-01T04:30:51.074 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-01T10:42:31.224 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:56.855 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2022-05-01T04:30:44.650869+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=44, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:30:56.856 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-05-01T04:29:49.588383+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=29, tm_sec=49, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:30:56.856 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2022-05-01T04:28:11.783670+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=28, tm_sec=11, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) 2022-05-01T10:42:31.225 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:31:37.605 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2022-05-01T04:29:39.348483+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=29, tm_sec=39, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:31:37.607 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2022-05-01T04:30:48.005729+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=48, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:31:37.607 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2022-05-01T04:30:43.097017+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=43, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) 2022-05-01T10:42:31.225 WARNING:scrape:Ignoring malparsed backtrace: raise CommandCrashedError(command=self.command) , teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --balance-reads --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' , 2022-05-01T04:32:18.690 INFO:teuthology.misc:Shutting down mds daemons... 2022-05-01T10:42:31.226 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:32:22.368 DEBUG:teuthology.orchestra.run.smithi061:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2022-05-01T04:32:22.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2022-05-01T04:32:51.327 INFO:tasks.ceph:Archiving logs... 2022-05-01T10:42:31.226 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:33:23.756 INFO:teuthology.task.internal:Transferring binaries for coredumps... , 2022-05-01T04:33:23.798 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/rfriedma-2022-04-30_17:51:41-rados:thrash-wip-rf-80cls-v1-distro-basic-smithi/6816343/remote/smithi061/coredump/1651379397.97363.core.gz: gzip compressed data, was "1651379397.97363.core", last modified: Sun May 1 04:33:05 2022, max compression , 2022-05-01T10:42:31.471 WARNING:scrape:Ignoring malparsed backtrace: ceph version 17.0.0-11854-g7e2ba75f (7e2ba75f07d12b6d8e925d4291e3d3c5168d80cb) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f59310de114] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x285335) [0x7f59310de335] 2022-05-01T10:42:31.472 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 165.34371991500001, , 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.79822107499999995, , 2022-05-01T04:29:58.376 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:31.472 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", , 2022-05-01T04:29:58.386 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:27:13.021813+0000", 2022-05-01T10:42:31.472 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "commit_sent", , 2022-05-01T04:29:58.404 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:27:15.429554+0000", 2022-05-01T10:42:31.473 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:27:14.821435+0000", , 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 163.54397385499999, , 2022-05-01T04:29:58.432 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.61002250300000005, 2022-05-01T10:42:31.473 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.462 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.463 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.463 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "dispatched", 2022-05-01T10:42:31.473 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.475 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting_for_map not empty", 2022-05-01T10:42:31.473 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.502 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.503 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.503 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:31.474 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.525 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", 2022-05-01T10:42:31.474 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.547 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.474 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.568 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.569 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.569 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for degraded object", 2022-05-01T10:42:31.475 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.580 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:31.475 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.591 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.475 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.601 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.601 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.602 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for subops from 6,7", 2022-05-01T10:42:31.475 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:29:58.613 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.476 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "description": "osd_op(client.4455.0:7064 3.5 3:a09ddd8e:::smithi06197363-888:head [write 1929332~491206] snapc c8=[c8,c6,c5,c4,c3,c1,be,b5,b4,b0,ac,a8,a2] ondisk+write+known_if_redirected+supports_pool_eio e244)", , 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:29:27.804769+0000", , 2022-05-01T04:29:58.625 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 30.560639985999998, 2022-05-01T10:42:31.476 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.642 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.476 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 5.7226999999999999e-05 , 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:29:58.659 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.476 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.5339809390000001, , 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { , 2022-05-01T04:29:59.189 INFO:teuthology.orchestra.run.smithi136.stdout: "flag_point": "commit sent; apply or cleanup", 2022-05-01T10:42:31.477 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", , 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 140 , 2022-05-01T04:29:59.204 INFO:teuthology.orchestra.run.smithi136.stdout: }, 2022-05-01T10:42:31.477 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", , 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.254057+0000", , 2022-05-01T04:29:59.221 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 3.9273000000000002e-05 2022-05-01T10:42:31.477 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.889696+0000", , 2022-05-01T04:29:59.231 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.63557935899999995 2022-05-01T10:42:31.477 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:36.308535+0000", , 2022-05-01T04:29:59.243 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.143439328 2022-05-01T10:42:31.478 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:36.532607+0000", , 2022-05-01T04:29:59.253 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.22404791199999999 2022-05-01T10:42:31.478 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 256.59385050200001, , 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.451711459, , 2022-05-01T04:29:59.263 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2022-05-01T10:42:31.478 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.273 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.274 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", , 2022-05-01T04:29:59.274 INFO:teuthology.orchestra.run.smithi136.stdout: "tid": 2885 2022-05-01T10:42:31.478 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "all_read", , 2022-05-01T04:29:59.285 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.150976+0000", 2022-05-01T10:42:31.478 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.297 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.823546+0000", 2022-05-01T10:42:31.479 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:29:59.310 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.924465+0000", 2022-05-01T10:42:31.479 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.320 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.321 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.321 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:50.640007+0000", 2022-05-01T10:42:31.479 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:29:59.331 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:50.640570+0000", 2022-05-01T10:42:31.482 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:29:59.341 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.101230+0000", 2022-05-01T10:42:31.482 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.351 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.482 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.361 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", 2022-05-01T10:42:31.483 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.371 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.372 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for degraded object", 2022-05-01T10:42:31.483 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.778 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 600, , 2022-05-01T04:29:59.778 INFO:teuthology.orchestra.run.smithi136.stdout: "ops": [ , 2022-05-01T04:29:59.779 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.484 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.788 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.789 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", , 2022-05-01T04:29:59.789 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.258436+0000", 2022-05-01T10:42:31.484 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:29:59.799 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.259144+0000", 2022-05-01T10:42:31.484 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", , 2022-05-01T04:29:59.809 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:49.259193+0000", 2022-05-01T10:42:31.485 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:29:59.820 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.331931+0000", 2022-05-01T10:42:31.485 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:29:59.830 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:51.847377+0000", 2022-05-01T10:42:31.485 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 2,3", , 2022-05-01T04:29:59.840 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:52.042695+0000", 2022-05-01T10:42:31.486 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.849 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.849 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:29:59.850 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:52.457260+0000", 2022-05-01T10:42:31.486 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2022-05-01T04:25:49.424986+0000", , 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 250.35124122400001, , 2022-05-01T04:29:59.859 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 2.6264513410000001, 2022-05-01T10:42:31.487 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:29:59.869 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.487 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ , 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.884 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2022-05-01T10:42:31.487 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.895 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2022-05-01T10:42:31.487 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.906 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2022-05-01T10:42:31.488 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.916 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", 2022-05-01T10:42:31.488 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.926 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", 2022-05-01T10:42:31.488 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.982 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.982 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.983 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 6,7", 2022-05-01T10:42:31.488 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:29:59.994 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2022-05-01T10:42:31.489 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.004 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:31.489 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.015 INFO:teuthology.orchestra.run.smithi136.stdout: } , 2022-05-01T04:30:00.016 INFO:teuthology.orchestra.run.smithi136.stdout: ] , 2022-05-01T04:30:00.016 INFO:teuthology.orchestra.run.smithi136.stdout: } 2022-05-01T10:42:31.490 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.422013+0000", , 2022-05-01T04:30:00.436 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.40178407399999999 2022-05-01T10:42:31.490 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.448 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 272.10812970900002, , 2022-05-01T04:30:00.448 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.1152526899999999, , 2022-05-01T04:30:00.449 INFO:teuthology.orchestra.run.smithi136.stdout: "type_data": { 2022-05-01T10:42:31.490 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:30:00.463 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.307854+0000", 2022-05-01T10:42:31.491 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.475 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.476 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "dispatched", , 2022-05-01T04:30:00.476 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:28.307960+0000", 2022-05-01T10:42:31.491 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:00.490 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.523043+0000", 2022-05-01T10:42:31.491 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:30:00.500 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:29.928874+0000", 2022-05-01T10:42:31.492 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:30:00.510 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.492 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.521 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "queued_for_pg", 2022-05-01T10:42:31.492 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.532 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.532 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.533 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for subops from 1,4", 2022-05-01T10:42:31.493 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.543 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "op_commit", 2022-05-01T10:42:31.493 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:00.554 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:31.493 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: } , 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: ] , 2022-05-01T04:30:00.564 INFO:teuthology.orchestra.run.smithi136.stdout: } 2022-05-01T10:42:31.493 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "description": "osd_op(client.4455.0:1778 3.a 3:53a403a1:::smithi06197363-398:head [read 0~1] snapc 0=[] ondisk+read+rwordered+known_if_redirected+supports_pool_eio e24)", , 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "initiated_at": "2022-05-01T04:25:36.695333+0000", , 2022-05-01T04:30:00.575 INFO:teuthology.orchestra.run.smithi136.stdout: "age": 263.72001420200002, 2022-05-01T10:42:31.494 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0 , 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.595 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.494 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.606 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4294967295.99999 , 2022-05-01T04:30:00.606 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.607 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.494 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.101112457 , 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.618 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.494 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 4.7070999999999997e-05 , 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:00.630 INFO:teuthology.orchestra.run.smithi136.stdout: { 2022-05-01T10:42:31.495 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.045 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.821119+0000", , 2022-05-01T04:30:01.046 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 5.6906e-05 2022-05-01T10:42:31.495 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:42.446962+0000", , 2022-05-01T04:30:01.126 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.52507275200000003 2022-05-01T10:42:31.495 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "started", , 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:42.450351+0000", , 2022-05-01T04:30:01.137 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 8.9092999999999996e-05 2022-05-01T10:42:31.495 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.147 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.148 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.561503+0000", , 2022-05-01T04:30:01.148 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 1.0105489990000001 2022-05-01T10:42:31.496 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", , 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.866227+0000", , 2022-05-01T04:30:01.158 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 0.000105265 2022-05-01T10:42:31.496 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.175 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "done", , 2022-05-01T04:30:01.176 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.866671+0000", , 2022-05-01T04:30:01.176 INFO:teuthology.orchestra.run.smithi136.stdout: "duration": 6.1624000000000005e-05 2022-05-01T10:42:31.496 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", , 2022-05-01T04:30:01.187 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.582716+0000", 2022-05-01T10:42:31.496 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.197 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.198 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", , 2022-05-01T04:30:01.198 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.582989+0000", 2022-05-01T10:42:31.497 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "header_read", , 2022-05-01T04:30:01.207 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:41.583036+0000", 2022-05-01T10:42:31.497 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.217 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.459659+0000", 2022-05-01T10:42:31.497 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.226 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.459820+0000", 2022-05-01T10:42:31.498 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.242 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.243 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.869578+0000", 2022-05-01T10:42:31.498 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.263 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "waiting for rw locks", , 2022-05-01T04:30:01.266 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:43.870154+0000", 2022-05-01T10:42:31.498 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.276 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:01.277 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:44.477163+0000", 2022-05-01T10:42:31.498 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.287 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "commit_sent", , 2022-05-01T04:30:01.288 INFO:teuthology.orchestra.run.smithi136.stdout: "time": "2022-05-01T04:25:44.576950+0000", 2022-05-01T10:42:31.499 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.299 INFO:teuthology.orchestra.run.smithi136.stdout: "client_info": { , 2022-05-01T04:30:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "client": "client.4455", , 2022-05-01T04:30:01.300 INFO:teuthology.orchestra.run.smithi136.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.499 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "events": [ , 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.310 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "initiated", 2022-05-01T10:42:31.500 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: }, , 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: { , 2022-05-01T04:30:01.320 INFO:teuthology.orchestra.run.smithi136.stdout: "event": "throttled", 2022-05-01T10:42:31.500 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 1.8369999999999999e-05 , 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.463 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.500 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.100218394 , 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.766 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.501 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.786 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:52.881169+0000", , 2022-05-01T04:30:01.787 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 1.9573e-05 , 2022-05-01T04:30:01.787 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-05-01T10:42:31.501 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "throttled", , 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:57.746561+0000", , 2022-05-01T04:30:01.799 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 2022-05-01T10:42:31.501 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 3.7012903449999999, , 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.2022516, , 2022-05-01T04:30:01.818 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:31.502 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", , 2022-05-01T04:30:01.833 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:58.569471+0000", 2022-05-01T10:42:31.502 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.843 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", 2022-05-01T10:42:31.502 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.00045464499999999999 , 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:01.854 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.503 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:59.998668+0000", , 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:30:01.867 INFO:teuthology.orchestra.run.smithi061.stdout: }, 2022-05-01T10:42:31.503 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.10288931900000001, , 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { , 2022-05-01T04:30:01.884 INFO:teuthology.orchestra.run.smithi061.stdout: "flag_point": "started", 2022-05-01T10:42:31.503 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", , 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:30:00.993658+0000", , 2022-05-01T04:30:01.896 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.0014074020000000001 2022-05-01T10:42:31.503 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "reached_pg", , 2022-05-01T04:30:01.909 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:30:01.503016+0000", 2022-05-01T10:42:31.504 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.402 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 30.478786020000001, , 2022-05-01T04:30:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.41085582700000001, , 2022-05-01T04:30:02.403 INFO:teuthology.orchestra.run.smithi061.stdout: "type_data": { 2022-05-01T10:42:31.504 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "dispatched", , 2022-05-01T04:30:02.417 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:31.918835+0000", 2022-05-01T10:42:31.504 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "queued_for_pg", , 2022-05-01T04:30:02.430 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:32.019048+0000", 2022-05-01T10:42:31.504 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "waiting for blocked object", , 2022-05-01T04:30:02.447 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:32.368585+0000", 2022-05-01T10:42:31.505 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "op_commit", , 2022-05-01T04:30:02.465 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.083575+0000", 2022-05-01T10:42:31.505 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:02.476 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.192148+0000", 2022-05-01T10:42:31.505 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", , 2022-05-01T04:30:02.486 INFO:teuthology.orchestra.run.smithi061.stdout: "time": "2022-05-01T04:29:42.491318+0000", 2022-05-01T10:42:31.505 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: "events": [ , 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.501 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "initiated", 2022-05-01T10:42:31.506 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client_info": { , 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client": "client.4455", , 2022-05-01T04:30:02.516 INFO:teuthology.orchestra.run.smithi061.stdout: "client_addr": "172.21.15.61:0/140381418", 2022-05-01T10:42:31.506 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "initiated_at": "2022-05-01T04:29:42.789238+0000", , 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "age": 19.608178676000001, , 2022-05-01T04:30:02.539 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0.40311962699999998, 2022-05-01T10:42:31.506 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.551 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.552 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "header_read", 2022-05-01T10:42:31.507 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.563 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "throttled", 2022-05-01T10:42:31.507 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.579 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "header_read", 2022-05-01T10:42:31.507 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.597 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.598 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.598 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "all_read", 2022-05-01T10:42:31.508 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.608 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "started", 2022-05-01T10:42:31.508 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.624 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "sub_op_commit_rec", 2022-05-01T10:42:31.509 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: { , 2022-05-01T04:30:02.640 INFO:teuthology.orchestra.run.smithi061.stdout: "event": "done", 2022-05-01T10:42:31.509 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: "duration": 0 , 2022-05-01T04:30:02.659 INFO:teuthology.orchestra.run.smithi061.stdout: }, , 2022-05-01T04:30:02.660 INFO:teuthology.orchestra.run.smithi061.stdout: { 2022-05-01T10:42:31.509 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:13.025 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 , reweighted osd.7 to 1 (10000) , 2022-05-01T04:30:14.038 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2022-05-01T10:42:31.515 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:23.813 INFO:teuthology.orchestra.run.smithi061.stdout: , dumped all , 2022-05-01T04:30:23.825 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":446,"stamp":"2022-05-01T04:30:23.278784+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3095203105,"num_objects":1168,"num_object_clones":201,"num_object_copies":3504,"num_objects_missing_on_primary":82,"num_objects_missing":82,"num_objects_degraded":133,"num_objects_misplaced":309,"num_objects_unfound":0,"num_objects_dirty":1168,"num_whiteouts":30,"num_read":3828,"num_read_kb":1765564,"num_write":7625,"num_write_kb":2038597,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3548,"num_bytes_recovered":3906462674,"num_keys_recovered":1880,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12998,"ondisk_log_size":12998,"up":105,"acting":103,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":131,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":5618844,"kb_used_data":5318748,"kb_used_omap":655,"kb_used_meta":299376,"kb_avail":749355876,"statfs":{"total":773094113280,"available":767340417024,"internally_reserved":0,"allocated":5446397952,"data_stored":5679194944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":671085,"internal_metadata":306561683},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,1,4],"upper_bound":256},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":-74,"num_objects_missing":-74,"num_objects_degraded":-142,"num_objects_misplaced":-72,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-39,"num_bytes_recovered":-47056945,"num_keys_recovered":60,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.225277"},"pg_stats":[{"pgid":"3.19","version":"272'501","reported_seq":1324,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177697+0000","last_change":"2022-05-01T04:30:11.500632+0000","last_active":"2022-05-01T04:30:19.177697+0000","last_peered":"2022-05-01T04:30:19.177697+0000","last_clean":"2022-05-01T04:30:19.177697+0000","last_became_active":"2022-05-01T04:30:11.294414+0000","last_became_peered":"2022-05-01T04:30:11.294414+0000","last_unstale":"2022-05-01T04:30:19.177697+0000","last_undegraded":"2022-05-01T04:30:19.177697+0000","last_fullsized":"2022-05-01T04:30:19.177697+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":5,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":501,"ondisk_log_size":501,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.205175364,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":114,"num_read_kb":82076,"num_write":204,"num_write_kb":57354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":40234521,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.18","version":"273'465","reported_seq":2334,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277719+0000","last_change":"2022-05-01T04:30:15.339106+0000","last_active":"2022-05-01T04:30:19.277719+0000","last_peered":"2022-05-01T04:30:19.277719+0000","last_clean":"2022-05-01T04:30:19.277719+0000","last_became_active":"2022-05-01T04:30:15.336684+0000","last_became_peered":"2022-05-01T04:30:15.336684+0000","last_unstale":"2022-05-01T04:30:19.277719+0000","last_undegraded":"2022-05-01T04:30:19.277719+0000","last_fullsized":"2022-05-01T04:30:19.277719+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":5,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.001352624,"stat_sum":{"num_bytes":96164905,"num_objects":40,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":2,"num_read":116,"num_read_kb":48609,"num_write":277,"num_write_kb":64535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":249,"num_bytes_recovered":275012362,"num_keys_recovered":150,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.17","version":"273'533","reported_seq":1864,"reported_epoch":295,"state":"active+recovery_wait+degraded","last_fresh":"2022-05-01T04:30:19.057547+0000","last_change":"2022-05-01T04:30:07.304715+0000","last_active":"2022-05-01T04:30:19.057547+0000","last_peered":"2022-05-01T04:30:19.057547+0000","last_clean":"2022-05-01T04:29:49.419159+0000","last_became_active":"2022-05-01T04:30:07.303342+0000","last_became_peered":"2022-05-01T04:30:07.303342+0000","last_unstale":"2022-05-01T04:30:19.057547+0000","last_undegraded":"2022-05-01T04:30:06.968327+0000","last_fullsized":"2022-05-01T04:30:19.057547+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":207,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":533,"ondisk_log_size":533,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":12,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":90,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":145444603,"num_keys_recovered":30,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":["0","4","7"],"object_location_counts":[{"shards":"0,3,4,7","objects":18},{"shards":"0,3,5","objects":-1},{"shards":"0,4,7","objects":26},{"shards":"0,7","objects":4}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"1"}]},{"pgid":"3.16","version":"275'571","reported_seq":1900,"reported_epoch":296,"state":"peering","last_fresh":"2022-05-01T04:30:20.074891+0000","last_change":"2022-05-01T04:30:20.075228+0000","last_active":"2022-05-01T04:29:59.794431+0000","last_peered":"2022-05-01T04:29:59.192384+0000","last_clean":"2022-05-01T04:29:59.192384+0000","last_became_active":"2022-05-01T04:29:59.190893+0000","last_became_peered":"2022-05-01T04:29:59.190893+0000","last_unstale":"2022-05-01T04:30:20.074891+0000","last_undegraded":"2022-05-01T04:30:20.074891+0000","last_fullsized":"2022-05-01T04:30:20.074891+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":5,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":571,"ondisk_log_size":571,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.00047920800000000001,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":113,"num_read_kb":54635,"num_write":201,"num_write_kb":69191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967346,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[0,1,3,4,7],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.15","version":"261'465","reported_seq":1966,"reported_epoch":296,"state":"active+recovering","last_fresh":"2022-05-01T04:30:20.587146+0000","last_change":"2022-05-01T04:30:19.922879+0000","last_active":"2022-05-01T04:30:20.587146+0000","last_peered":"2022-05-01T04:30:20.587146+0000","last_clean":"2022-05-01T04:29:44.969856+0000","last_became_active":"2022-05-01T04:30:17.351913+0000","last_became_peered":"2022-05-01T04:30:17.351913+0000","last_unstale":"2022-05-01T04:30:20.587146+0000","last_undegraded":"2022-05-01T04:30:20.587146+0000","last_fullsized":"2022-05-01T04:30:20.587146+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":5,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":33,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79997673,"num_objects":32,"num_object_clones":5,"num_object_copies":96,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":60,"num_objects_unfound":0,"num_objects_dirty":32,"num_whiteouts":1,"num_read":104,"num_read_kb":29450,"num_write":244,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":193,"num_bytes_recovered":208364605,"num_keys_recovered":150,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":["7","2","6"],"object_location_counts":[{"shards":"2,6,7","objects":30},{"shards":"3,4,7","objects":2}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.14","version":"264'361","reported_seq":1626,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155646+0000","last_change":"2022-05-01T04:30:13.108744+0000","last_active":"2022-05-01T04:30:19.155646+0000","last_peered":"2022-05-01T04:30:19.155646+0000","last_clean":"2022-05-01T04:30:19.155646+0000","last_became_active":"2022-05-01T04:30:13.107986+0000","last_became_peered":"2022-05-01T04:30:13.107986+0000","last_unstale":"2022-05-01T04:30:19.155646+0000","last_undegraded":"2022-05-01T04:30:19.155646+0000","last_fullsized":"2022-05-01T04:30:19.155646+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":5,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83569378,"num_objects":30,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":179,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":132378397,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.13","version":"296'566","reported_seq":1353,"reported_epoch":296,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:20.480444+0000","last_change":"2022-05-01T04:30:20.287148+0000","last_active":"2022-05-01T04:30:20.480444+0000","last_peered":"2022-05-01T04:30:20.480444+0000","last_clean":"2022-05-01T04:30:20.480444+0000","last_became_active":"2022-05-01T04:30:20.285780+0000","last_became_peered":"2022-05-01T04:30:20.285780+0000","last_unstale":"2022-05-01T04:30:20.480444+0000","last_undegraded":"2022-05-01T04:30:20.480444+0000","last_fullsized":"2022-05-01T04:30:20.480444+0000","mapping_epoch":295,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":296,"parent":"0.0","parent_split_bits":5,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":10,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":102081758,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":128,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":56033723,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"2"}]},{"pgid":"3.12","version":"273'535","reported_seq":1795,"reported_epoch":296,"state":"active+recovering+degraded","last_fresh":"2022-05-01T04:30:20.481519+0000","last_change":"2022-05-01T04:30:20.378621+0000","last_active":"2022-05-01T04:30:20.481519+0000","last_peered":"2022-05-01T04:30:20.481519+0000","last_clean":"2022-05-01T04:29:46.967195+0000","last_became_active":"2022-05-01T04:30:07.095952+0000","last_became_peered":"2022-05-01T04:30:07.095952+0000","last_unstale":"2022-05-01T04:30:20.481519+0000","last_undegraded":"2022-05-01T04:30:20.304415+0000","last_fullsized":"2022-05-01T04:30:20.481519+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":230,"parent":"0.0","parent_split_bits":5,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":30,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":8,"num_object_copies":129,"num_objects_missing_on_primary":30,"num_objects_missing":30,"num_objects_degraded":0,"num_objects_misplaced":63,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":2,"num_read":142,"num_read_kb":77693,"num_write":291,"num_write_kb":74977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":130444559,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":["1","4","6"],"object_location_counts":[{"shards":"0,1,4,6","objects":1},{"shards":"0,1,4,6,7","objects":1},{"shards":"0,3,7","objects":21},{"shards":"1,4,6","objects":20}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"}]},{"pgid":"3.11","version":"294'459","reported_seq":1935,"reported_epoch":295,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:19.155957+0000","last_change":"2022-05-01T04:30:16.442516+0000","last_active":"2022-05-01T04:30:19.155957+0000","last_peered":"2022-05-01T04:30:19.155957+0000","last_clean":"2022-05-01T04:30:19.155957+0000","last_became_active":"2022-05-01T04:30:16.337078+0000","last_became_peered":"2022-05-01T04:30:16.337078+0000","last_unstale":"2022-05-01T04:30:19.155957+0000","last_undegraded":"2022-05-01T04:30:19.155957+0000","last_fullsized":"2022-05-01T04:30:19.155957+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":459,"ondisk_log_size":459,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":17,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.0044887349999999998,"stat_sum":{"num_bytes":95657072,"num_objects":39,"num_object_clones":8,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":121,"num_read_kb":76398,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":183552292,"num_keys_recovered":160,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"3"}]},{"pgid":"3.10","version":"273'490","reported_seq":1683,"reported_epoch":296,"state":"active+recovering+undersized+degraded+remapped","last_fresh":"2022-05-01T04:30:20.474618+0000","last_change":"2022-05-01T04:30:20.224873+0000","last_active":"2022-05-01T04:30:20.474618+0000","last_peered":"2022-05-01T04:30:20.474618+0000","last_clean":"2022-05-01T04:29:56.885986+0000","last_became_active":"2022-05-01T04:30:02.988629+0000","last_became_peered":"2022-05-01T04:30:02.988629+0000","last_unstale":"2022-05-01T04:30:20.474618+0000","last_undegraded":"2022-05-01T04:30:20.165835+0000","last_fullsized":"2022-05-01T04:30:02.785753+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":5,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":93110779,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":21,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":104,"num_read_kb":46934,"num_write":216,"num_write_kb":63007,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":109,"num_bytes_recovered":114601618,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0],"avail_no_missing":["6","1","2"],"object_location_counts":[{"shards":"0,6","objects":26},{"shards":"1,2,5,6","objects":1},{"shards":"1,2,6","objects":10}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.f","version":"277'540","reported_seq":1300,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.256155+0000","last_change":"2022-05-01T04:30:16.500449+0000","last_active":"2022-05-01T04:30:19.256155+0000","last_peered":"2022-05-01T04:30:19.256155+0000","last_clean":"2022-05-01T04:30:19.256155+0000","last_became_active":"2022-05-01T04:30:16.399454+0000","last_became_peered":"2022-05-01T04:30:16.399454+0000","last_unstale":"2022-05-01T04:30:19.256155+0000","last_undegraded":"2022-05-01T04:30:19.256155+0000","last_fullsized":"2022-05-01T04:30:19.256155+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'412","last_scrub_stamp":"2022-05-01T04:28:16.288822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:16.288822+0000","objects_scrubbed":63,"log_size":540,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81907881800000004,"objects_trimmed":0,"snaptrim_duration":0.72566574800000005,"stat_sum":{"num_bytes":198947307,"num_objects":70,"num_object_clones":8,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":2,"num_read":226,"num_read_kb":100373,"num_write":447,"num_write_kb":118211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":2944186,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.e","version":"276'657","reported_seq":1954,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.156852+0000","last_change":"2022-05-01T04:30:02.666116+0000","last_active":"2022-05-01T04:30:19.156852+0000","last_peered":"2022-05-01T04:30:19.156852+0000","last_clean":"2022-05-01T04:30:19.156852+0000","last_became_active":"2022-05-01T04:29:15.968177+0000","last_became_peered":"2022-05-01T04:29:15.968177+0000","last_unstale":"2022-05-01T04:30:19.156852+0000","last_undegraded":"2022-05-01T04:30:19.156852+0000","last_fullsized":"2022-05-01T04:30:19.156852+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'588","last_scrub_stamp":"2022-05-01T04:29:37.821007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.821007+0000","objects_scrubbed":80,"log_size":657,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:41.870002+0000","scrub_duration":0.62661968000000001,"objects_trimmed":0,"snaptrim_duration":0.88139935800000002,"stat_sum":{"num_bytes":238859551,"num_objects":88,"num_object_clones":14,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":2,"num_read":259,"num_read_kb":84476,"num_write":573,"num_write_kb":169626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":228132670,"num_keys_recovered":80,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.d","version":"273'434","reported_seq":1401,"reported_epoch":295,"state":"active+recovery_wait+degraded","last_fresh":"2022-05-01T04:30:19.156101+0000","last_change":"2022-05-01T04:30:17.631154+0000","last_active":"2022-05-01T04:30:19.156101+0000","last_peered":"2022-05-01T04:30:19.156101+0000","last_clean":"2022-05-01T04:29:49.001379+0000","last_became_active":"2022-05-01T04:30:17.429652+0000","last_became_peered":"2022-05-01T04:30:17.429652+0000","last_unstale":"2022-05-01T04:30:19.156101+0000","last_undegraded":"2022-05-01T04:30:17.148995+0000","last_fullsized":"2022-05-01T04:30:19.156101+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":195,"parent":"0.0","parent_split_bits":0,"last_scrub":"162'315","last_scrub_stamp":"2022-05-01T04:28:14.235007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:14.235007+0000","objects_scrubbed":59,"log_size":434,"ondisk_log_size":434,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":7,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.154700571,"objects_trimmed":0,"snaptrim_duration":0.40905342099999997,"stat_sum":{"num_bytes":173196488,"num_objects":65,"num_object_clones":11,"num_object_copies":195,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":43,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":65,"num_whiteouts":1,"num_read":184,"num_read_kb":90112,"num_write":428,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":79,"num_bytes_recovered":78443415,"num_keys_recovered":60,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":["7","4","6"],"object_location_counts":[{"shards":"4,6,7","objects":26},{"shards":"5,6,7","objects":36},{"shards":"6,7","objects":3}],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"}]},{"pgid":"3.c","version":"265'484","reported_seq":2106,"reported_epoch":296,"state":"active+recovering+remapped","last_fresh":"2022-05-01T04:30:20.384354+0000","last_change":"2022-05-01T04:30:19.827029+0000","last_active":"2022-05-01T04:30:20.384354+0000","last_peered":"2022-05-01T04:30:20.384354+0000","last_clean":"2022-05-01T04:29:48.965884+0000","last_became_active":"2022-05-01T04:30:03.989010+0000","last_became_peered":"2022-05-01T04:30:03.989010+0000","last_unstale":"2022-05-01T04:30:20.384354+0000","last_undegraded":"2022-05-01T04:30:20.384354+0000","last_fullsized":"2022-05-01T04:30:20.384354+0000","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":211,"parent":"0.0","parent_split_bits":0,"last_scrub":"249'466","last_scrub_stamp":"2022-05-01T04:29:36.465699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.465699+0000","objects_scrubbed":62,"log_size":484,"ondisk_log_size":484,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":5,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:52.684317+0000","scrub_duration":0.81548162000000002,"objects_trimmed":1,"snaptrim_duration":0.72789094899999995,"stat_sum":{"num_bytes":167437493,"num_objects":63,"num_object_clones":7,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":91,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":2,"num_read":271,"num_read_kb":161213,"num_write":425,"num_write_kb":112139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":336,"num_bytes_recovered":374094922,"num_keys_recovered":40,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[0,3,6],"avail_no_missing":["0","1","6"],"object_location_counts":[{"shards":"0,1,3,6","objects":27},{"shards":"0,1,6","objects":32},{"shards":"0,3,6","objects":4}],"blocked_by":[],"up_primary":5,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a3","length":"2"},{"start":"a7","length":"1"},{"start":"a9","length":"3"},{"start":"ad","length":"1"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.b","version":"261'397","reported_seq":1739,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277855+0000","last_change":"2022-05-01T04:30:07.810362+0000","last_active":"2022-05-01T04:30:19.277855+0000","last_peered":"2022-05-01T04:30:19.277855+0000","last_clean":"2022-05-01T04:30:19.277855+0000","last_became_active":"2022-05-01T04:30:07.195503+0000","last_became_peered":"2022-05-01T04:30:07.195503+0000","last_unstale":"2022-05-01T04:30:19.277855+0000","last_undegraded":"2022-05-01T04:30:19.277855+0000","last_fullsized":"2022-05-01T04:30:19.277855+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"248'389","last_scrub_stamp":"2022-05-01T04:29:39.348483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.348483+0000","objects_scrubbed":68,"log_size":397,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:42.553069+0000","scrub_duration":1.05234216,"objects_trimmed":0,"snaptrim_duration":0.61416249099999998,"stat_sum":{"num_bytes":179141560,"num_objects":68,"num_object_clones":8,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":206,"num_read_kb":69949,"num_write":398,"num_write_kb":107432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":339541664,"num_keys_recovered":220,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.a","version":"272'477","reported_seq":1738,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.238444+0000","last_change":"2022-05-01T04:29:58.990005+0000","last_active":"2022-05-01T04:30:19.238444+0000","last_peered":"2022-05-01T04:30:19.238444+0000","last_clean":"2022-05-01T04:30:19.238444+0000","last_became_active":"2022-05-01T04:29:08.175363+0000","last_became_peered":"2022-05-01T04:29:08.175363+0000","last_unstale":"2022-05-01T04:30:19.238444+0000","last_undegraded":"2022-05-01T04:30:19.238444+0000","last_fullsized":"2022-05-01T04:30:19.238444+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"247'454","last_scrub_stamp":"2022-05-01T04:29:39.093953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.093953+0000","objects_scrubbed":70,"log_size":477,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:46.460212+0000","scrub_duration":1.3648651510000001,"objects_trimmed":0,"snaptrim_duration":0.15573891400000001,"stat_sum":{"num_bytes":197706553,"num_objects":71,"num_object_clones":8,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":2,"num_read":262,"num_read_kb":159904,"num_write":471,"num_write_kb":128600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":193253880,"num_keys_recovered":160,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.9","version":"276'505","reported_seq":1339,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.255437+0000","last_change":"2022-05-01T04:30:02.707698+0000","last_active":"2022-05-01T04:30:19.255437+0000","last_peered":"2022-05-01T04:30:19.255437+0000","last_clean":"2022-05-01T04:30:19.255437+0000","last_became_active":"2022-05-01T04:29:59.090857+0000","last_became_peered":"2022-05-01T04:29:59.090857+0000","last_unstale":"2022-05-01T04:30:19.255437+0000","last_undegraded":"2022-05-01T04:30:19.255437+0000","last_fullsized":"2022-05-01T04:30:19.255437+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":505,"ondisk_log_size":505,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.71138417200000004,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":113,"num_read_kb":82075,"num_write":204,"num_write_kb":57353,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.8","version":"273'465","reported_seq":2265,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.277718+0000","last_change":"2022-05-01T04:30:08.055718+0000","last_active":"2022-05-01T04:30:19.277718+0000","last_peered":"2022-05-01T04:30:19.277718+0000","last_clean":"2022-05-01T04:30:19.277718+0000","last_became_active":"2022-05-01T04:30:00.189790+0000","last_became_peered":"2022-05-01T04:30:00.189790+0000","last_unstale":"2022-05-01T04:30:19.277718+0000","last_undegraded":"2022-05-01T04:30:19.277718+0000","last_fullsized":"2022-05-01T04:30:19.277718+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.101109292,"stat_sum":{"num_bytes":96164905,"num_objects":39,"num_object_clones":10,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":116,"num_read_kb":48609,"num_write":276,"num_write_kb":64534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":252683112,"num_keys_recovered":230,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":109,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177759+0000","last_change":"2022-05-01T04:29:49.104235+0000","last_active":"2022-05-01T04:30:19.177759+0000","last_peered":"2022-05-01T04:30:19.177759+0000","last_clean":"2022-05-01T04:30:19.177759+0000","last_became_active":"2022-05-01T04:28:42.075951+0000","last_became_peered":"2022-05-01T04:28:42.075951+0000","last_unstale":"2022-05-01T04:30:19.177759+0000","last_undegraded":"2022-05-01T04:30:19.177759+0000","last_fullsized":"2022-05-01T04:30:19.177759+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:00.204819+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:00.204819+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"261'465","reported_seq":1972,"reported_epoch":296,"state":"peering","last_fresh":"2022-05-01T04:30:20.075325+0000","last_change":"2022-05-01T04:30:20.075325+0000","last_active":"2022-05-01T04:29:57.787070+0000","last_peered":"2022-05-01T04:29:57.436823+0000","last_clean":"2022-05-01T04:29:48.904733+0000","last_became_active":"2022-05-01T04:29:52.471792+0000","last_became_peered":"2022-05-01T04:29:52.471792+0000","last_unstale":"2022-05-01T04:30:20.075325+0000","last_undegraded":"2022-05-01T04:30:20.075325+0000","last_fullsized":"2022-05-01T04:30:20.075325+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":237,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0.407825406,"stat_sum":{"num_bytes":79997672,"num_objects":31,"num_object_clones":5,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":103,"num_read_kb":29450,"num_write":243,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":189,"num_bytes_recovered":203448551,"num_keys_recovered":150,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[2],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":27,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.238636+0000","last_change":"2022-05-01T04:30:02.996712+0000","last_active":"2022-05-01T04:30:19.238636+0000","last_peered":"2022-05-01T04:30:19.238636+0000","last_clean":"2022-05-01T04:30:19.238636+0000","last_became_active":"2022-05-01T04:30:02.896021+0000","last_became_peered":"2022-05-01T04:30:02.896021+0000","last_unstale":"2022-05-01T04:30:19.238636+0000","last_undegraded":"2022-05-01T04:30:19.238636+0000","last_fullsized":"2022-05-01T04:30:19.238636+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:52.422661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:52.422661+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:05.375337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"275'566","reported_seq":1415,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155577+0000","last_change":"2022-05-01T04:30:02.778149+0000","last_active":"2022-05-01T04:30:19.155577+0000","last_peered":"2022-05-01T04:30:19.155577+0000","last_clean":"2022-05-01T04:30:19.155577+0000","last_became_active":"2022-05-01T04:29:59.089639+0000","last_became_peered":"2022-05-01T04:29:59.089639+0000","last_unstale":"2022-05-01T04:30:19.155577+0000","last_undegraded":"2022-05-01T04:30:19.155577+0000","last_fullsized":"2022-05-01T04:30:19.155577+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0.89342225399999997,"stat_sum":{"num_bytes":102081757,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":127,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":386,"reported_epoch":294,"state":"active+clean","last_fresh":"2022-05-01T04:30:17.986898+0000","last_change":"2022-05-01T04:29:51.118516+0000","last_active":"2022-05-01T04:30:17.986898+0000","last_peered":"2022-05-01T04:30:17.986898+0000","last_clean":"2022-05-01T04:30:17.986898+0000","last_became_active":"2022-05-01T04:29:51.118117+0000","last_became_peered":"2022-05-01T04:29:51.118117+0000","last_unstale":"2022-05-01T04:30:17.986898+0000","last_undegraded":"2022-05-01T04:30:17.986898+0000","last_fullsized":"2022-05-01T04:30:17.986898+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:40.698524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:40.698524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:45.889971+0000","scrub_duration":0.50325435799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"273'490","reported_seq":1597,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177829+0000","last_change":"2022-05-01T04:29:58.989879+0000","last_active":"2022-05-01T04:30:19.177829+0000","last_peered":"2022-05-01T04:30:19.177829+0000","last_clean":"2022-05-01T04:30:19.177829+0000","last_became_active":"2022-05-01T04:29:58.888029+0000","last_became_peered":"2022-05-01T04:29:58.888029+0000","last_unstale":"2022-05-01T04:30:19.177829+0000","last_undegraded":"2022-05-01T04:30:19.177829+0000","last_fullsized":"2022-05-01T04:30:19.177829+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0.00046417000000000002,"stat_sum":{"num_bytes":93110778,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":103,"num_read_kb":46934,"num_write":215,"num_write_kb":63006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":83574846,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":27,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.183000+0000","last_change":"2022-05-01T04:30:02.982397+0000","last_active":"2022-05-01T04:30:19.183000+0000","last_peered":"2022-05-01T04:30:19.183000+0000","last_clean":"2022-05-01T04:30:19.183000+0000","last_became_active":"2022-05-01T04:30:02.982092+0000","last_became_peered":"2022-05-01T04:30:02.982092+0000","last_unstale":"2022-05-01T04:30:19.183000+0000","last_undegraded":"2022-05-01T04:30:19.183000+0000","last_fullsized":"2022-05-01T04:30:19.183000+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:24.617265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:24.617265+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.402921694,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'117","reported_seq":258,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155690+0000","last_change":"2022-05-01T04:30:16.239307+0000","last_active":"2022-05-01T04:30:19.155690+0000","last_peered":"2022-05-01T04:30:19.155690+0000","last_clean":"2022-05-01T04:30:19.155690+0000","last_became_active":"2022-05-01T04:30:16.238972+0000","last_became_peered":"2022-05-01T04:30:16.238972+0000","last_unstale":"2022-05-01T04:30:19.155690+0000","last_undegraded":"2022-05-01T04:30:19.155690+0000","last_fullsized":"2022-05-01T04:30:19.155690+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2022-05-01T04:28:00.739540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:15.316890+0000","last_clean_scrub_stamp":"2022-05-01T04:28:00.739540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"273'535","reported_seq":1734,"reported_epoch":296,"state":"active+recovering+undersized+remapped","last_fresh":"2022-05-01T04:30:20.123730+0000","last_change":"2022-05-01T04:30:20.328949+0000","last_active":"2022-05-01T04:30:20.123730+0000","last_peered":"2022-05-01T04:30:20.123730+0000","last_clean":"2022-05-01T04:29:46.967195+0000","last_became_active":"2022-05-01T04:30:03.895066+0000","last_became_peered":"2022-05-01T04:30:03.895066+0000","last_unstale":"2022-05-01T04:30:20.123730+0000","last_undegraded":"2022-05-01T04:30:03.791995+0000","last_fullsized":"2022-05-01T04:30:03.788182+0000","mapping_epoch":279,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":230,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":30,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0.40853271600000002,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":7,"num_object_copies":129,"num_objects_missing_on_primary":52,"num_objects_missing":52,"num_objects_degraded":0,"num_objects_misplaced":74,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":1,"num_read":140,"num_read_kb":72872,"num_write":290,"num_write_kb":74976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":109105320,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,6],"avail_no_missing":["1","4","6"],"object_location_counts":[{"shards":"1,3,4,6","objects":8},{"shards":"1,4,6","objects":33},{"shards":"3,6","objects":2}],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"}]},{"pgid":"2.0","version":"0'0","reported_seq":137,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.255829+0000","last_change":"2022-05-01T04:30:16.267571+0000","last_active":"2022-05-01T04:30:19.255829+0000","last_peered":"2022-05-01T04:30:19.255829+0000","last_clean":"2022-05-01T04:30:19.255829+0000","last_became_active":"2022-05-01T04:30:16.267154+0000","last_became_peered":"2022-05-01T04:30:16.267154+0000","last_unstale":"2022-05-01T04:30:19.255829+0000","last_undegraded":"2022-05-01T04:30:19.255829+0000","last_fullsized":"2022-05-01T04:30:19.255829+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:12.658835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:12.658835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.304165821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"294'453","reported_seq":1765,"reported_epoch":295,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:19.057308+0000","last_change":"2022-05-01T04:30:18.886977+0000","last_active":"2022-05-01T04:30:19.057308+0000","last_peered":"2022-05-01T04:30:19.057308+0000","last_clean":"2022-05-01T04:30:19.057308+0000","last_became_active":"2022-05-01T04:30:06.174043+0000","last_became_peered":"2022-05-01T04:30:06.174043+0000","last_unstale":"2022-05-01T04:30:19.057308+0000","last_undegraded":"2022-05-01T04:30:19.057308+0000","last_fullsized":"2022-05-01T04:30:19.057308+0000","mapping_epoch":281,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":453,"ondisk_log_size":453,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":24,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.76321735999999996,"stat_sum":{"num_bytes":95657071,"num_objects":38,"num_object_clones":8,"num_object_copies":114,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":38,"num_whiteouts":0,"num_read":120,"num_read_kb":76397,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":119,"num_bytes_recovered":141204132,"num_keys_recovered":40,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":317,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.155906+0000","last_change":"2022-05-01T04:29:49.588507+0000","last_active":"2022-05-01T04:30:19.155906+0000","last_peered":"2022-05-01T04:30:19.155906+0000","last_clean":"2022-05-01T04:30:19.155906+0000","last_became_active":"2022-05-01T04:25:17.351886+0000","last_became_peered":"2022-05-01T04:25:17.351886+0000","last_unstale":"2022-05-01T04:30:19.155906+0000","last_undegraded":"2022-05-01T04:30:19.155906+0000","last_fullsized":"2022-05-01T04:30:19.155906+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:49.588383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.588383+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:54.942702+0000","scrub_duration":0.30376289400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'361","reported_seq":1781,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.177815+0000","last_change":"2022-05-01T04:30:13.312203+0000","last_active":"2022-05-01T04:30:19.177815+0000","last_peered":"2022-05-01T04:30:19.177815+0000","last_clean":"2022-05-01T04:30:19.177815+0000","last_became_active":"2022-05-01T04:30:13.311320+0000","last_became_peered":"2022-05-01T04:30:13.311320+0000","last_unstale":"2022-05-01T04:30:19.177815+0000","last_undegraded":"2022-05-01T04:30:19.177815+0000","last_fullsized":"2022-05-01T04:30:19.177815+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0.00086617699999999998,"stat_sum":{"num_bytes":83569377,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":178,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":177664904,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.7","version":"273'533","reported_seq":1998,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.377978+0000","last_change":"2022-05-01T04:30:05.888096+0000","last_active":"2022-05-01T04:30:19.377978+0000","last_peered":"2022-05-01T04:30:19.377978+0000","last_clean":"2022-05-01T04:30:19.377978+0000","last_became_active":"2022-05-01T04:29:59.991809+0000","last_became_peered":"2022-05-01T04:29:59.991809+0000","last_unstale":"2022-05-01T04:30:19.377978+0000","last_undegraded":"2022-05-01T04:30:19.377978+0000","last_fullsized":"2022-05-01T04:30:19.377978+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":281,"parent":"0.0","parent_split_bits":0,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":533,"ondisk_log_size":533,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0.40617742299999998,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":11,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":153,"num_bytes_recovered":194369701,"num_keys_recovered":70,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.178048+0000","last_change":"2022-05-01T04:28:42.261677+0000","last_active":"2022-05-01T04:30:19.178048+0000","last_peered":"2022-05-01T04:30:19.178048+0000","last_clean":"2022-05-01T04:30:19.178048+0000","last_became_active":"2022-05-01T04:28:42.261299+0000","last_became_peered":"2022-05-01T04:28:42.261299+0000","last_unstale":"2022-05-01T04:30:19.178048+0000","last_undegraded":"2022-05-01T04:30:19.178048+0000","last_fullsized":"2022-05-01T04:30:19.178048+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:48.745287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.745287+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":375,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.150747+0000","last_change":"2022-05-01T04:29:05.171169+0000","last_active":"2022-05-01T04:30:19.150747+0000","last_peered":"2022-05-01T04:30:19.150747+0000","last_clean":"2022-05-01T04:30:19.150747+0000","last_became_active":"2022-05-01T04:29:05.170684+0000","last_became_peered":"2022-05-01T04:29:05.170684+0000","last_unstale":"2022-05-01T04:30:19.150747+0000","last_undegraded":"2022-05-01T04:30:19.150747+0000","last_fullsized":"2022-05-01T04:30:19.150747+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:47.562100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:47.562100+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.30425882100000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"277'573","reported_seq":1925,"reported_epoch":295,"state":"active+clean","last_fresh":"2022-05-01T04:30:19.157470+0000","last_change":"2022-05-01T04:30:03.710494+0000","last_active":"2022-05-01T04:30:19.157470+0000","last_peered":"2022-05-01T04:30:19.157470+0000","last_clean":"2022-05-01T04:30:19.157470+0000","last_became_active":"2022-05-01T04:29:58.986844+0000","last_became_peered":"2022-05-01T04:29:58.986844+0000","last_unstale":"2022-05-01T04:30:19.157470+0000","last_undegraded":"2022-05-01T04:30:19.157470+0000","last_fullsized":"2022-05-01T04:30:19.157470+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":573,"ondisk_log_size":573,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.91696671600000002,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":112,"num_read_kb":54635,"num_write":200,"num_write_kb":69190,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967345,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"91","length":"3"},{"start":"96","length":"1"},{"start":"99","length":"3"},{"start":"9e","length":"1"},{"start":"a0","length":"1"},{"start":"a2","length":"3"},{"start":"a7","length":"1"},{"start":"a9","length":"5"},{"start":"af","length":"1"},{"start":"b1","length":"1"},{"start":"b4","length":"1"},{"start":"b9","length":"1"},{"start":"bc","length":"1"},{"start":"c2","length":"3"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":26,"stat_sum":{"num_bytes":3094612737,"num_objects":1166,"num_object_clones":201,"num_object_copies":3498,"num_objects_missing_on_primary":82,"num_objects_missing":82,"num_objects_degraded":133,"num_objects_misplaced":309,"num_objects_unfound":0,"num_objects_dirty":1166,"num_whiteouts":30,"num_read":3712,"num_read_kb":1765464,"num_write":7466,"num_write_kb":2036181,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3548,"num_bytes_recovered":3906462674,"num_keys_recovered":1880,"num_objects_omap":71,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":5410938880,"data_stored":5655074692,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":654892,"internal_metadata":0},"log_size":12881,"ondisk_log_size":12881,"up":78,"acting":76,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":2115712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574914,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":870964,"kb_used_data":833388,"kb_used_omap":0,"kb_used_meta":37568,"kb_avail":93500876,"statfs":{"total":96636764160,"available":95744897024,"internally_reserved":0,"allocated":853389312,"data_stored":896292243,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":38469632},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":12.237,"5min":37.633000000000003,"15min":61.872999999999998},"min":{"1min":0.51800000000000002,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":72.403999999999996,"5min":518.15200000000004,"15min":518.15200000000004},"last":5.5860000000000003},{"interface":"front","average":{"1min":5.0730000000000004,"5min":5.4240000000000004,"15min":8.3490000000000002},"min":{"1min":0.53000000000000003,"5min":0.433,"15min":0.433},"max":{"1min":65.225999999999999,"5min":99.054000000000002,"15min":99.054000000000002},"last":3.1640000000000001}]},{"osd":1,"last update":"Sun May 1 04:29:37 2022","interfaces":[{"interface":"back","average":{"1min":0.69099999999999995,"5min":0.76000000000000001,"15min":0.77200000000000002},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":0.86199999999999999,"5min":1.1739999999999999,"15min":1.1739999999999999},"last":3.6469999999999998},{"interface":"front","average":{"1min":16.597999999999999,"5min":10.374000000000001,"15min":9.3369999999999997},"min":{"1min":0.66900000000000004,"5min":0.60199999999999998,"15min":0.60199999999999998},"max":{"1min":88.078000000000003,"5min":88.078000000000003,"15min":88.078000000000003},"last":3.7829999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":11.132,"5min":15.377000000000001,"15min":26.102},"min":{"1min":0.54300000000000004,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":176.274,"5min":252.857,"15min":252.857},"last":0.58599999999999997},{"interface":"front","average":{"1min":11.837,"5min":26.882999999999999,"15min":47.584000000000003},"min":{"1min":0.70699999999999996,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":72.778000000000006,"5min":310.839,"15min":310.839},"last":3.7109999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":1.401,"15min":1.131},"min":{"1min":0.70899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":40.189999999999998,"5min":40.189999999999998,"15min":40.189999999999998},"last":5.2359999999999998},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1140000000000001,"15min":1.1499999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5600000000000001,"5min":3.585,"15min":3.585},"last":9.1560000000000006}]},{"osd":4,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":0.91400000000000003,"5min":3.673,"15min":3.3029999999999999},"min":{"1min":0.60099999999999998,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":1.391,"5min":100.727,"15min":100.727},"last":0.55800000000000005},{"interface":"front","average":{"1min":7.3159999999999998,"5min":18.145,"15min":27.129999999999999},"min":{"1min":0.78400000000000003,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":108.63200000000001,"5min":252.94900000000001,"15min":252.94900000000001},"last":0.74099999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":11.952,"5min":16.052,"15min":25.853999999999999},"min":{"1min":0.88700000000000001,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":72.542000000000002,"5min":301.91000000000003,"15min":301.91000000000003},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.095,"5min":6.4960000000000004,"15min":11.42},"min":{"1min":0.79800000000000004,"5min":0.71199999999999997,"15min":0.71199999999999997},"max":{"1min":1.3720000000000001,"5min":159.309,"15min":159.309},"last":0.99199999999999999}]},{"osd":6,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":6.5549999999999997,"5min":15.954000000000001,"15min":28.488},"min":{"1min":0.872,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":92.481999999999999,"5min":294.37,"15min":294.37},"last":0.77100000000000002},{"interface":"front","average":{"1min":6.5700000000000003,"5min":25.222000000000001,"15min":47.006},"min":{"1min":1.0089999999999999,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":92.453999999999994,"5min":294.82299999999998,"15min":294.82299999999998},"last":0.874}]}]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":781112,"kb_used_data":744432,"kb_used_omap":0,"kb_used_meta":36672,"kb_avail":93590728,"statfs":{"total":96636764160,"available":95836905472,"internally_reserved":0,"allocated":762298368,"data_stored":793548305,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":37552128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":12.117000000000001,"5min":20.341999999999999,"15min":40.899000000000001},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":146.00800000000001,"5min":474.91300000000001,"15min":474.91300000000001},"last":1.147},{"interface":"front","average":{"1min":16.079999999999998,"5min":14.685,"15min":24.908999999999999},"min":{"1min":0.53400000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":146.03,"5min":296.67500000000001,"15min":296.67500000000001},"last":1.0580000000000001}]},{"osd":1,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":10.571,"5min":2.8530000000000002,"15min":1.5669999999999999},"min":{"1min":0.64600000000000002,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":100.899,"5min":100.899,"15min":100.899},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.702,"5min":2.8900000000000001,"15min":3.0880000000000001},"min":{"1min":0.61099999999999999,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":13.907,"5min":49.499000000000002,"15min":49.499000000000002},"last":1.405}]},{"osd":2,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":12.288,"15min":31.699000000000002},"min":{"1min":0.65600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":37.988999999999997,"5min":384.75700000000001,"15min":384.75700000000001},"last":3.6579999999999999},{"interface":"front","average":{"1min":4.9180000000000001,"5min":7.1749999999999998,"15min":16.774000000000001},"min":{"1min":0.66200000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":74.480999999999995,"5min":160.499,"15min":160.499},"last":1.6220000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:12 2022","interfaces":[{"interface":"back","average":{"1min":5.1210000000000004,"5min":6.2729999999999997,"15min":6.0990000000000002},"min":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":39.613999999999997,"5min":93.191999999999993,"15min":93.191999999999993},"last":88.484999999999999},{"interface":"front","average":{"1min":5.5700000000000003,"5min":2.5150000000000001,"15min":1.544},"min":{"1min":0.81699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":45.993000000000002,"5min":49.615000000000002,"15min":49.615000000000002},"last":8.5380000000000003}]},{"osd":4,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":9.2210000000000001,"15min":28.965},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.736,"5min":384.22199999999998,"15min":384.22199999999998},"last":0.65800000000000003},{"interface":"front","average":{"1min":17.77,"5min":14.365,"15min":32.424999999999997},"min":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":167.744,"5min":290.24200000000002,"15min":290.24200000000002},"last":0.94899999999999995}]},{"osd":5,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":9.2119999999999997,"15min":20.93},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":33.787999999999997,"5min":276.17000000000002,"15min":276.17000000000002},"last":0.77500000000000002},{"interface":"front","average":{"1min":4.8029999999999999,"5min":13.064,"15min":40.137999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":69.587999999999994,"5min":384.64299999999997,"15min":384.64299999999997},"last":1.0149999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":8.8539999999999992,"5min":26.236999999999998,"15min":76.006},"min":{"1min":0.88500000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":74.135000000000005,"5min":670.42999999999995,"15min":670.42999999999995},"last":1.181},{"interface":"front","average":{"1min":2.778,"5min":4.8630000000000004,"15min":2.327},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":33.892000000000003,"5min":94.379999999999995,"15min":94.379999999999995},"last":0.97699999999999998}]}]},{"osd":1,"up_from":134,"seq":575525617699,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":817664,"kb_used_data":774520,"kb_used_omap":652,"kb_used_meta":42483,"kb_avail":93554176,"statfs":{"total":96636764160,"available":95799476224,"internally_reserved":0,"allocated":793108480,"data_stored":827588588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":668200,"internal_metadata":43503064},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":13.711,"5min":10.115,"15min":9.5150000000000006},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":99.966999999999999,"5min":176.80000000000001,"15min":176.80000000000001},"last":0.80600000000000005},{"interface":"front","average":{"1min":8.9359999999999999,"5min":9.1989999999999998,"15min":9.2430000000000003},"min":{"1min":0.58599999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":79.738,"5min":176.886,"15min":176.886},"last":0.99099999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":8.2460000000000004,"5min":4.4459999999999997,"15min":3.8119999999999998},"min":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":100.336,"5min":100.336,"15min":100.336},"last":0.89800000000000002},{"interface":"front","average":{"1min":3.2919999999999998,"5min":1.343,"15min":1.018},"min":{"1min":0.63900000000000001,"5min":0.625,"15min":0.625},"max":{"1min":34.151000000000003,"5min":34.151000000000003,"15min":34.151000000000003},"last":0.83599999999999997}]},{"osd":3,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":8.3409999999999993,"5min":2.544,"15min":1.5780000000000001},"min":{"1min":0.70299999999999996,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":100.11499999999999,"5min":100.11499999999999,"15min":100.11499999999999},"last":1.036},{"interface":"front","average":{"1min":3.5529999999999999,"5min":1.6559999999999999,"15min":1.3400000000000001},"min":{"1min":0.73699999999999999,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":34.658000000000001,"5min":34.658000000000001,"15min":34.658000000000001},"last":1.133}]},{"osd":4,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":9.782,"5min":9.6500000000000004,"15min":9.6280000000000001},"min":{"1min":0.66900000000000004,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":89.364000000000004,"5min":92.572000000000003,"15min":92.572000000000003},"last":90.158000000000001},{"interface":"front","average":{"1min":11.432,"5min":3.1389999999999998,"15min":1.7569999999999999},"min":{"1min":0.67400000000000004,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":58.978000000000002,"5min":58.978000000000002,"15min":58.978000000000002},"last":0.86699999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":3.6680000000000001,"5min":1.736,"15min":1.4139999999999999},"min":{"1min":0.88900000000000001,"5min":0.84899999999999998,"15min":0.84899999999999998},"max":{"1min":34.417999999999999,"5min":34.417999999999999,"15min":34.417999999999999},"last":1.282},{"interface":"front","average":{"1min":8.2729999999999997,"5min":2.5369999999999999,"15min":1.581},"min":{"1min":0.755,"5min":0.755,"15min":0.755},"max":{"1min":59.185000000000002,"5min":59.185000000000002,"15min":59.185000000000002},"last":0.97699999999999998}]},{"osd":6,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":13.271000000000001,"5min":3.7170000000000001,"15min":2.125},"min":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":69.930999999999997,"5min":69.930999999999997,"15min":69.930999999999997},"last":1.052},{"interface":"front","average":{"1min":8.6340000000000003,"5min":2.8380000000000001,"15min":1.8720000000000001},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":100.20099999999999,"5min":100.20099999999999,"15min":100.20099999999999},"last":1.3200000000000001}]},{"osd":7,"last update":"Sun May 1 04:29:40 2022","interfaces":[{"interface":"back","average":{"1min":12.922000000000001,"5min":6.2359999999999998,"15min":5.1219999999999999},"min":{"1min":0.92800000000000005,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":64.167000000000002,"5min":69.519000000000005,"15min":69.519000000000005},"last":1.167},{"interface":"front","average":{"1min":8.6799999999999997,"5min":2.9199999999999999,"15min":1.96},"min":{"1min":1.048,"5min":1.048,"15min":1.048},"max":{"1min":100.27,"5min":100.27,"15min":100.27},"last":1.2230000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574913,"num_pgs":22,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":900552,"kb_used_data":861696,"kb_used_omap":0,"kb_used_meta":38848,"kb_avail":93471288,"statfs":{"total":96636764160,"available":95714598912,"internally_reserved":0,"allocated":882376704,"data_stored":926887646,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":39780352},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,1,0,0,3],"upper_bound":256},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 1 04:29:37 2022","interfaces":[{"interface":"back","average":{"1min":2.2090000000000001,"5min":4.625,"15min":5.0279999999999996},"min":{"1min":0.56799999999999995,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":25.649000000000001,"5min":94.671999999999997,"15min":94.671999999999997},"last":1.274},{"interface":"front","average":{"1min":15.130000000000001,"5min":4.6319999999999997,"15min":2.8820000000000001},"min":{"1min":0.67800000000000005,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":218.80099999999999,"5min":218.80099999999999,"15min":218.80099999999999},"last":1.3280000000000001}]},{"osd":2,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":3.411,"5min":7.8899999999999997,"15min":11.317},"min":{"1min":0.58699999999999997,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":48.067,"5min":106.374,"15min":106.374},"last":1.228},{"interface":"front","average":{"1min":13.252000000000001,"5min":29.773,"15min":51.216000000000001},"min":{"1min":0.67400000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":95.516999999999996,"5min":497.91500000000002,"15min":497.91500000000002},"last":1.472}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":3.3580000000000001,"15min":2.4969999999999999},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.528,"5min":176.02699999999999,"15min":176.02699999999999},"last":1.827},{"interface":"front","average":{"1min":6.5469999999999997,"5min":2.7210000000000001,"15min":2.2480000000000002},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":48.159999999999997,"5min":48.159999999999997,"15min":48.159999999999997},"last":1.379}]},{"osd":4,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":13.605,"5min":16.038,"15min":23.190000000000001},"min":{"1min":0.85799999999999998,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":176.16900000000001,"5min":248.709,"15min":248.709},"last":1.587},{"interface":"front","average":{"1min":25.143999999999998,"5min":26.859000000000002,"15min":36.008000000000003},"min":{"1min":0.76500000000000001,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":249.125,"5min":315.69400000000002,"15min":315.69400000000002},"last":1.4930000000000001}]},{"osd":5,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":33.139000000000003,"15min":55.725000000000001},"min":{"1min":0.81399999999999995,"5min":0.622,"15min":0.622},"max":{"1min":1.8779999999999999,"5min":540.08900000000006,"15min":540.08900000000006},"last":66.656999999999996},{"interface":"front","average":{"1min":11.036,"5min":13.048,"15min":14.032},"min":{"1min":0.75600000000000001,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":176.32599999999999,"5min":176.32599999999999,"15min":176.32599999999999},"last":1.7130000000000001}]},{"osd":6,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":29.782,"5min":22.654,"15min":32.274000000000001},"min":{"1min":0.84499999999999997,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":222.18299999999999,"5min":240.36600000000001,"15min":240.36600000000001},"last":1.6699999999999999},{"interface":"front","average":{"1min":1.304,"5min":40.305999999999997,"15min":67.299999999999997},"min":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":1.996,"5min":498.05399999999997,"15min":498.05399999999997},"last":2.456}]},{"osd":7,"last update":"Sun May 1 04:29:23 2022","interfaces":[{"interface":"back","average":{"1min":8.7680000000000007,"5min":64.995999999999995,"15min":123.136},"min":{"1min":0.88200000000000001,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":93.771000000000001,"5min":1663.876,"15min":1663.876},"last":2.3029999999999999},{"interface":"front","average":{"1min":11.15,"5min":56.536999999999999,"15min":106.17},"min":{"1min":1.016,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":176.261,"5min":844.65300000000002,"15min":844.65300000000002},"last":2.0129999999999999}]}]},{"osd":2,"up_from":13,"seq":55834574913,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":344540,"kb_used_data":316628,"kb_used_omap":0,"kb_used_meta":27904,"kb_avail":94027300,"statfs":{"total":96636764160,"available":96283955200,"internally_reserved":0,"allocated":324227072,"data_stored":339798606,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28573696},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":7.5739999999999998,"5min":3.2999999999999998,"15min":1.6240000000000001},"min":{"1min":0.53400000000000003,"5min":0.443,"15min":0.443},"max":{"1min":66.424000000000007,"5min":72.322000000000003,"15min":72.322000000000003},"last":7.242},{"interface":"front","average":{"1min":11.119,"5min":37.843000000000004,"15min":63.07},"min":{"1min":0.51200000000000001,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":91.519000000000005,"5min":465.05200000000002,"15min":465.05200000000002},"last":2.927}]},{"osd":1,"last update":"Sun May 1 04:29:39 2022","interfaces":[{"interface":"back","average":{"1min":18.872,"5min":18.231000000000002,"15min":18.123999999999999},"min":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":84.466999999999999,"5min":153.101,"15min":153.101},"last":1.8069999999999999},{"interface":"front","average":{"1min":8.1769999999999996,"5min":2.3620000000000001,"15min":1.393},"min":{"1min":0.61099999999999999,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":117.398,"5min":117.398,"15min":117.398},"last":2.0579999999999998}]},{"osd":3,"last update":"Sun May 1 04:30:08 2022","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.212,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.390000000000001,"5min":21.312000000000001,"15min":21.312000000000001},"last":101.03100000000001},{"interface":"front","average":{"1min":1.034,"5min":0.93799999999999994,"15min":0.90600000000000003},"min":{"1min":0.73999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":2.8079999999999998}]},{"osd":4,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":2.234,"5min":8.4920000000000009,"15min":14.210000000000001},"min":{"1min":0.874,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":21.434000000000001,"5min":147.17099999999999,"15min":147.17099999999999},"last":2.1890000000000001},{"interface":"front","average":{"1min":8.3149999999999995,"5min":19.849,"15min":34.643999999999998},"min":{"1min":1.032,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":72.075000000000003,"5min":240.71000000000001,"15min":240.71000000000001},"last":2.4199999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":8.907,"5min":14.784000000000001,"15min":15.452999999999999},"min":{"1min":0.85199999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":153.203,"5min":260.42099999999999,"15min":260.42099999999999},"last":13.206},{"interface":"front","average":{"1min":2.4009999999999998,"5min":7.548,"15min":12.875999999999999},"min":{"1min":1.012,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":21.504000000000001,"5min":196.74799999999999,"15min":196.74799999999999},"last":2.3290000000000002}]},{"osd":6,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":1.3899999999999999,"5min":11.903,"15min":21.797000000000001},"min":{"1min":0.98999999999999999,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":2.2999999999999998,"5min":146.161,"15min":146.161},"last":2.5750000000000002},{"interface":"front","average":{"1min":13.718,"5min":24.753,"15min":36.780999999999999},"min":{"1min":1.0309999999999999,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":161.85599999999999,"5min":269.53100000000001,"15min":269.53100000000001},"last":13.034000000000001}]},{"osd":7,"last update":"Sun May 1 04:29:22 2022","interfaces":[{"interface":"back","average":{"1min":1.4159999999999999,"5min":1.5589999999999999,"15min":1.7649999999999999},"min":{"1min":1.069,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":2.1720000000000002,"5min":11.654999999999999,"15min":11.654999999999999},"last":2.6930000000000001},{"interface":"front","average":{"1min":13.727,"5min":13.403,"15min":16.937000000000001},"min":{"1min":1.111,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":155.268,"5min":160.547,"15min":160.547},"last":13.332000000000001}]}]},{"osd":3,"up_from":105,"seq":450971566121,"num_pgs":14,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":530208,"kb_used_data":509400,"kb_used_omap":2,"kb_used_meta":20797,"kb_avail":93841632,"statfs":{"total":96636764160,"available":96093831168,"internally_reserved":0,"allocated":521625600,"data_stored":527555785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":21296315},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,1],"upper_bound":128},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":4.7389999999999999,"15min":6.298},"min":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":73.262,"15min":73.262},"last":0.94199999999999995},{"interface":"front","average":{"1min":7.7329999999999997,"5min":6.2919999999999998,"15min":7.1989999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":72.561000000000007,"5min":97.546999999999997,"15min":97.546999999999997},"last":1.121}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":3.3540000000000001,"5min":1.3680000000000001,"15min":1.0369999999999999},"min":{"1min":0.69199999999999995,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":51.892000000000003,"5min":51.892000000000003,"15min":51.892000000000003},"last":0.60799999999999998},{"interface":"front","average":{"1min":5.0890000000000004,"5min":1.716,"15min":1.1539999999999999},"min":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":51.715000000000003,"5min":51.715000000000003,"15min":51.715000000000003},"last":0.64400000000000002}]},{"osd":2,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":0.94399999999999995},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.841,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.73499999999999999},{"interface":"front","average":{"1min":5.4009999999999998,"5min":4.351,"15min":4.7690000000000001},"min":{"1min":0.748,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":73.284000000000006,"5min":83.582999999999998,"15min":83.582999999999998},"last":1.032}]},{"osd":4,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":14.065,"5min":6.859,"15min":4.4889999999999999},"min":{"1min":0.80500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":88.811000000000007,"5min":97.501999999999995,"15min":97.501999999999995},"last":0.76300000000000001},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.3220000000000001,"15min":2.8300000000000001},"min":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7150000000000001,"5min":42.081000000000003,"15min":42.081000000000003},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3029999999999999,"15min":1.284},"min":{"1min":1.0660000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.885,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.1539999999999999},{"interface":"front","average":{"1min":5.4340000000000002,"5min":4.4109999999999996,"15min":3.9750000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":72.870000000000005,"5min":91.775999999999996,"15min":91.775999999999996},"last":0.91500000000000004}]},{"osd":6,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":2.681,"15min":1.7549999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":60.124000000000002,"5min":78.131,"15min":78.131},"last":1.321},{"interface":"front","average":{"1min":3.6890000000000001,"5min":4.7919999999999998,"15min":4.3760000000000003},"min":{"1min":1.0840000000000001,"5min":1.014,"15min":1.014},"max":{"1min":39.942999999999998,"5min":89.192999999999998,"15min":89.192999999999998},"last":1.2889999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":7.8170000000000002,"5min":2.6709999999999998,"15min":1.8169999999999999},"min":{"1min":0.98599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":73.015000000000001,"5min":73.015000000000001,"15min":73.015000000000001},"last":1.012},{"interface":"front","average":{"1min":6.5549999999999997,"5min":3.1709999999999998,"15min":1.954},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":89.414000000000001,"5min":89.414000000000001,"15min":89.414000000000001},"last":1.1870000000000001}]}]},{"osd":4,"up_from":13,"seq":55834574913,"num_pgs":21,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1106868,"kb_used_data":1056940,"kb_used_omap":0,"kb_used_meta":49920,"kb_avail":93264972,"statfs":{"total":96636764160,"available":95503331328,"internally_reserved":0,"allocated":1082306560,"data_stored":1139940750,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":51118080},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":12.122,"5min":17.731999999999999,"15min":24.044},"min":{"1min":0.46899999999999997,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":129.07599999999999,"5min":257.822,"15min":257.822},"last":78.052999999999997},{"interface":"front","average":{"1min":0.76500000000000001,"5min":13.398,"15min":22.884},"min":{"1min":0.51600000000000001,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":1.1799999999999999,"5min":256.291,"15min":256.291},"last":0.81200000000000006}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":4.1289999999999996,"5min":5.9720000000000004,"15min":6.2789999999999999},"min":{"1min":0.57499999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":69.811999999999998,"5min":91.667000000000002,"15min":91.667000000000002},"last":0.93400000000000005},{"interface":"front","average":{"1min":17.847000000000001,"5min":4.6870000000000003,"15min":2.4929999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":129.15799999999999,"5min":129.15799999999999,"15min":129.15799999999999},"last":1.0740000000000001}]},{"osd":2,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":5.9720000000000004,"5min":13.859,"15min":21.893999999999998},"min":{"1min":0.60199999999999998,"5min":0.505,"15min":0.505},"max":{"1min":45.573,"5min":256.45999999999998,"15min":256.45999999999998},"last":1.008},{"interface":"front","average":{"1min":8.9290000000000003,"5min":10.433999999999999,"15min":16.033999999999999},"min":{"1min":0.77200000000000002,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":91.593000000000004,"5min":174.048,"15min":174.048},"last":1.038}]},{"osd":3,"last update":"Sun May 1 04:30:11 2022","interfaces":[{"interface":"back","average":{"1min":6.1619999999999999,"5min":4.6959999999999997,"15min":4.4619999999999997},"min":{"1min":0.80700000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":97.203999999999994,"5min":97.203999999999994,"15min":97.203999999999994},"last":1.208},{"interface":"front","average":{"1min":1.0349999999999999,"5min":3.8929999999999998,"15min":3.2010000000000001},"min":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3260000000000001,"5min":91.527000000000001,"15min":91.527000000000001},"last":1.3129999999999999}]},{"osd":5,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":6.3840000000000003,"5min":17.690999999999999,"15min":24.939},"min":{"1min":0.70499999999999996,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":44.625,"5min":159.648,"15min":159.648},"last":0.91200000000000003},{"interface":"front","average":{"1min":0.96999999999999997,"5min":17.940999999999999,"15min":31.800999999999998},"min":{"1min":0.64700000000000002,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.2470000000000001,"5min":256.18799999999999,"15min":256.18799999999999},"last":1.1080000000000001}]},{"osd":6,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":17.603000000000002,"5min":12.807,"15min":17.817},"min":{"1min":0.69399999999999995,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":91.289000000000001,"5min":174.274,"15min":174.274},"last":1.181},{"interface":"front","average":{"1min":6.5199999999999996,"5min":18.015999999999998,"15min":26.024000000000001},"min":{"1min":0.86199999999999999,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":44.703000000000003,"5min":231.74799999999999,"15min":231.74799999999999},"last":1.1519999999999999}]},{"osd":7,"last update":"Sun May 1 04:29:24 2022","interfaces":[{"interface":"back","average":{"1min":1.1699999999999999,"5min":28.369,"15min":52.451000000000001},"min":{"1min":0.85999999999999999,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.516,"5min":652.226,"15min":652.226},"last":1.2789999999999999},{"interface":"front","average":{"1min":13.464,"5min":30.495999999999999,"15min":49.872999999999998},"min":{"1min":0.85299999999999998,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":91.421999999999997,"5min":376.32900000000001,"15min":376.32900000000001},"last":106.176}]}]},{"osd":5,"up_from":13,"seq":55834574912,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":266936,"kb_used_data":221744,"kb_used_omap":0,"kb_used_meta":45184,"kb_avail":94104904,"statfs":{"total":96636764160,"available":96363421696,"internally_reserved":0,"allocated":227065856,"data_stored":227583021,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":46268416},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[0,0,0,0,0,0,0,1],"upper_bound":256},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":3.8239999999999998,"5min":22.074999999999999,"15min":35.737000000000002},"min":{"1min":0.497,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":48.405999999999999,"5min":334.69799999999998,"15min":334.69799999999998},"last":4.9119999999999999},{"interface":"front","average":{"1min":4.0570000000000004,"5min":15.731999999999999,"15min":22.18},"min":{"1min":0.77300000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":48.375999999999998,"5min":282.01999999999998,"15min":282.01999999999998},"last":4.9900000000000002}]},{"osd":1,"last update":"Sun May 1 04:29:38 2022","interfaces":[{"interface":"back","average":{"1min":7.569,"5min":2.2519999999999998,"15min":1.3660000000000001},"min":{"1min":0.622,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":97.450000000000003,"5min":97.450000000000003,"15min":97.450000000000003},"last":4.3899999999999997},{"interface":"front","average":{"1min":8.4730000000000008,"5min":2.3879999999999999,"15min":1.3740000000000001},"min":{"1min":0.57099999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":58.759,"5min":58.759,"15min":58.759},"last":1.3939999999999999}]},{"osd":2,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":0.89000000000000001,"5min":2.7890000000000001,"15min":4.0099999999999998},"min":{"1min":0.57699999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":3.2599999999999998,"5min":82.424999999999997,"15min":82.424999999999997},"last":1.052},{"interface":"front","average":{"1min":0.91900000000000004,"5min":5.452,"15min":9.968},"min":{"1min":0.69499999999999995,"5min":0.621,"15min":0.621},"max":{"1min":1.325,"5min":150.518,"15min":150.518},"last":4.3239999999999998}]},{"osd":3,"last update":"Sun May 1 04:30:10 2022","interfaces":[{"interface":"back","average":{"1min":5.3099999999999996,"5min":1.879,"15min":1.3069999999999999},"min":{"1min":0.751,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":110.706,"5min":110.706,"15min":110.706},"last":4.5140000000000002},{"interface":"front","average":{"1min":7.556,"5min":2.3849999999999998,"15min":1.486},"min":{"1min":0.84699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":76.444000000000003,"5min":76.444000000000003,"15min":76.444000000000003},"last":99.159999999999997}]},{"osd":4,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":3.2810000000000001,"5min":21.321999999999999,"15min":39.951000000000001},"min":{"1min":0.57499999999999996,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":45.170000000000002,"5min":385.29300000000001,"15min":385.29300000000001},"last":0.95799999999999996},{"interface":"front","average":{"1min":1.48,"5min":13.676,"15min":20.757999999999999},"min":{"1min":0.68200000000000005,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":11.239000000000001,"5min":189.869,"15min":189.869},"last":0.83699999999999997}]},{"osd":6,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":18.375,"5min":18.841999999999999,"15min":30.875},"min":{"1min":0.71399999999999997,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":173.755,"5min":332.26299999999998,"15min":332.26299999999998},"last":4.25},{"interface":"front","average":{"1min":6.577,"5min":11.333,"15min":19.437000000000001},"min":{"1min":0.73399999999999999,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":60.741999999999997,"5min":295.99299999999999,"15min":295.99299999999999},"last":0.89300000000000002}]},{"osd":7,"last update":"Sun May 1 04:29:25 2022","interfaces":[{"interface":"back","average":{"1min":1.087,"5min":53.643999999999998,"15min":101.39},"min":{"1min":0.83099999999999996,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.321,"5min":1543.201,"15min":1543.201},"last":0.90800000000000003},{"interface":"front","average":{"1min":3.4769999999999999,"5min":7.6059999999999999,"15min":13.260999999999999},"min":{"1min":0.97999999999999998,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":44.923999999999999,"5min":150.71100000000001,"15min":150.71100000000001},"last":4.452}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":885415936,"data_stored":931792676,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":789708800,"data_stored":826088549,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":652007,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":320839680,"data_stored":338303778,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":528502784,"data_stored":536261159,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1080651776,"data_stored":1140181288,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":232603648,"data_stored":234980026,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":720662528,"data_stored":750115991,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":852553728,"data_stored":897351225,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2022-05-01T10:42:31.556 WARNING:scrape:Ignoring malparsed backtrace: dumped all , 2022-05-01T04:30:51.050 INFO:teuthology.orchestra.run.smithi061.stdout:{"pg_ready":true,"pg_map":{"version":467,"stamp":"2022-05-01T04:30:49.284987+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":3034072875,"num_objects":1140,"num_object_clones":186,"num_object_copies":3420,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1140,"num_whiteouts":28,"num_read":3100,"num_read_kb":1354332,"num_write":6217,"num_write_kb":1638045,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3293,"num_bytes_recovered":3515279523,"num_keys_recovered":1981,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13078,"ondisk_log_size":13078,"up":105,"acting":105,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":106,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":4882300,"kb_used_data":4569916,"kb_used_omap":655,"kb_used_meta":311664,"kb_avail":750092420,"statfs":{"total":773094113280,"available":768094638080,"internally_reserved":0,"allocated":4679593984,"data_stored":4869698937,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":671085,"internal_metadata":319144595},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-56420173,"num_objects":-25,"num_object_clones":-11,"num_object_copies":-75,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-3,"num_objects_unfound":0,"num_objects_dirty":-25,"num_whiteouts":-2,"num_read":-615,"num_read_kb":-329157,"num_write":-1204,"num_write_kb":-343199,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":-649,"num_bytes_recovered":-739472948,"num_keys_recovered":-330,"num_objects_omap":-4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.002032"},"pg_stats":[{"pgid":"3.19","version":"272'501","reported_seq":1338,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794886+0000","last_change":"2022-05-01T04:30:36.658256+0000","last_active":"2022-05-01T04:30:42.794886+0000","last_peered":"2022-05-01T04:30:42.794886+0000","last_clean":"2022-05-01T04:30:42.794886+0000","last_became_active":"2022-05-01T04:30:11.294414+0000","last_became_peered":"2022-05-01T04:30:11.294414+0000","last_unstale":"2022-05-01T04:30:42.794886+0000","last_undegraded":"2022-05-01T04:30:42.794886+0000","last_fullsized":"2022-05-01T04:30:42.794886+0000","mapping_epoch":286,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":287,"parent":"0.0","parent_split_bits":5,"last_scrub":"250'463","last_scrub_stamp":"2022-05-01T04:29:36.358563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.358563+0000","objects_scrubbed":61,"log_size":501,"ondisk_log_size":501,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.009914687,"objects_trimmed":0,"snaptrim_duration":0.205175364,"stat_sum":{"num_bytes":85403830,"num_objects":31,"num_object_clones":4,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":1,"num_read":114,"num_read_kb":82076,"num_write":204,"num_write_kb":57354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":42,"num_bytes_recovered":40234521,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.18","version":"273'465","reported_seq":2345,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971260+0000","last_change":"2022-05-01T04:30:15.339106+0000","last_active":"2022-05-01T04:30:42.971260+0000","last_peered":"2022-05-01T04:30:42.971260+0000","last_clean":"2022-05-01T04:30:42.971260+0000","last_became_active":"2022-05-01T04:30:15.336684+0000","last_became_peered":"2022-05-01T04:30:15.336684+0000","last_unstale":"2022-05-01T04:30:42.971260+0000","last_undegraded":"2022-05-01T04:30:42.971260+0000","last_fullsized":"2022-05-01T04:30:42.971260+0000","mapping_epoch":290,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":291,"parent":"0.0","parent_split_bits":5,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.001352624,"stat_sum":{"num_bytes":96164905,"num_objects":40,"num_object_clones":10,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":2,"num_read":116,"num_read_kb":48609,"num_write":277,"num_write_kb":64535,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":249,"num_bytes_recovered":275012362,"num_keys_recovered":150,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.17","version":"305'541","reported_seq":2031,"reported_epoch":305,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:44.138602+0000","last_change":"2022-05-01T04:30:41.229899+0000","last_active":"2022-05-01T04:30:44.138602+0000","last_peered":"2022-05-01T04:30:44.138602+0000","last_clean":"2022-05-01T04:30:44.138602+0000","last_became_active":"2022-05-01T04:30:07.303342+0000","last_became_peered":"2022-05-01T04:30:07.303342+0000","last_unstale":"2022-05-01T04:30:44.138602+0000","last_undegraded":"2022-05-01T04:30:44.138602+0000","last_fullsized":"2022-05-01T04:30:44.138602+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'519","last_scrub_stamp":"2022-05-01T04:29:49.116725+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.116725+0000","objects_scrubbed":90,"log_size":541,"ondisk_log_size":541,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":11,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.6545139820000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":124000332,"num_objects":47,"num_object_clones":12,"num_object_copies":141,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":47,"num_whiteouts":1,"num_read":137,"num_read_kb":73498,"num_write":248,"num_write_kb":73061,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":163,"num_bytes_recovered":207854617,"num_keys_recovered":90,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,3],"acting":[0,5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"275'571","reported_seq":1935,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.071933+0000","last_change":"2022-05-01T04:30:21.386607+0000","last_active":"2022-05-01T04:30:43.071933+0000","last_peered":"2022-05-01T04:30:43.071933+0000","last_clean":"2022-05-01T04:30:43.071933+0000","last_became_active":"2022-05-01T04:30:21.278471+0000","last_became_peered":"2022-05-01T04:30:21.278471+0000","last_unstale":"2022-05-01T04:30:43.071933+0000","last_undegraded":"2022-05-01T04:30:43.071933+0000","last_fullsized":"2022-05-01T04:30:43.071933+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":297,"parent":"0.0","parent_split_bits":5,"last_scrub":"251'514","last_scrub_stamp":"2022-05-01T04:29:37.508784+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.508784+0000","objects_scrubbed":66,"log_size":571,"ondisk_log_size":571,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.071777553,"objects_trimmed":0,"snaptrim_duration":0.102919052,"stat_sum":{"num_bytes":97707735,"num_objects":36,"num_object_clones":7,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":1,"num_read":113,"num_read_kb":54635,"num_write":201,"num_write_kb":69191,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":107,"num_bytes_recovered":120967346,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,1],"acting":[5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.15","version":"300'475","reported_seq":2264,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886295+0000","last_change":"2022-05-01T04:30:38.186202+0000","last_active":"2022-05-01T04:30:42.886295+0000","last_peered":"2022-05-01T04:30:42.886295+0000","last_clean":"2022-05-01T04:30:42.886295+0000","last_became_active":"2022-05-01T04:30:17.351913+0000","last_became_peered":"2022-05-01T04:30:17.351913+0000","last_unstale":"2022-05-01T04:30:42.886295+0000","last_undegraded":"2022-05-01T04:30:42.886295+0000","last_fullsized":"2022-05-01T04:30:42.886295+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":475,"ondisk_log_size":475,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":0.31212725699999999,"stat_sum":{"num_bytes":74400612,"num_objects":29,"num_object_clones":3,"num_object_copies":87,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":104,"num_read_kb":29450,"num_write":244,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":241,"num_bytes_recovered":247163307,"num_keys_recovered":230,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3,4],"acting":[7,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.14","version":"264'361","reported_seq":1637,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794291+0000","last_change":"2022-05-01T04:30:13.108744+0000","last_active":"2022-05-01T04:30:42.794291+0000","last_peered":"2022-05-01T04:30:42.794291+0000","last_clean":"2022-05-01T04:30:42.794291+0000","last_became_active":"2022-05-01T04:30:13.107986+0000","last_became_peered":"2022-05-01T04:30:13.107986+0000","last_unstale":"2022-05-01T04:30:42.794291+0000","last_undegraded":"2022-05-01T04:30:42.794291+0000","last_fullsized":"2022-05-01T04:30:42.794291+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":5,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83569378,"num_objects":30,"num_object_clones":5,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":179,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":129,"num_bytes_recovered":132378397,"num_keys_recovered":10,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7,6],"acting":[4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.13","version":"299'572","reported_seq":1407,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886038+0000","last_change":"2022-05-01T04:30:26.931140+0000","last_active":"2022-05-01T04:30:42.886038+0000","last_peered":"2022-05-01T04:30:42.886038+0000","last_clean":"2022-05-01T04:30:42.886038+0000","last_became_active":"2022-05-01T04:30:20.285780+0000","last_became_peered":"2022-05-01T04:30:20.285780+0000","last_unstale":"2022-05-01T04:30:42.886038+0000","last_undegraded":"2022-05-01T04:30:42.886038+0000","last_fullsized":"2022-05-01T04:30:42.886038+0000","mapping_epoch":295,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":296,"parent":"0.0","parent_split_bits":5,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":572,"ondisk_log_size":572,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":1.706369295,"stat_sum":{"num_bytes":102081758,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":1,"num_read":128,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":56033723,"num_keys_recovered":60,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,2],"acting":[7,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.12","version":"300'547","reported_seq":2075,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:45.067414+0000","last_change":"2022-05-01T04:30:45.067267+0000","last_active":"2022-05-01T04:30:45.067414+0000","last_peered":"2022-05-01T04:30:45.067414+0000","last_clean":"2022-05-01T04:30:45.067414+0000","last_became_active":"2022-05-01T04:30:07.095952+0000","last_became_peered":"2022-05-01T04:30:07.095952+0000","last_unstale":"2022-05-01T04:30:45.067414+0000","last_undegraded":"2022-05-01T04:30:45.067414+0000","last_fullsized":"2022-05-01T04:30:45.067414+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"300'547","last_scrub_stamp":"2022-05-01T04:30:45.067056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:45.067056+0000","objects_scrubbed":45,"log_size":547,"ondisk_log_size":547,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:48.642649+0000","scrub_duration":0.41387814099999998,"objects_trimmed":0,"snaptrim_duration":0.29937229199999998,"stat_sum":{"num_bytes":119129063,"num_objects":45,"num_object_clones":6,"num_object_copies":135,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":45,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3],"acting":[0,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.11","version":"294'459","reported_seq":2012,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.885825+0000","last_change":"2022-05-01T04:30:20.820375+0000","last_active":"2022-05-01T04:30:42.885825+0000","last_peered":"2022-05-01T04:30:42.885825+0000","last_clean":"2022-05-01T04:30:42.885825+0000","last_became_active":"2022-05-01T04:30:16.337078+0000","last_became_peered":"2022-05-01T04:30:16.337078+0000","last_unstale":"2022-05-01T04:30:42.885825+0000","last_undegraded":"2022-05-01T04:30:42.885825+0000","last_fullsized":"2022-05-01T04:30:42.885825+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":5,"last_scrub":"264'433","last_scrub_stamp":"2022-05-01T04:29:49.430810+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.430810+0000","objects_scrubbed":74,"log_size":459,"ondisk_log_size":459,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.2245067409999999,"objects_trimmed":0,"snaptrim_duration":0.75287199800000004,"stat_sum":{"num_bytes":95657072,"num_objects":39,"num_object_clones":8,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":121,"num_read_kb":76398,"num_write":249,"num_write_kb":62964,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":168,"num_bytes_recovered":183552292,"num_keys_recovered":160,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,6],"acting":[7,4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.10","version":"306'494","reported_seq":1770,"reported_epoch":306,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:45.217681+0000","last_change":"2022-05-01T04:30:45.217681+0000","last_active":"2022-05-01T04:30:45.217681+0000","last_peered":"2022-05-01T04:30:45.217681+0000","last_clean":"2022-05-01T04:30:45.217681+0000","last_became_active":"2022-05-01T04:30:25.327719+0000","last_became_peered":"2022-05-01T04:30:25.327719+0000","last_unstale":"2022-05-01T04:30:45.217681+0000","last_undegraded":"2022-05-01T04:30:45.217681+0000","last_fullsized":"2022-05-01T04:30:45.217681+0000","mapping_epoch":299,"log_start":"0'0","ondisk_log_start":"0'0","created":274,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":5,"last_scrub":"305'492","last_scrub_stamp":"2022-05-01T04:30:44.966852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.966852+0000","objects_scrubbed":31,"log_size":494,"ondisk_log_size":494,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":9,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:06.496639+0000","scrub_duration":0.313975106,"objects_trimmed":0,"snaptrim_duration":1.37659145,"stat_sum":{"num_bytes":90587458,"num_objects":31,"num_object_clones":3,"num_object_copies":93,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0,5],"acting":[6,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.f","version":"277'540","reported_seq":1311,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886800+0000","last_change":"2022-05-01T04:30:16.500449+0000","last_active":"2022-05-01T04:30:42.886800+0000","last_peered":"2022-05-01T04:30:42.886800+0000","last_clean":"2022-05-01T04:30:42.886800+0000","last_became_active":"2022-05-01T04:30:16.399454+0000","last_became_peered":"2022-05-01T04:30:16.399454+0000","last_unstale":"2022-05-01T04:30:42.886800+0000","last_undegraded":"2022-05-01T04:30:42.886800+0000","last_fullsized":"2022-05-01T04:30:42.886800+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"164'412","last_scrub_stamp":"2022-05-01T04:28:16.288822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:16.288822+0000","objects_scrubbed":63,"log_size":540,"ondisk_log_size":540,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81907881800000004,"objects_trimmed":0,"snaptrim_duration":0.72566574800000005,"stat_sum":{"num_bytes":198947307,"num_objects":70,"num_object_clones":8,"num_object_copies":210,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":70,"num_whiteouts":2,"num_read":226,"num_read_kb":100373,"num_write":447,"num_write_kb":118211,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":2944186,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,0],"acting":[7,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.e","version":"276'657","reported_seq":1965,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886057+0000","last_change":"2022-05-01T04:30:02.666116+0000","last_active":"2022-05-01T04:30:42.886057+0000","last_peered":"2022-05-01T04:30:42.886057+0000","last_clean":"2022-05-01T04:30:42.886057+0000","last_became_active":"2022-05-01T04:29:15.968177+0000","last_became_peered":"2022-05-01T04:29:15.968177+0000","last_unstale":"2022-05-01T04:30:42.886057+0000","last_undegraded":"2022-05-01T04:30:42.886057+0000","last_fullsized":"2022-05-01T04:30:42.886057+0000","mapping_epoch":232,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":233,"parent":"0.0","parent_split_bits":0,"last_scrub":"251'588","last_scrub_stamp":"2022-05-01T04:29:37.821007+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:37.821007+0000","objects_scrubbed":80,"log_size":657,"ondisk_log_size":657,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.62661968000000001,"objects_trimmed":0,"snaptrim_duration":0.88139935800000002,"stat_sum":{"num_bytes":238859551,"num_objects":88,"num_object_clones":14,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":88,"num_whiteouts":2,"num_read":259,"num_read_kb":84476,"num_write":573,"num_write_kb":169626,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":218,"num_bytes_recovered":228132670,"num_keys_recovered":80,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4,1],"acting":[7,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.d","version":"304'452","reported_seq":1559,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.466858+0000","last_change":"2022-05-01T04:30:43.466858+0000","last_active":"2022-05-01T04:30:43.466858+0000","last_peered":"2022-05-01T04:30:43.466858+0000","last_clean":"2022-05-01T04:30:43.466858+0000","last_became_active":"2022-05-01T04:30:17.429652+0000","last_became_peered":"2022-05-01T04:30:17.429652+0000","last_unstale":"2022-05-01T04:30:43.466858+0000","last_undegraded":"2022-05-01T04:30:43.466858+0000","last_fullsized":"2022-05-01T04:30:43.466858+0000","mapping_epoch":292,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":300,"parent":"0.0","parent_split_bits":0,"last_scrub":"304'452","last_scrub_stamp":"2022-05-01T04:30:43.262739+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.262739+0000","objects_scrubbed":64,"log_size":452,"ondisk_log_size":452,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:08.333726+0000","scrub_duration":0.92506281099999998,"objects_trimmed":0,"snaptrim_duration":0.50948584399999997,"stat_sum":{"num_bytes":171885785,"num_objects":64,"num_object_clones":10,"num_object_copies":192,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":64,"num_whiteouts":1,"num_read":184,"num_read_kb":90112,"num_write":428,"num_write_kb":108352,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":122,"num_bytes_recovered":115470720,"num_keys_recovered":180,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5,6],"acting":[7,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.c","version":"306'496","reported_seq":2106,"reported_epoch":306,"state":"active+clean+snaptrim","last_fresh":"2022-05-01T04:30:45.425481+0000","last_change":"2022-05-01T04:30:45.425481+0000","last_active":"2022-05-01T04:30:45.425481+0000","last_peered":"2022-05-01T04:30:45.425481+0000","last_clean":"2022-05-01T04:30:45.425481+0000","last_became_active":"2022-05-01T04:30:39.013083+0000","last_became_peered":"2022-05-01T04:30:39.013083+0000","last_unstale":"2022-05-01T04:30:45.425481+0000","last_undegraded":"2022-05-01T04:30:45.425481+0000","last_fullsized":"2022-05-01T04:30:45.425481+0000","mapping_epoch":303,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":304,"parent":"0.0","parent_split_bits":0,"last_scrub":"249'466","last_scrub_stamp":"2022-05-01T04:29:36.465699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:36.465699+0000","objects_scrubbed":62,"log_size":496,"ondisk_log_size":496,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":3,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.81548162000000002,"objects_trimmed":0,"snaptrim_duration":1.142217163,"stat_sum":{"num_bytes":167437493,"num_objects":63,"num_object_clones":7,"num_object_copies":189,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":63,"num_whiteouts":2,"num_read":271,"num_read_kb":161213,"num_write":425,"num_write_kb":112139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":431,"num_bytes_recovered":451139640,"num_keys_recovered":91,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,6],"acting":[5,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"2"},{"start":"cc","length":"2"}]},{"pgid":"3.b","version":"261'397","reported_seq":1750,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971191+0000","last_change":"2022-05-01T04:30:07.810362+0000","last_active":"2022-05-01T04:30:42.971191+0000","last_peered":"2022-05-01T04:30:42.971191+0000","last_clean":"2022-05-01T04:30:42.971191+0000","last_became_active":"2022-05-01T04:30:07.195503+0000","last_became_peered":"2022-05-01T04:30:07.195503+0000","last_unstale":"2022-05-01T04:30:42.971191+0000","last_undegraded":"2022-05-01T04:30:42.971191+0000","last_fullsized":"2022-05-01T04:30:42.971191+0000","mapping_epoch":282,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":283,"parent":"0.0","parent_split_bits":0,"last_scrub":"248'389","last_scrub_stamp":"2022-05-01T04:29:39.348483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.348483+0000","objects_scrubbed":68,"log_size":397,"ondisk_log_size":397,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.05234216,"objects_trimmed":0,"snaptrim_duration":0.61416249099999998,"stat_sum":{"num_bytes":179141560,"num_objects":68,"num_object_clones":8,"num_object_copies":204,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":68,"num_whiteouts":2,"num_read":206,"num_read_kb":69949,"num_write":398,"num_write_kb":107432,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":300,"num_bytes_recovered":339541664,"num_keys_recovered":220,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,4],"acting":[3,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.a","version":"272'477","reported_seq":1749,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886252+0000","last_change":"2022-05-01T04:29:58.990005+0000","last_active":"2022-05-01T04:30:42.886252+0000","last_peered":"2022-05-01T04:30:42.886252+0000","last_clean":"2022-05-01T04:30:42.886252+0000","last_became_active":"2022-05-01T04:29:08.175363+0000","last_became_peered":"2022-05-01T04:29:08.175363+0000","last_unstale":"2022-05-01T04:30:42.886252+0000","last_undegraded":"2022-05-01T04:30:42.886252+0000","last_fullsized":"2022-05-01T04:30:42.886252+0000","mapping_epoch":224,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":225,"parent":"0.0","parent_split_bits":0,"last_scrub":"247'454","last_scrub_stamp":"2022-05-01T04:29:39.093953+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:39.093953+0000","objects_scrubbed":70,"log_size":477,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:46.460212+0000","scrub_duration":1.3648651510000001,"objects_trimmed":0,"snaptrim_duration":0.15573891400000001,"stat_sum":{"num_bytes":197706553,"num_objects":71,"num_object_clones":8,"num_object_copies":213,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":71,"num_whiteouts":2,"num_read":262,"num_read_kb":159904,"num_write":471,"num_write_kb":128600,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":172,"num_bytes_recovered":193253880,"num_keys_recovered":160,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,1],"acting":[6,4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.9","version":"276'505","reported_seq":1361,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.894496+0000","last_change":"2022-05-01T04:30:40.000604+0000","last_active":"2022-05-01T04:30:42.894496+0000","last_peered":"2022-05-01T04:30:42.894496+0000","last_clean":"2022-05-01T04:30:42.894496+0000","last_became_active":"2022-05-01T04:29:59.090857+0000","last_became_peered":"2022-05-01T04:29:59.090857+0000","last_unstale":"2022-05-01T04:30:42.894496+0000","last_undegraded":"2022-05-01T04:30:42.894496+0000","last_fullsized":"2022-05-01T04:30:42.894496+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"276'505","last_scrub_stamp":"2022-05-01T04:30:40.000406+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:40.000406+0000","objects_scrubbed":33,"log_size":505,"ondisk_log_size":505,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:40.973401+0000","scrub_duration":1.1692613220000001,"objects_trimmed":0,"snaptrim_duration":0.71138417200000004,"stat_sum":{"num_bytes":88684995,"num_objects":33,"num_object_clones":4,"num_object_copies":99,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":1,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7],"acting":[4,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.8","version":"273'465","reported_seq":2276,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971123+0000","last_change":"2022-05-01T04:30:08.055718+0000","last_active":"2022-05-01T04:30:42.971123+0000","last_peered":"2022-05-01T04:30:42.971123+0000","last_clean":"2022-05-01T04:30:42.971123+0000","last_became_active":"2022-05-01T04:30:00.189790+0000","last_became_peered":"2022-05-01T04:30:00.189790+0000","last_unstale":"2022-05-01T04:30:42.971123+0000","last_undegraded":"2022-05-01T04:30:42.971123+0000","last_fullsized":"2022-05-01T04:30:42.971123+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":284,"parent":"0.0","parent_split_bits":0,"last_scrub":"145'356","last_scrub_stamp":"2022-05-01T04:27:48.809995+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.809995+0000","objects_scrubbed":62,"log_size":465,"ondisk_log_size":465,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.92147099200000004,"objects_trimmed":0,"snaptrim_duration":0.101109292,"stat_sum":{"num_bytes":96164905,"num_objects":39,"num_object_clones":10,"num_object_copies":117,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":39,"num_whiteouts":1,"num_read":116,"num_read_kb":48609,"num_write":276,"num_write_kb":64534,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":235,"num_bytes_recovered":252683112,"num_keys_recovered":230,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":129,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.097278+0000","last_change":"2022-05-01T04:30:43.097130+0000","last_active":"2022-05-01T04:30:43.097278+0000","last_peered":"2022-05-01T04:30:43.097278+0000","last_clean":"2022-05-01T04:30:43.097278+0000","last_became_active":"2022-05-01T04:28:42.075951+0000","last_became_peered":"2022-05-01T04:28:42.075951+0000","last_unstale":"2022-05-01T04:30:43.097278+0000","last_undegraded":"2022-05-01T04:30:43.097278+0000","last_fullsized":"2022-05-01T04:30:43.097278+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:43.097017+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.097017+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:12.069270+0000","scrub_duration":0.562521787,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"300'475","reported_seq":2132,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971873+0000","last_change":"2022-05-01T04:30:30.786613+0000","last_active":"2022-05-01T04:30:42.971873+0000","last_peered":"2022-05-01T04:30:42.971873+0000","last_clean":"2022-05-01T04:30:42.971873+0000","last_became_active":"2022-05-01T04:30:21.445664+0000","last_became_peered":"2022-05-01T04:30:21.445664+0000","last_unstale":"2022-05-01T04:30:42.971873+0000","last_undegraded":"2022-05-01T04:30:42.971873+0000","last_fullsized":"2022-05-01T04:30:42.971873+0000","mapping_epoch":296,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":297,"parent":"0.0","parent_split_bits":0,"last_scrub":"127'322","last_scrub_stamp":"2022-05-01T04:27:36.926299+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:36.926299+0000","objects_scrubbed":0,"log_size":475,"ondisk_log_size":475,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.3750655649999999,"objects_trimmed":0,"snaptrim_duration":5.6648302790000002,"stat_sum":{"num_bytes":78914214,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":1,"num_read":103,"num_read_kb":29450,"num_write":243,"num_write_kb":57719,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":239,"num_bytes_recovered":241573064,"num_keys_recovered":170,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3,2],"acting":[5,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.2","version":"0'0","reported_seq":37,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.098496+0000","last_change":"2022-05-01T04:30:02.996712+0000","last_active":"2022-05-01T04:30:43.098496+0000","last_peered":"2022-05-01T04:30:43.098496+0000","last_clean":"2022-05-01T04:30:43.098496+0000","last_became_active":"2022-05-01T04:30:02.896021+0000","last_became_peered":"2022-05-01T04:30:02.896021+0000","last_unstale":"2022-05-01T04:30:43.098496+0000","last_undegraded":"2022-05-01T04:30:43.098496+0000","last_fullsized":"2022-05-01T04:30:43.098496+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:52.422661+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:52.422661+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:05.375337+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"275'566","reported_seq":1429,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794267+0000","last_change":"2022-05-01T04:30:35.848139+0000","last_active":"2022-05-01T04:30:42.794267+0000","last_peered":"2022-05-01T04:30:42.794267+0000","last_clean":"2022-05-01T04:30:42.794267+0000","last_became_active":"2022-05-01T04:29:59.089639+0000","last_became_peered":"2022-05-01T04:29:59.089639+0000","last_unstale":"2022-05-01T04:30:42.794267+0000","last_undegraded":"2022-05-01T04:30:42.794267+0000","last_fullsized":"2022-05-01T04:30:42.794267+0000","mapping_epoch":19,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"263'558","last_scrub_stamp":"2022-05-01T04:29:51.115969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:29:51.115969+0000","objects_scrubbed":74,"log_size":566,"ondisk_log_size":566,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.89133616299999996,"objects_trimmed":0,"snaptrim_duration":0.89342225399999997,"stat_sum":{"num_bytes":102081757,"num_objects":37,"num_object_clones":5,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":0,"num_read":127,"num_read_kb":52726,"num_write":256,"num_write_kb":65818,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":397,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.020574+0000","last_change":"2022-05-01T04:29:51.118516+0000","last_active":"2022-05-01T04:30:43.020574+0000","last_peered":"2022-05-01T04:30:43.020574+0000","last_clean":"2022-05-01T04:30:43.020574+0000","last_became_active":"2022-05-01T04:29:51.118117+0000","last_became_peered":"2022-05-01T04:29:51.118117+0000","last_unstale":"2022-05-01T04:30:43.020574+0000","last_undegraded":"2022-05-01T04:30:43.020574+0000","last_fullsized":"2022-05-01T04:30:43.020574+0000","mapping_epoch":266,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":267,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:40.698524+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:40.698524+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:45.889971+0000","scrub_duration":0.50325435799999996,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"273'490","reported_seq":1611,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.895251+0000","last_change":"2022-05-01T04:30:33.642210+0000","last_active":"2022-05-01T04:30:42.895251+0000","last_peered":"2022-05-01T04:30:42.895251+0000","last_clean":"2022-05-01T04:30:42.895251+0000","last_became_active":"2022-05-01T04:29:58.888029+0000","last_became_peered":"2022-05-01T04:29:58.888029+0000","last_unstale":"2022-05-01T04:30:42.895251+0000","last_undegraded":"2022-05-01T04:30:42.895251+0000","last_fullsized":"2022-05-01T04:30:42.895251+0000","mapping_epoch":238,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"146'349","last_scrub_stamp":"2022-05-01T04:27:49.793846+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:49.793846+0000","objects_scrubbed":58,"log_size":490,"ondisk_log_size":490,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.51835619799999999,"objects_trimmed":0,"snaptrim_duration":0.00046417000000000002,"stat_sum":{"num_bytes":93110778,"num_objects":37,"num_object_clones":10,"num_object_copies":111,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":37,"num_whiteouts":2,"num_read":103,"num_read_kb":46934,"num_write":215,"num_write_kb":63006,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":80,"num_bytes_recovered":83574846,"num_keys_recovered":40,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.3","version":"0'0","reported_seq":47,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.071675+0000","last_change":"2022-05-01T04:30:41.934135+0000","last_active":"2022-05-01T04:30:43.071675+0000","last_peered":"2022-05-01T04:30:43.071675+0000","last_clean":"2022-05-01T04:30:43.071675+0000","last_became_active":"2022-05-01T04:30:02.982092+0000","last_became_peered":"2022-05-01T04:30:02.982092+0000","last_unstale":"2022-05-01T04:30:43.071675+0000","last_undegraded":"2022-05-01T04:30:43.071675+0000","last_fullsized":"2022-05-01T04:30:43.071675+0000","mapping_epoch":278,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":279,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:41.933990+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:41.933990+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:45.211294+0000","scrub_duration":0.30281493700000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"24'117","reported_seq":271,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.885606+0000","last_change":"2022-05-01T04:30:35.384860+0000","last_active":"2022-05-01T04:30:42.885606+0000","last_peered":"2022-05-01T04:30:42.885606+0000","last_clean":"2022-05-01T04:30:42.885606+0000","last_became_active":"2022-05-01T04:30:16.238972+0000","last_became_peered":"2022-05-01T04:30:16.238972+0000","last_unstale":"2022-05-01T04:30:42.885606+0000","last_undegraded":"2022-05-01T04:30:42.885606+0000","last_fullsized":"2022-05-01T04:30:42.885606+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":15,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"24'117","last_scrub_stamp":"2022-05-01T04:28:00.739540+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:15.316890+0000","last_clean_scrub_stamp":"2022-05-01T04:28:00.739540+0000","objects_scrubbed":0,"log_size":117,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2","version":"273'535","reported_seq":2048,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.971294+0000","last_change":"2022-05-01T04:30:37.327909+0000","last_active":"2022-05-01T04:30:42.971294+0000","last_peered":"2022-05-01T04:30:42.971294+0000","last_clean":"2022-05-01T04:30:42.971294+0000","last_became_active":"2022-05-01T04:30:37.005571+0000","last_became_peered":"2022-05-01T04:30:37.005571+0000","last_unstale":"2022-05-01T04:30:42.971294+0000","last_undegraded":"2022-05-01T04:30:42.971294+0000","last_fullsized":"2022-05-01T04:30:42.971294+0000","mapping_epoch":301,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":302,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'347","last_scrub_stamp":"2022-05-01T04:27:13.521008+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:27:13.521008+0000","objects_scrubbed":81,"log_size":535,"ondisk_log_size":535,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"queued for scrub","scrub_duration":1.9964351630000001,"objects_trimmed":0,"snaptrim_duration":0.32170438600000001,"stat_sum":{"num_bytes":111968433,"num_objects":43,"num_object_clones":7,"num_object_copies":129,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":43,"num_whiteouts":1,"num_read":140,"num_read_kb":72872,"num_write":290,"num_write_kb":74976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":157,"num_bytes_recovered":166104272,"num_keys_recovered":60,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":150,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.985883+0000","last_change":"2022-05-01T04:30:38.332044+0000","last_active":"2022-05-01T04:30:42.985883+0000","last_peered":"2022-05-01T04:30:42.985883+0000","last_clean":"2022-05-01T04:30:42.985883+0000","last_became_active":"2022-05-01T04:30:16.267154+0000","last_became_peered":"2022-05-01T04:30:16.267154+0000","last_unstale":"2022-05-01T04:30:42.985883+0000","last_undegraded":"2022-05-01T04:30:42.985883+0000","last_fullsized":"2022-05-01T04:30:42.985883+0000","mapping_epoch":291,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":292,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:28:12.658835+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:28:12.658835+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.304165821,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"294'453","reported_seq":1881,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:44.651118+0000","last_change":"2022-05-01T04:30:44.651012+0000","last_active":"2022-05-01T04:30:44.651118+0000","last_peered":"2022-05-01T04:30:44.651118+0000","last_clean":"2022-05-01T04:30:44.651118+0000","last_became_active":"2022-05-01T04:30:06.174043+0000","last_became_peered":"2022-05-01T04:30:06.174043+0000","last_unstale":"2022-05-01T04:30:44.651118+0000","last_undegraded":"2022-05-01T04:30:44.651118+0000","last_fullsized":"2022-05-01T04:30:44.651118+0000","mapping_epoch":281,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":290,"parent":"0.0","parent_split_bits":0,"last_scrub":"294'453","last_scrub_stamp":"2022-05-01T04:30:44.650869+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.650869+0000","objects_scrubbed":28,"log_size":453,"ondisk_log_size":453,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":2,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:31:47.041633+0000","scrub_duration":1.0091338110000001,"objects_trimmed":0,"snaptrim_duration":0.466307156,"stat_sum":{"num_bytes":71326779,"num_objects":28,"num_object_clones":6,"num_object_copies":84,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":327,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.886488+0000","last_change":"2022-05-01T04:29:49.588507+0000","last_active":"2022-05-01T04:30:42.886488+0000","last_peered":"2022-05-01T04:30:42.886488+0000","last_clean":"2022-05-01T04:30:42.886488+0000","last_became_active":"2022-05-01T04:25:17.351886+0000","last_became_peered":"2022-05-01T04:25:17.351886+0000","last_unstale":"2022-05-01T04:30:42.886488+0000","last_undegraded":"2022-05-01T04:30:42.886488+0000","last_fullsized":"2022-05-01T04:30:42.886488+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:29:49.588383+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:29:49.588383+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:30:54.942702+0000","scrub_duration":0.30376289400000001,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.4","version":"264'361","reported_seq":1795,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.795559+0000","last_change":"2022-05-01T04:30:37.735039+0000","last_active":"2022-05-01T04:30:42.795559+0000","last_peered":"2022-05-01T04:30:42.795559+0000","last_clean":"2022-05-01T04:30:42.795559+0000","last_became_active":"2022-05-01T04:30:13.311320+0000","last_became_peered":"2022-05-01T04:30:13.311320+0000","last_unstale":"2022-05-01T04:30:42.795559+0000","last_undegraded":"2022-05-01T04:30:42.795559+0000","last_fullsized":"2022-05-01T04:30:42.795559+0000","mapping_epoch":288,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":289,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'324","last_scrub_stamp":"2022-05-01T04:28:11.783670+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:28:11.783670+0000","objects_scrubbed":50,"log_size":361,"ondisk_log_size":361,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","scrub_duration":0.66231246799999999,"objects_trimmed":0,"snaptrim_duration":0.00086617699999999998,"stat_sum":{"num_bytes":83569377,"num_objects":30,"num_object_clones":4,"num_object_copies":90,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":77,"num_read_kb":10111,"num_write":178,"num_write_kb":57287,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":179,"num_bytes_recovered":177664904,"num_keys_recovered":10,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,5],"acting":[1,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"3.7","version":"273'533","reported_seq":2020,"reported_epoch":306,"state":"active+clean","last_fresh":"2022-05-01T04:30:44.251951+0000","last_change":"2022-05-01T04:30:44.251861+0000","last_active":"2022-05-01T04:30:44.251951+0000","last_peered":"2022-05-01T04:30:44.251951+0000","last_clean":"2022-05-01T04:30:44.251951+0000","last_became_active":"2022-05-01T04:29:59.991809+0000","last_became_peered":"2022-05-01T04:29:59.991809+0000","last_unstale":"2022-05-01T04:30:44.251951+0000","last_undegraded":"2022-05-01T04:30:44.251951+0000","last_fullsized":"2022-05-01T04:30:44.251951+0000","mapping_epoch":275,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":281,"parent":"0.0","parent_split_bits":0,"last_scrub":"273'533","last_scrub_stamp":"2022-05-01T04:30:44.251736+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:44.251736+0000","objects_scrubbed":46,"log_size":533,"ondisk_log_size":533,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:13.952725+0000","scrub_duration":0.57039800500000004,"objects_trimmed":0,"snaptrim_duration":0.40617742299999998,"stat_sum":{"num_bytes":119043437,"num_objects":46,"num_object_clones":12,"num_object_copies":138,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":46,"num_whiteouts":2,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":120,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:42.794919+0000","last_change":"2022-05-01T04:30:29.747580+0000","last_active":"2022-05-01T04:30:42.794919+0000","last_peered":"2022-05-01T04:30:42.794919+0000","last_clean":"2022-05-01T04:30:42.794919+0000","last_became_active":"2022-05-01T04:28:42.261299+0000","last_became_peered":"2022-05-01T04:28:42.261299+0000","last_unstale":"2022-05-01T04:30:42.794919+0000","last_undegraded":"2022-05-01T04:30:42.794919+0000","last_fullsized":"2022-05-01T04:30:42.794919+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:27:48.745287+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:27:48.745287+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":395,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.865335+0000","last_change":"2022-05-01T04:30:43.865062+0000","last_active":"2022-05-01T04:30:43.865335+0000","last_peered":"2022-05-01T04:30:43.865335+0000","last_clean":"2022-05-01T04:30:43.865335+0000","last_became_active":"2022-05-01T04:29:05.170684+0000","last_became_peered":"2022-05-01T04:29:05.170684+0000","last_unstale":"2022-05-01T04:30:43.865335+0000","last_undegraded":"2022-05-01T04:30:43.865335+0000","last_fullsized":"2022-05-01T04:30:43.865335+0000","mapping_epoch":221,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":222,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-05-01T04:30:43.864934+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:16.318133+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.864934+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:06.201732+0000","scrub_duration":0.204585195,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.6","version":"277'573","reported_seq":1947,"reported_epoch":305,"state":"active+clean","last_fresh":"2022-05-01T04:30:43.103309+0000","last_change":"2022-05-01T04:30:43.103199+0000","last_active":"2022-05-01T04:30:43.103309+0000","last_peered":"2022-05-01T04:30:43.103309+0000","last_clean":"2022-05-01T04:30:43.103309+0000","last_became_active":"2022-05-01T04:29:58.986844+0000","last_became_peered":"2022-05-01T04:29:58.986844+0000","last_unstale":"2022-05-01T04:30:43.103309+0000","last_undegraded":"2022-05-01T04:30:43.103309+0000","last_fullsized":"2022-05-01T04:30:43.103309+0000","mapping_epoch":214,"log_start":"0'0","ondisk_log_start":"0'0","created":19,"last_epoch_clean":275,"parent":"0.0","parent_split_bits":0,"last_scrub":"277'573","last_scrub_stamp":"2022-05-01T04:30:43.103081+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-05-01T04:25:24.710872+0000","last_clean_scrub_stamp":"2022-05-01T04:30:43.103081+0000","objects_scrubbed":26,"log_size":573,"ondisk_log_size":573,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-05-01T04:32:09.192011+0000","scrub_duration":0.413295617,"objects_trimmed":0,"snaptrim_duration":0.91696671600000002,"stat_sum":{"num_bytes":65937440,"num_objects":26,"num_object_clones":6,"num_object_copies":78,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"a2","length":"1"},{"start":"ac","length":"1"},{"start":"c3","length":"2"},{"start":"c8","length":"3"},{"start":"cc","length":"2"},{"start":"d0","length":"1"},{"start":"e3","length":"1"}]}],"pool_stats":[{"poolid":3,"num_pg":26,"stat_sum":{"num_bytes":3033482507,"num_objects":1138,"num_object_clones":186,"num_object_copies":3414,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1138,"num_whiteouts":28,"num_read":2984,"num_read_kb":1354232,"num_write":6058,"num_write_kb":1635629,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3293,"num_bytes_recovered":3515279523,"num_keys_recovered":1981,"num_objects_omap":64,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4649717760,"data_stored":4855667241,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":654892,"internal_metadata":0},"log_size":12961,"ondisk_log_size":12961,"up":78,"acting":78,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":2129920,"data_stored":2115712,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":3,"acting":3,"num_store_stats":5},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574919,"num_pgs":19,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":803700,"kb_used_data":760236,"kb_used_omap":0,"kb_used_meta":43456,"kb_avail":93568140,"statfs":{"total":96636764160,"available":95813775360,"internally_reserved":0,"allocated":778481664,"data_stored":807990595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":44498944},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":10.657,"5min":24.966000000000001,"15min":57.649999999999999},"min":{"1min":0.47599999999999998,"5min":0.42899999999999999,"15min":0.42899999999999999},"max":{"1min":85.858999999999995,"5min":518.15200000000004,"15min":518.15200000000004},"last":1.143},{"interface":"front","average":{"1min":2.96,"5min":4.0540000000000003,"15min":7.8920000000000003},"min":{"1min":0.505,"5min":0.433,"15min":0.433},"max":{"1min":40.087000000000003,"5min":99.054000000000002,"15min":99.054000000000002},"last":1.175}]},{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":4.6619999999999999,"5min":1.5369999999999999,"15min":1.0309999999999999},"min":{"1min":0.52900000000000003,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":62.966999999999999,"5min":62.966999999999999,"15min":62.966999999999999},"last":1.111},{"interface":"front","average":{"1min":7.3620000000000001,"5min":10.083,"15min":9.2400000000000002},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":98.472999999999999,"5min":98.472999999999999,"15min":98.472999999999999},"last":1.244}]},{"osd":2,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":3.3980000000000001,"5min":9.7639999999999993,"15min":24.231000000000002},"min":{"1min":0.57099999999999995,"5min":0.54300000000000004,"15min":0.54300000000000004},"max":{"1min":48.801000000000002,"5min":252.857,"15min":252.857},"last":1.026},{"interface":"front","average":{"1min":5.5060000000000002,"5min":16.396999999999998,"15min":44.088999999999999},"min":{"1min":0.59799999999999998,"5min":0.59799999999999998,"15min":0.59799999999999998},"max":{"1min":41.975000000000001,"5min":310.839,"15min":310.839},"last":1.0609999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":3.0129999999999999,"5min":1.401,"15min":1.131},"min":{"1min":0.70899999999999996,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":40.189999999999998,"5min":40.189999999999998,"15min":40.189999999999998},"last":1.3520000000000001},{"interface":"front","average":{"1min":1.0129999999999999,"5min":1.1140000000000001,"15min":1.1499999999999999},"min":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"max":{"1min":1.5600000000000001,"5min":3.585,"15min":3.585},"last":1.21}]},{"osd":4,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":3.927,"5min":3.835,"15min":3.3570000000000002},"min":{"1min":0.55800000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":40.259999999999998,"5min":100.727,"15min":100.727},"last":0.80000000000000004},{"interface":"front","average":{"1min":1.028,"5min":12.026,"15min":25.09},"min":{"1min":0.67000000000000004,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":1.4450000000000001,"5min":252.94900000000001,"15min":252.94900000000001},"last":0.89900000000000002}]},{"osd":5,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.3410000000000002,"5min":10.968999999999999,"15min":24.16},"min":{"1min":0.63,"5min":0.58899999999999997,"15min":0.58899999999999997},"max":{"1min":42.119999999999997,"5min":301.91000000000003,"15min":301.91000000000003},"last":0.95099999999999996},{"interface":"front","average":{"1min":6.9429999999999996,"5min":5.1079999999999997,"15min":10.957000000000001},"min":{"1min":0.69899999999999995,"5min":0.69899999999999995,"15min":0.69899999999999995},"max":{"1min":72.120999999999995,"5min":159.309,"15min":159.309},"last":0.97799999999999998}]},{"osd":6,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":6.9029999999999996,"5min":10.384,"15min":26.631},"min":{"1min":0.77100000000000002,"5min":0.68300000000000005,"15min":0.68300000000000005},"max":{"1min":69.748999999999995,"5min":294.37,"15min":294.37},"last":1.2809999999999999},{"interface":"front","average":{"1min":4.8680000000000003,"5min":14.615,"15min":43.470999999999997},"min":{"1min":0.874,"5min":0.71299999999999997,"15min":0.71299999999999997},"max":{"1min":69.724000000000004,"5min":294.82299999999998,"15min":294.82299999999998},"last":1.3069999999999999}]}]},{"osd":6,"up_from":13,"seq":55834574918,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":592860,"kb_used_data":555540,"kb_used_omap":0,"kb_used_meta":37312,"kb_avail":93778980,"statfs":{"total":96636764160,"available":96029675520,"internally_reserved":0,"allocated":568872960,"data_stored":588717970,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":38207488},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":12.117000000000001,"5min":20.341999999999999,"15min":40.899000000000001},"min":{"1min":0.53600000000000003,"5min":0.46300000000000002,"15min":0.46300000000000002},"max":{"1min":146.00800000000001,"5min":474.91300000000001,"15min":474.91300000000001},"last":1.5740000000000001},{"interface":"front","average":{"1min":16.079999999999998,"5min":14.685,"15min":24.908999999999999},"min":{"1min":0.53400000000000003,"5min":0.46999999999999997,"15min":0.46999999999999997},"max":{"1min":146.03,"5min":296.67500000000001,"15min":296.67500000000001},"last":1.214}]},{"osd":1,"last update":"Sun May 1 04:30:41 2022","interfaces":[{"interface":"back","average":{"1min":4.9189999999999996,"5min":3.6520000000000001,"15min":1.833},"min":{"1min":0.60499999999999998,"5min":0.56200000000000006,"15min":0.56200000000000006},"max":{"1min":74.247,"5min":100.899,"15min":100.899},"last":0.998},{"interface":"front","average":{"1min":4.1319999999999997,"5min":3.0790000000000002,"15min":3.1509999999999998},"min":{"1min":0.65900000000000003,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":58.203000000000003,"5min":58.203000000000003,"15min":58.203000000000003},"last":1.4670000000000001}]},{"osd":2,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":3.0529999999999999,"5min":12.288,"15min":31.699000000000002},"min":{"1min":0.65600000000000003,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":37.988999999999997,"5min":384.75700000000001,"15min":384.75700000000001},"last":1.1850000000000001},{"interface":"front","average":{"1min":4.9180000000000001,"5min":7.1749999999999998,"15min":16.774000000000001},"min":{"1min":0.66200000000000003,"5min":0.59399999999999997,"15min":0.59399999999999997},"max":{"1min":74.480999999999995,"5min":160.499,"15min":160.499},"last":1.6240000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:12 2022","interfaces":[{"interface":"back","average":{"1min":5.1210000000000004,"5min":6.2729999999999997,"15min":6.0990000000000002},"min":{"1min":0.65400000000000003,"5min":0.63300000000000001,"15min":0.63300000000000001},"max":{"1min":39.613999999999997,"5min":93.191999999999993,"15min":93.191999999999993},"last":1.3660000000000001},{"interface":"front","average":{"1min":5.5700000000000003,"5min":2.5150000000000001,"15min":1.544},"min":{"1min":0.81699999999999995,"5min":0.64400000000000002,"15min":0.64400000000000002},"max":{"1min":45.993000000000002,"5min":49.615000000000002,"15min":49.615000000000002},"last":1.3300000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":0.99299999999999999,"5min":9.2210000000000001,"15min":28.965},"min":{"1min":0.64400000000000002,"5min":0.56399999999999995,"15min":0.56399999999999995},"max":{"1min":1.736,"5min":384.22199999999998,"15min":384.22199999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":17.77,"5min":14.365,"15min":32.424999999999997},"min":{"1min":0.64800000000000002,"5min":0.64300000000000002,"15min":0.64300000000000002},"max":{"1min":167.744,"5min":290.24200000000002,"15min":290.24200000000002},"last":1.391}]},{"osd":5,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":2.6059999999999999,"5min":9.2119999999999997,"15min":20.93},"min":{"1min":0.61899999999999999,"5min":0.61899999999999999,"15min":0.61899999999999999},"max":{"1min":33.787999999999997,"5min":276.17000000000002,"15min":276.17000000000002},"last":1.272},{"interface":"front","average":{"1min":4.8029999999999999,"5min":13.064,"15min":40.137999999999998},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":69.587999999999994,"5min":384.64299999999997,"15min":384.64299999999997},"last":1.657}]},{"osd":7,"last update":"Sun May 1 04:30:20 2022","interfaces":[{"interface":"back","average":{"1min":8.8539999999999992,"5min":26.236999999999998,"15min":76.006},"min":{"1min":0.88500000000000001,"5min":0.69399999999999995,"15min":0.69399999999999995},"max":{"1min":74.135000000000005,"5min":670.42999999999995,"15min":670.42999999999995},"last":1.538},{"interface":"front","average":{"1min":2.778,"5min":4.8630000000000004,"15min":2.327},"min":{"1min":0.79300000000000004,"5min":0.70699999999999996,"15min":0.70699999999999996},"max":{"1min":33.892000000000003,"5min":94.379999999999995,"15min":94.379999999999995},"last":1.5209999999999999}]}]},{"osd":1,"up_from":134,"seq":575525617704,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":583412,"kb_used_data":540012,"kb_used_omap":652,"kb_used_meta":42739,"kb_avail":93788428,"statfs":{"total":96636764160,"available":96039350272,"internally_reserved":0,"allocated":552972288,"data_stored":578843183,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":668200,"internal_metadata":43765208},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":7.4340000000000002,"5min":9.7579999999999991,"15min":9.3960000000000008},"min":{"1min":0.55700000000000005,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":152.63800000000001,"5min":176.80000000000001,"15min":176.80000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":0.91000000000000003,"5min":7.5279999999999996,"15min":8.6859999999999999},"min":{"1min":0.71499999999999997,"5min":0.58599999999999997,"15min":0.58599999999999997},"max":{"1min":1.1599999999999999,"5min":176.886,"15min":176.886},"last":1.0620000000000001}]},{"osd":2,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":9.1899999999999995,"5min":5.5839999999999996,"15min":4.1920000000000002},"min":{"1min":0.67300000000000004,"5min":0.55400000000000005,"15min":0.55400000000000005},"max":{"1min":153.50700000000001,"5min":153.50700000000001,"15min":153.50700000000001},"last":1.028},{"interface":"front","average":{"1min":0.83699999999999997,"5min":1.339,"15min":1.0169999999999999},"min":{"1min":0.59299999999999997,"5min":0.59299999999999997,"15min":0.59299999999999997},"max":{"1min":1.2410000000000001,"5min":34.151000000000003,"15min":34.151000000000003},"last":1.2230000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":7.7270000000000003,"5min":3.8700000000000001,"15min":2.02},"min":{"1min":0.80300000000000005,"5min":0.70299999999999996,"15min":0.70299999999999996},"max":{"1min":153.66499999999999,"5min":153.66499999999999,"15min":153.66499999999999},"last":1.444},{"interface":"front","average":{"1min":1.095,"5min":1.6379999999999999,"15min":1.3340000000000001},"min":{"1min":0.85099999999999998,"5min":0.73699999999999999,"15min":0.73699999999999999},"max":{"1min":1.3799999999999999,"5min":34.658000000000001,"15min":34.658000000000001},"last":1.3799999999999999}]},{"osd":4,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":11.423,"5min":10.010999999999999,"15min":9.7490000000000006},"min":{"1min":0.86799999999999999,"5min":0.66900000000000004,"15min":0.66900000000000004},"max":{"1min":93.575000000000003,"5min":93.575000000000003,"15min":93.575000000000003},"last":1.532},{"interface":"front","average":{"1min":20.222000000000001,"5min":6.9699999999999998,"15min":3.0339999999999998},"min":{"1min":0.86699999999999999,"5min":0.67400000000000004,"15min":0.67400000000000004},"max":{"1min":182.101,"5min":182.101,"15min":182.101},"last":1.1000000000000001}]},{"osd":5,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":1.208,"5min":1.7270000000000001,"15min":1.411},"min":{"1min":0.68400000000000005,"5min":0.68400000000000005,"15min":0.68400000000000005},"max":{"1min":1.7390000000000001,"5min":34.417999999999999,"15min":34.417999999999999},"last":1.7390000000000001},{"interface":"front","average":{"1min":12.800000000000001,"5min":4.8769999999999998,"15min":2.3610000000000002},"min":{"1min":0.77800000000000002,"5min":0.755,"15min":0.755},"max":{"1min":87.403000000000006,"5min":87.403000000000006,"15min":87.403000000000006},"last":1.4139999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":8.4019999999999992,"5min":5.1319999999999997,"15min":2.5960000000000001},"min":{"1min":0.90400000000000003,"5min":0.81999999999999995,"15min":0.81999999999999995},"max":{"1min":87.778999999999996,"5min":87.778999999999996,"15min":87.778999999999996},"last":1.605},{"interface":"front","average":{"1min":8.5630000000000006,"5min":4.2729999999999997,"15min":2.351},"min":{"1min":0.96199999999999997,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":153.84700000000001,"5min":153.84700000000001,"15min":153.84700000000001},"last":1.6739999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:44 2022","interfaces":[{"interface":"back","average":{"1min":16.396000000000001,"5min":8.6020000000000003,"15min":5.9100000000000001},"min":{"1min":1.0569999999999999,"5min":0.92800000000000005,"15min":0.92800000000000005},"max":{"1min":182.24700000000001,"5min":182.24700000000001,"15min":182.24700000000001},"last":1.8680000000000001},{"interface":"front","average":{"1min":10.667,"5min":4.758,"15min":2.573},"min":{"1min":1.0469999999999999,"5min":1.0469999999999999,"15min":1.0469999999999999},"max":{"1min":153.999,"5min":153.999,"15min":153.999},"last":1.8320000000000001}]}]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":613588,"kb_used_data":572940,"kb_used_omap":0,"kb_used_meta":40640,"kb_avail":93758252,"statfs":{"total":96636764160,"available":96008450048,"internally_reserved":0,"allocated":586690560,"data_stored":614157248,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":41615360},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":1.25,"5min":3.8290000000000002,"15min":4.7629999999999999},"min":{"1min":0.59299999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":9.2599999999999998,"5min":94.671999999999997,"15min":94.671999999999997},"last":0.96199999999999997},{"interface":"front","average":{"1min":1.3979999999999999,"5min":4.5099999999999998,"15min":2.8420000000000001},"min":{"1min":0.61799999999999999,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":9.3369999999999997,"5min":218.80099999999999,"15min":218.80099999999999},"last":1.161}]},{"osd":2,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":4.1360000000000001,"5min":6.1109999999999998,"15min":10.724},"min":{"1min":0.60699999999999998,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":37.590000000000003,"5min":106.374,"15min":106.374},"last":0.998},{"interface":"front","average":{"1min":3.9159999999999999,"5min":18.167999999999999,"15min":47.347999999999999},"min":{"1min":0.67000000000000004,"5min":0.54900000000000004,"15min":0.54900000000000004},"max":{"1min":62.494999999999997,"5min":497.91500000000002,"15min":497.91500000000002},"last":1.2090000000000001}]},{"osd":3,"last update":"Sun May 1 04:30:13 2022","interfaces":[{"interface":"back","average":{"1min":0.88,"5min":3.3580000000000001,"15min":2.4969999999999999},"min":{"1min":0.58999999999999997,"5min":0.53700000000000003,"15min":0.53700000000000003},"max":{"1min":1.528,"5min":176.02699999999999,"15min":176.02699999999999},"last":1.0389999999999999},{"interface":"front","average":{"1min":6.5469999999999997,"5min":2.7210000000000001,"15min":2.2480000000000002},"min":{"1min":0.73599999999999999,"5min":0.73599999999999999,"15min":0.73599999999999999},"max":{"1min":48.159999999999997,"5min":48.159999999999997,"15min":48.159999999999997},"last":1.256}]},{"osd":4,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":5.4749999999999996,"5min":11.779,"15min":21.771000000000001},"min":{"1min":0.78800000000000003,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":91.885999999999996,"5min":248.709,"15min":248.709},"last":1.8400000000000001},{"interface":"front","average":{"1min":10.771000000000001,"5min":20.896000000000001,"15min":34.020000000000003},"min":{"1min":0.92400000000000004,"5min":0.69799999999999995,"15min":0.69799999999999995},"max":{"1min":94.790000000000006,"5min":315.69400000000002,"15min":315.69400000000002},"last":1.7769999999999999}]},{"osd":5,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":5.2300000000000004,"5min":20.780999999999999,"15min":51.606000000000002},"min":{"1min":0.97599999999999998,"5min":0.622,"15min":0.622},"max":{"1min":66.656999999999996,"5min":540.08900000000006,"15min":540.08900000000006},"last":1.7549999999999999},{"interface":"front","average":{"1min":3.895,"5min":10.922000000000001,"15min":13.324},"min":{"1min":0.93600000000000005,"5min":0.71799999999999997,"15min":0.71799999999999997},"max":{"1min":55.593000000000004,"5min":176.32599999999999,"15min":176.32599999999999},"last":1.9419999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":7.5250000000000004,"5min":16.742000000000001,"15min":30.303999999999998},"min":{"1min":0.88100000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"max":{"1min":62.244999999999997,"5min":240.36600000000001,"15min":240.36600000000001},"last":1.8819999999999999},{"interface":"front","average":{"1min":1.4530000000000001,"5min":24.437000000000001,"15min":62.009999999999998},"min":{"1min":1.151,"5min":0.73799999999999999,"15min":0.73799999999999999},"max":{"1min":2.456,"5min":498.05399999999997,"15min":498.05399999999997},"last":1.964}]},{"osd":7,"last update":"Sun May 1 04:30:28 2022","interfaces":[{"interface":"back","average":{"1min":1.4450000000000001,"5min":34.844000000000001,"15min":113.08499999999999},"min":{"1min":1.129,"5min":0.78500000000000003,"15min":0.78500000000000003},"max":{"1min":2.3029999999999999,"5min":1663.876,"15min":1663.876},"last":1.865},{"interface":"front","average":{"1min":7.1310000000000002,"5min":31.765999999999998,"15min":97.912999999999997},"min":{"1min":1.157,"5min":0.90500000000000003,"15min":0.90500000000000003},"max":{"1min":101.224,"5min":844.65300000000002,"15min":844.65300000000002},"last":2.0299999999999998}]}]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":255172,"kb_used_data":227004,"kb_used_omap":0,"kb_used_meta":28160,"kb_avail":94116668,"statfs":{"total":96636764160,"available":96375468032,"internally_reserved":0,"allocated":232452096,"data_stored":245001212,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":28835840},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":3.6150000000000002,"5min":3.8660000000000001,"15min":1.8120000000000001},"min":{"1min":0.54200000000000004,"5min":0.443,"15min":0.443},"max":{"1min":54.290999999999997,"5min":72.322000000000003,"15min":72.322000000000003},"last":0.84199999999999997},{"interface":"front","average":{"1min":1.419,"5min":22.989999999999998,"15min":58.119},"min":{"1min":0.52900000000000003,"5min":0.46500000000000002,"15min":0.46500000000000002},"max":{"1min":9.8650000000000002,"5min":465.05200000000002,"15min":465.05200000000002},"last":0.89100000000000001}]},{"osd":1,"last update":"Sun May 1 04:30:41 2022","interfaces":[{"interface":"back","average":{"1min":1.2569999999999999,"5min":14.868,"15min":17.003},"min":{"1min":0.54800000000000004,"5min":0.53100000000000003,"15min":0.53100000000000003},"max":{"1min":9.3889999999999993,"5min":153.101,"15min":153.101},"last":0.92700000000000005},{"interface":"front","average":{"1min":3.2469999999999999,"5min":2.8300000000000001,"15min":1.5489999999999999},"min":{"1min":0.621,"5min":0.51000000000000001,"15min":0.51000000000000001},"max":{"1min":52.039000000000001,"5min":117.398,"15min":117.398},"last":1.145}]},{"osd":3,"last update":"Sun May 1 04:30:08 2022","interfaces":[{"interface":"back","average":{"1min":1.5529999999999999,"5min":1.212,"15min":0.95799999999999996},"min":{"1min":0.69299999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"max":{"1min":13.390000000000001,"5min":21.312000000000001,"15min":21.312000000000001},"last":1.29},{"interface":"front","average":{"1min":1.034,"5min":0.93799999999999994,"15min":0.90600000000000003},"min":{"1min":0.73999999999999999,"5min":0.56699999999999995,"15min":0.56699999999999995},"max":{"1min":1.879,"5min":1.879,"15min":1.879},"last":1.0760000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":2.7200000000000002,"5min":5.6219999999999999,"15min":13.254},"min":{"1min":0.88300000000000001,"5min":0.66600000000000004,"15min":0.66600000000000004},"max":{"1min":35.039999999999999,"5min":147.17099999999999,"15min":147.17099999999999},"last":1.4239999999999999},{"interface":"front","average":{"1min":2.2959999999999998,"5min":11.9,"15min":31.994},"min":{"1min":0.89200000000000002,"5min":0.68100000000000005,"15min":0.68100000000000005},"max":{"1min":26.298999999999999,"5min":240.71000000000001,"15min":240.71000000000001},"last":1.206}]},{"osd":5,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":1.6910000000000001,"5min":11.964,"15min":14.513},"min":{"1min":0.85799999999999998,"5min":0.61799999999999999,"15min":0.61799999999999999},"max":{"1min":13.206,"5min":260.42099999999999,"15min":260.42099999999999},"last":1.383},{"interface":"front","average":{"1min":1.4139999999999999,"5min":4.7229999999999999,"15min":11.933999999999999},"min":{"1min":0.98199999999999998,"5min":0.73899999999999999,"15min":0.73899999999999999},"max":{"1min":3.492,"5min":196.74799999999999,"15min":196.74799999999999},"last":1.655}]},{"osd":6,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":10.991,"5min":8.7520000000000007,"15min":20.745999999999999},"min":{"1min":0.82799999999999996,"5min":0.76400000000000001,"15min":0.76400000000000001},"max":{"1min":174.387,"5min":174.387,"15min":174.387},"last":1.353},{"interface":"front","average":{"1min":1.7849999999999999,"5min":16.550999999999998,"15min":34.046999999999997},"min":{"1min":0.93000000000000005,"5min":0.76100000000000001,"15min":0.76100000000000001},"max":{"1min":13.034000000000001,"5min":269.53100000000001,"15min":269.53100000000001},"last":1.5169999999999999}]},{"osd":7,"last update":"Sun May 1 04:30:23 2022","interfaces":[{"interface":"back","average":{"1min":1.556,"5min":1.4970000000000001,"15min":1.744},"min":{"1min":1.0289999999999999,"5min":0.82999999999999996,"15min":0.82999999999999996},"max":{"1min":4.008,"5min":11.654999999999999,"15min":11.654999999999999},"last":1.464},{"interface":"front","average":{"1min":1.873,"5min":10.037000000000001,"15min":15.815},"min":{"1min":1.05,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":13.332000000000001,"5min":160.547,"15min":160.547},"last":1.623}]}]},{"osd":3,"up_from":105,"seq":450971566126,"num_pgs":13,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":695516,"kb_used_data":665620,"kb_used_omap":2,"kb_used_meta":29885,"kb_avail":93676324,"statfs":{"total":96636764160,"available":95924555776,"internally_reserved":0,"allocated":681594880,"data_stored":700583997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":30602427},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.748,"5min":4.7389999999999999,"15min":6.298},"min":{"1min":0.55400000000000005,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":0.93999999999999995,"5min":73.262,"15min":73.262},"last":0.63900000000000001},{"interface":"front","average":{"1min":7.7329999999999997,"5min":6.2919999999999998,"15min":7.1989999999999998},"min":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"max":{"1min":72.561000000000007,"5min":97.546999999999997,"15min":97.546999999999997},"last":0.56599999999999995}]},{"osd":1,"last update":"Sun May 1 04:30:40 2022","interfaces":[{"interface":"back","average":{"1min":6.1150000000000002,"5min":2.4169999999999998,"15min":1.387},"min":{"1min":0.60799999999999998,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":79.268000000000001,"5min":79.268000000000001,"15min":79.268000000000001},"last":0.749},{"interface":"front","average":{"1min":3.6040000000000001,"5min":2.262,"15min":1.3360000000000001},"min":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":42.411000000000001,"5min":51.715000000000003,"15min":51.715000000000003},"last":0.53900000000000003}]},{"osd":2,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":0.97499999999999998,"5min":0.94599999999999995,"15min":0.94399999999999995},"min":{"1min":0.64500000000000002,"5min":0.53400000000000003,"15min":0.53400000000000003},"max":{"1min":1.841,"5min":2.4849999999999999,"15min":2.4849999999999999},"last":0.72599999999999998},{"interface":"front","average":{"1min":5.4009999999999998,"5min":4.351,"15min":4.7690000000000001},"min":{"1min":0.748,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":73.284000000000006,"5min":83.582999999999998,"15min":83.582999999999998},"last":0.89000000000000001}]},{"osd":4,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":14.065,"5min":6.859,"15min":4.4889999999999999},"min":{"1min":0.80500000000000005,"5min":0.61299999999999999,"15min":0.61299999999999999},"max":{"1min":88.811000000000007,"5min":97.501999999999995,"15min":97.501999999999995},"last":1.018},{"interface":"front","average":{"1min":1.1459999999999999,"5min":2.3220000000000001,"15min":2.8300000000000001},"min":{"1min":0.76600000000000001,"5min":0.72499999999999998,"15min":0.72499999999999998},"max":{"1min":1.7150000000000001,"5min":42.081000000000003,"15min":42.081000000000003},"last":0.94999999999999996}]},{"osd":5,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":1.3540000000000001,"5min":1.3029999999999999,"15min":1.284},"min":{"1min":1.0660000000000001,"5min":0.86199999999999999,"15min":0.86199999999999999},"max":{"1min":1.885,"5min":1.9079999999999999,"15min":1.9079999999999999},"last":1.353},{"interface":"front","average":{"1min":5.4340000000000002,"5min":4.4109999999999996,"15min":3.9750000000000001},"min":{"1min":0.81100000000000005,"5min":0.81100000000000005,"15min":0.81100000000000005},"max":{"1min":72.870000000000005,"5min":91.775999999999996,"15min":91.775999999999996},"last":1.27}]},{"osd":6,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":4.7539999999999996,"5min":2.681,"15min":1.7549999999999999},"min":{"1min":0.76900000000000002,"5min":0.76900000000000002,"15min":0.76900000000000002},"max":{"1min":60.124000000000002,"5min":78.131,"15min":78.131},"last":1.1279999999999999},{"interface":"front","average":{"1min":3.6890000000000001,"5min":4.7919999999999998,"15min":4.3760000000000003},"min":{"1min":1.0840000000000001,"5min":1.014,"15min":1.014},"max":{"1min":39.942999999999998,"5min":89.192999999999998,"15min":89.192999999999998},"last":1.246}]},{"osd":7,"last update":"Sun May 1 04:30:09 2022","interfaces":[{"interface":"back","average":{"1min":7.8170000000000002,"5min":2.6709999999999998,"15min":1.8169999999999999},"min":{"1min":0.98599999999999999,"5min":0.97099999999999997,"15min":0.97099999999999997},"max":{"1min":73.015000000000001,"5min":73.015000000000001,"15min":73.015000000000001},"last":1.1419999999999999},{"interface":"front","average":{"1min":6.5549999999999997,"5min":3.1709999999999998,"15min":1.954},"min":{"1min":0.90800000000000003,"5min":0.90800000000000003,"15min":0.90800000000000003},"max":{"1min":89.414000000000001,"5min":89.414000000000001,"15min":89.414000000000001},"last":1.389}]}]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":833920,"kb_used_data":778360,"kb_used_omap":0,"kb_used_meta":55552,"kb_avail":93537920,"statfs":{"total":96636764160,"available":95782830080,"internally_reserved":0,"allocated":797040640,"data_stored":838331730,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":56885248},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":5.0339999999999998,"5min":13.298999999999999,"15min":22.567},"min":{"1min":0.499,"5min":0.44900000000000001,"15min":0.44900000000000001},"max":{"1min":78.052999999999997,"5min":257.822,"15min":257.822},"last":0.63},{"interface":"front","average":{"1min":7.0049999999999999,"5min":9.2729999999999997,"15min":21.509},"min":{"1min":0.56399999999999995,"5min":0.49199999999999999,"15min":0.49199999999999999},"max":{"1min":58.395000000000003,"5min":256.291,"15min":256.291},"last":1.171}]},{"osd":1,"last update":"Sun May 1 04:30:42 2022","interfaces":[{"interface":"back","average":{"1min":4.0570000000000004,"5min":5.4969999999999999,"15min":6.1210000000000004},"min":{"1min":0.57899999999999996,"5min":0.53800000000000003,"15min":0.53800000000000003},"max":{"1min":66.712999999999994,"5min":91.667000000000002,"15min":91.667000000000002},"last":0.65900000000000003},{"interface":"front","average":{"1min":0.95699999999999996,"5min":4.5990000000000002,"15min":2.464},"min":{"1min":0.623,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.284,"5min":129.15799999999999,"15min":129.15799999999999},"last":0.92400000000000004}]},{"osd":2,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":0.91900000000000004,"5min":8.8599999999999994,"15min":20.228000000000002},"min":{"1min":0.56200000000000006,"5min":0.505,"15min":0.505},"max":{"1min":1.2669999999999999,"5min":256.45999999999998,"15min":256.45999999999998},"last":0.84799999999999998},{"interface":"front","average":{"1min":0.97699999999999998,"5min":6.8630000000000004,"15min":14.843},"min":{"1min":0.74099999999999999,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":1.222,"5min":174.048,"15min":174.048},"last":1.111}]},{"osd":3,"last update":"Sun May 1 04:30:11 2022","interfaces":[{"interface":"back","average":{"1min":6.1619999999999999,"5min":4.6959999999999997,"15min":4.4619999999999997},"min":{"1min":0.80700000000000005,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":97.203999999999994,"5min":97.203999999999994,"15min":97.203999999999994},"last":1.0409999999999999},{"interface":"front","average":{"1min":1.0349999999999999,"5min":3.8929999999999998,"15min":3.2010000000000001},"min":{"1min":0.72799999999999998,"5min":0.66800000000000004,"15min":0.66800000000000004},"max":{"1min":1.3260000000000001,"5min":91.527000000000001,"15min":91.527000000000001},"last":1.256}]},{"osd":5,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.4220000000000002,"5min":12.462999999999999,"15min":23.196999999999999},"min":{"1min":0.65500000000000003,"5min":0.56799999999999995,"15min":0.56799999999999995},"max":{"1min":27.620000000000001,"5min":159.648,"15min":159.648},"last":1.077},{"interface":"front","average":{"1min":1.0940000000000001,"5min":10.414,"15min":29.292000000000002},"min":{"1min":0.83199999999999996,"5min":0.63200000000000001,"15min":0.63200000000000001},"max":{"1min":1.4350000000000001,"5min":256.18799999999999,"15min":256.18799999999999},"last":1.2849999999999999}]},{"osd":6,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.8769999999999998,"5min":9.3179999999999996,"15min":16.654},"min":{"1min":0.80900000000000005,"5min":0.64900000000000002,"15min":0.64900000000000002},"max":{"1min":34.543999999999997,"5min":174.274,"15min":174.274},"last":1.3540000000000001},{"interface":"front","average":{"1min":5.2380000000000004,"5min":13.058,"15min":24.372},"min":{"1min":0.91600000000000004,"5min":0.67900000000000005,"15min":0.67900000000000005},"max":{"1min":54.326999999999998,"5min":231.74799999999999,"15min":231.74799999999999},"last":1.206}]},{"osd":7,"last update":"Sun May 1 04:30:25 2022","interfaces":[{"interface":"back","average":{"1min":2.0859999999999999,"5min":15.888,"15min":48.289999999999999},"min":{"1min":0.998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":16.422000000000001,"5min":652.226,"15min":652.226},"last":1.381},{"interface":"front","average":{"1min":9.3469999999999995,"5min":20.452999999999999,"15min":46.524999999999999},"min":{"1min":0.94799999999999995,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":106.176,"5min":376.32900000000001,"15min":376.32900000000001},"last":1.4530000000000001}]}]},{"osd":5,"up_from":13,"seq":55834574917,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":504132,"kb_used_data":470204,"kb_used_omap":0,"kb_used_meta":33920,"kb_avail":93867708,"statfs":{"total":96636764160,"available":96120532992,"internally_reserved":0,"allocated":481488896,"data_stored":496073002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":34734080},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.6230000000000002,"5min":14.685,"15min":33.274000000000001},"min":{"1min":0.49099999999999999,"5min":0.46400000000000002,"15min":0.46400000000000002},"max":{"1min":63.991999999999997,"5min":334.69799999999998,"15min":334.69799999999998},"last":0.71499999999999997},{"interface":"front","average":{"1min":13.112,"5min":13.273,"15min":21.361000000000001},"min":{"1min":0.76800000000000002,"5min":0.48499999999999999,"15min":0.48499999999999999},"max":{"1min":106.07899999999999,"5min":282.01999999999998,"15min":282.01999999999998},"last":1.0940000000000001}]},{"osd":1,"last update":"Sun May 1 04:30:38 2022","interfaces":[{"interface":"back","average":{"1min":5.5499999999999998,"5min":3.177,"15min":1.6739999999999999},"min":{"1min":0.52100000000000002,"5min":0.52100000000000002,"15min":0.52100000000000002},"max":{"1min":110.831,"5min":110.831,"15min":110.831},"last":0.98099999999999998},{"interface":"front","average":{"1min":4.25,"5min":3.0640000000000001,"15min":1.599},"min":{"1min":0.69599999999999995,"5min":0.56000000000000005,"15min":0.56000000000000005},"max":{"1min":40.506,"5min":58.759,"15min":58.759},"last":1.014}]},{"osd":2,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":8.2409999999999997,"5min":3.5129999999999999,"15min":4.2510000000000003},"min":{"1min":0.58399999999999996,"5min":0.45400000000000001,"15min":0.45400000000000001},"max":{"1min":106.206,"5min":106.206,"15min":106.206},"last":0.93700000000000006},{"interface":"front","average":{"1min":5.3499999999999996,"5min":4.0759999999999996,"15min":9.5099999999999998},"min":{"1min":0.66700000000000004,"5min":0.621,"15min":0.621},"max":{"1min":110.908,"5min":150.518,"15min":150.518},"last":1.4159999999999999}]},{"osd":3,"last update":"Sun May 1 04:30:10 2022","interfaces":[{"interface":"back","average":{"1min":5.3099999999999996,"5min":1.879,"15min":1.3069999999999999},"min":{"1min":0.751,"5min":0.72099999999999997,"15min":0.72099999999999997},"max":{"1min":110.706,"5min":110.706,"15min":110.706},"last":1.2},{"interface":"front","average":{"1min":7.556,"5min":2.3849999999999998,"15min":1.486},"min":{"1min":0.84699999999999998,"5min":0.64700000000000002,"15min":0.64700000000000002},"max":{"1min":76.444000000000003,"5min":76.444000000000003,"15min":76.444000000000003},"last":1.1319999999999999}]},{"osd":4,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":1.0049999999999999,"5min":11.669,"15min":36.732999999999997},"min":{"1min":0.58599999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.4339999999999999,"5min":385.29300000000001,"15min":385.29300000000001},"last":0.91500000000000004},{"interface":"front","average":{"1min":11.545999999999999,"5min":11.125,"15min":19.908000000000001},"min":{"1min":0.59599999999999997,"5min":0.59599999999999997,"15min":0.59599999999999997},"max":{"1min":106.327,"5min":189.869,"15min":189.869},"last":1.2490000000000001}]},{"osd":6,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":5.9960000000000004,"5min":12.663,"15min":28.815000000000001},"min":{"1min":0.80700000000000005,"5min":0.64000000000000001,"15min":0.64000000000000001},"max":{"1min":110.61199999999999,"5min":332.26299999999998,"15min":332.26299999999998},"last":1.327},{"interface":"front","average":{"1min":1.827,"5min":7,"15min":17.992999999999999},"min":{"1min":0.71199999999999997,"5min":0.66100000000000003,"15min":0.66100000000000003},"max":{"1min":17.824000000000002,"5min":295.99299999999999,"15min":295.99299999999999},"last":1.2310000000000001}]},{"osd":7,"last update":"Sun May 1 04:30:26 2022","interfaces":[{"interface":"back","average":{"1min":12.597,"5min":31.109999999999999,"15min":93.878},"min":{"1min":0.69799999999999995,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":152.393,"5min":1543.201,"15min":1543.201},"last":1.5629999999999999},{"interface":"front","average":{"1min":9.4559999999999995,"5min":6.2789999999999999,"15min":12.819000000000001},"min":{"1min":0.89100000000000001,"5min":0.76000000000000001,"15min":0.76000000000000001},"max":{"1min":110.771,"5min":150.71100000000001,"15min":150.71100000000001},"last":1.488}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":582623232,"data_stored":612072706,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":549437440,"data_stored":577287569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":652007,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":228917248,"data_stored":243445598,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":678060032,"data_stored":699028383,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":2885,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":793505792,"data_stored":836776116,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":477954048,"data_stored":494517388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":564805632,"data_stored":586633428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":774414336,"data_stored":805906053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-05-01T04:30:51.074 DEBUG:teuthology.orchestra.run.smithi061:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2022-05-01T10:42:31.596 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:30:56.855 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2022-05-01T04:30:44.650869+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=44, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:30:56.856 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2022-05-01T04:29:49.588383+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=29, tm_sec=49, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:30:56.856 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2022-05-01T04:28:11.783670+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=28, tm_sec=11, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) 2022-05-01T10:42:31.597 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:31:37.605 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2022-05-01T04:29:39.348483+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=29, tm_sec=39, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:31:37.607 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2022-05-01T04:30:48.005729+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=48, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) , 2022-05-01T04:31:37.607 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2022-05-01T04:30:43.097017+0000 time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=43, tm_wday=6, tm_yday=121, tm_isdst=-1) <= time.struct_time(tm_year=2022, tm_mon=5, tm_mday=1, tm_hour=4, tm_min=30, tm_sec=51, tm_wday=6, tm_yday=121, tm_isdst=0) 2022-05-01T10:42:31.597 WARNING:scrape:Ignoring malparsed backtrace: raise CommandCrashedError(command=self.command) , teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --balance-reads --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' , 2022-05-01T04:32:18.690 INFO:teuthology.misc:Shutting down mds daemons... 2022-05-01T10:42:31.597 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:32:22.368 DEBUG:teuthology.orchestra.run.smithi061:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2022-05-01T04:32:22.380 DEBUG:teuthology.orchestra.run.smithi136:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2022-05-01T04:32:51.327 INFO:tasks.ceph:Archiving logs... 2022-05-01T10:42:31.597 WARNING:scrape:Ignoring malparsed backtrace: 2022-05-01T04:33:23.756 INFO:teuthology.task.internal:Transferring binaries for coredumps... , 2022-05-01T04:33:23.798 INFO:teuthology.task.internal: core looks like: /home/teuthworker/archive/rfriedma-2022-04-30_17:51:41-rados:thrash-wip-rf-80cls-v1-distro-basic-smithi/6816343/remote/smithi061/coredump/1651379397.97363.core.gz: gzip compressed data, was "1651379397.97363.core", last modified: Sun May 1 04:33:05 2022, max compression , 2022-05-01T10:42:31.636 INFO:scrape:Found 2 distinct failure reasons 2022-05-01T10:42:31.636 INFO:scrape:Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --balance-reads --max-ops 400000 --objects 1024 --max-in-flight 64 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op snap_create 50 --op snap_remove 50 --op rollback 50 --op setattr 25 --op rmattr 25 --op copy_from 50 --op write_excl 50 --pool unique_pool_0' 2022-05-01T10:42:31.637 INFO:scrape:1 jobs: ['6816343'] 2022-05-01T10:42:31.637 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/default', 'thrashosds-health', 'workloads/small-objects-balanced}'] 2022-05-01T10:42:31.637 INFO:scrape: 2022-05-01T10:42:31.637 INFO:scrape:Dead: b'2022-05-01T10:38:02.652 DEBUG:teuthology.exit:Finished running handlers' 2022-05-01T10:42:31.637 INFO:scrape:1 jobs: ['6816331'] 2022-05-01T10:42:31.637 INFO:scrape:suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados:thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/default', 'thrashosds-health', 'workloads/cache-snaps}'] 2022-05-01T10:42:31.638 INFO:scrape: