Found 327 jobs Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Ignoring malparsed backtrace: ceph version 17.0.0-10314-gfc4f59a1 (fc4f59a13b5cfe31b1d75dc7e873c108d04bff91) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x152) [0x7f9ec5e4bf64] , 2: /usr/lib64/ceph/libceph-common.so.2(+0x283185) [0x7f9ec5e4c185] Ignoring malparsed backtrace: 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "MOSDPGPush(4.d 166/165 [PushOp(4:b1c761f9:::smithi09033386-13:52, version: 163'118, data_included: [1675490~872745,2844123~63521], data_size: 936266, omap_header_size: 0, omap_entries_size: 0, attrset_size: 0, recovery_info: ObjectRecoveryInfo(4:b1c761f9:::smithi09033386-13:52@163'118, size: 2907644, copy_subset: [0~2907644], clone_subset: {}, snapset: 67=[]:{3d=[2e],52=[52],67=[67,66,64,63,61,60,5a,56,54]}, object_exist: 0), after_progress: ObjectRecoveryProgress(!first, data_recovered_to:2907644, data_complete:true, omap_recovered_to:, omap_complete:true, error:false), before_progress: ObjectRecoveryProgress(!first, data_recovered_to:1675490, data_complete:false, omap_recovered_to:, omap_complete:true, error:false))])", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:11:53.693582+0000", , 2022-02-03T04:12:07.953 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 14.244802862, Ignoring malparsed backtrace: 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.4610000000000002e-06 , 2022-02-03T04:12:07.978 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:07.979 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.003 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091866+0000", , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.0363000000000001e-05 , 2022-02-03T04:12:08.004 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:08.143 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.148044+0000", , 2022-02-03T04:12:08.144 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.178 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.179 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.201 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:08.202 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.347677+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:08.224 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.247 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.270 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.292 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.293 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.315 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:08.338 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:08.360 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.999999 , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:08.361 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:08.383 INFO:teuthology.orchestra.run.smithi160.stdout:} , 2022-02-03T04:12:08.384 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub Ignoring malparsed backtrace: 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_info": { , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client": "client.4394", , 2022-02-03T04:12:08.907 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", Ignoring malparsed backtrace: 2022-02-03T04:12:08.931 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.932 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", Ignoring malparsed backtrace: 2022-02-03T04:12:08.955 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:10:57.129708+0000", , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 71.758565727000004, , 2022-02-03T04:12:08.956 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.030533663999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:08.979 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:57.159997+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.001 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.002 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.024 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:53.486132+0000", , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 15.402141873, , 2022-02-03T04:12:09.025 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.027021092, Ignoring malparsed backtrace: 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.047 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.048 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513153+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", , 2022-02-03T04:12:09.070 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513191+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", , 2022-02-03T04:12:09.093 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:53.513584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:09.115 INFO:teuthology.orchestra.run.smithi090.stdout: ] , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.116 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.138 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.139 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4531 4.b 4.c3d07c6b (undecoded) ondisk+read+rwordered+known_if_redirected+supports_pool_eio e170)", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "initiated_at": "2022-02-03T04:11:57.680679+0000", , 2022-02-03T04:12:09.161 INFO:teuthology.orchestra.run.smithi090.stdout: "age": 11.207594289999999, Ignoring malparsed backtrace: 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0223e-05 , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.184 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.206 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0093750670000000008 , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.207 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00012792500000000001 , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.229 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000131507 , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.252 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.1380000000000007e-06 , 2022-02-03T04:12:09.275 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.276 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00027832600000000002 , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.298 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: "ops": [ , 2022-02-03T04:12:09.784 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:09.785 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:1214 4.4 4:22a5f7cc:::smithi09033386-19:head [write 645402~551297] snapc e=[d,5,4,2] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e43)", Ignoring malparsed backtrace: 2022-02-03T04:12:09.825 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.025740587999999998, , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "type_data": { , 2022-02-03T04:12:09.826 INFO:teuthology.orchestra.run.smithi090.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:09.867 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 1216 , 2022-02-03T04:12:09.868 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "initiated", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237742+0000", , 2022-02-03T04:12:09.906 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.930 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237760+0000", , 2022-02-03T04:12:09.931 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:09.954 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:42.237842+0000", , 2022-02-03T04:12:09.955 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 3.4620000000000001e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:09.979 INFO:teuthology.orchestra.run.smithi090.stdout: } , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:09.980 INFO:teuthology.orchestra.run.smithi090.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.007 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.288848+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.037 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289215+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.061 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289479+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.086 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289508+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.110 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:10.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:09:47.289529+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.135 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:10:35.608249+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.159 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "dispatched", Ignoring malparsed backtrace: 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.184 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.185 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.208 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.231 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.232 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "sub_op_commit_rec", Ignoring malparsed backtrace: 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:10.255 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.682 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", Ignoring malparsed backtrace: 2022-02-03T04:12:10.707 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { , 2022-02-03T04:12:10.708 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", Ignoring malparsed backtrace: 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.733 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00050517800000000001 , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.759 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00031426700000000002 , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:10.784 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", , 2022-02-03T04:12:10.810 INFO:teuthology.orchestra.run.smithi160.stdout: "client_info": { Ignoring malparsed backtrace: 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.857752+0000", , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999976 , 2022-02-03T04:12:10.835 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.230514+0000", , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.00016135100000000001 , 2022-02-03T04:12:10.861 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:34.236257+0000", , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 8.2038000000000003e-05 , 2022-02-03T04:12:10.887 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:53.356081+0000", , 2022-02-03T04:12:10.913 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "commit_sent", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:22.444201+0000", , 2022-02-03T04:12:10.938 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0070842350000000004 Ignoring malparsed backtrace: 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:10.965 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116050+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:10.990 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:10.991 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.116766+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.016 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:11.017 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.117725+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", , 2022-02-03T04:12:11.042 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:49.118539+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client": "client.4394", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:11.069 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4296 Ignoring malparsed backtrace: 2022-02-03T04:12:11.474 INFO:teuthology.orchestra.run.smithi090.stdout:4.4 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.17 , 2022-02-03T04:12:11.475 INFO:teuthology.orchestra.run.smithi090.stdout:4.14 Ignoring malparsed backtrace: 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.814919+0000", , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0068661119999999997 , 2022-02-03T04:12:11.583 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.018230751, , 2022-02-03T04:12:11.607 INFO:teuthology.orchestra.run.smithi160.stdout: "type_data": { , 2022-02-03T04:12:11.608 INFO:teuthology.orchestra.run.smithi160.stdout: "flag_point": "commit sent; apply or cleanup", Ignoring malparsed backtrace: 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "started", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.818397+0000", , 2022-02-03T04:12:11.631 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 2.4552000000000001e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.662 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:24.861584+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "initiated_at": "2022-02-03T04:09:24.865698+0000", , 2022-02-03T04:12:11.685 INFO:teuthology.orchestra.run.smithi160.stdout: "age": 166.67146077699999, , 2022-02-03T04:12:11.686 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.016890948999999999, Ignoring malparsed backtrace: 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.714 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:11.740 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:11.741 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.8652000000000002e-05 , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.768 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.2179e-05 , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.800 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 3132 , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.829 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124253+0000", , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4.3889999999999998e-06 , 2022-02-03T04:12:11.856 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:11.890 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:11.891 INFO:teuthology.orchestra.run.smithi160.stdout: "description": "osd_op(client.4394.0:4554 4.a 4:586ade6a:::smithi09033386-47:head [read 0~3848836,checksum] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:11.918 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.124330+0000", , 2022-02-03T04:12:11.919 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.9260000000000002e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.357 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "queued_for_pg", , 2022-02-03T04:12:12.358 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.430827+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 0,6", , 2022-02-03T04:12:12.381 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.945332+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.404 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "op_commit", , 2022-02-03T04:12:12.405 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:09:07.953337+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: ] , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.428 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.451 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", Ignoring malparsed backtrace: 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 , 2022-02-03T04:12:12.474 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.475 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.497 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 7.8121999999999995e-05 , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.498 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000103553 , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.521 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5104999999999997e-05 , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.544 INFO:teuthology.orchestra.run.smithi160.stdout: ] Ignoring malparsed backtrace: 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:55.126833+0000", , 2022-02-03T04:12:12.567 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.7979999999999999e-06 , 2022-02-03T04:12:12.568 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:12.590 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.138835+0000", , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.003272184 , 2022-02-03T04:12:12.591 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "header_read", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:10:57.117784+0000", , 2022-02-03T04:12:12.614 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 4294967295.9999995 Ignoring malparsed backtrace: 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "waiting for subops from 3,6", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:00.133726+0000", , 2022-02-03T04:12:12.637 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.000189502 Ignoring malparsed backtrace: 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: } , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:12.660 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:12.683 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "all_read", , 2022-02-03T04:12:12.684 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:36.401701+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.119505+0000", , 2022-02-03T04:12:13.111 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 1.0550000000000001e-05 , 2022-02-03T04:12:13.112 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.313754+0000", , 2022-02-03T04:12:13.134 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.190594755 , 2022-02-03T04:12:13.135 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.316127+0000", , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000203389 , 2022-02-03T04:12:13.158 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.317712+0000", , 2022-02-03T04:12:13.181 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00023261500000000001 , 2022-02-03T04:12:13.182 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:14.322230+0000", , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000117087 , 2022-02-03T04:12:13.204 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.226 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.168293+0000", , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 8.5115000000000001e-05 , 2022-02-03T04:12:13.227 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177481+0000", , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.0419000000000005e-05 , 2022-02-03T04:12:13.249 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177360+0000", , 2022-02-03T04:12:13.271 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.0064976119999999998 , 2022-02-03T04:12:13.272 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.171732+0000", , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.00011505099999999999 , 2022-02-03T04:12:13.294 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4538 , 2022-02-03T04:12:13.316 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.338 INFO:teuthology.orchestra.run.smithi090.stdout: "client_addr": "172.21.15.90:0/3468573123", , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: "tid": 4539 , 2022-02-03T04:12:13.339 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.361 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.362 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4540 4.14 4:2984f270:::smithi09033386-16:head [setxattr _header (57) in=7b,truncate 2420274] snapc 6b=[6b,6a,67,66,64,63,61,60,56,52,2e] RETRY=1 ondisk+retry+write+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.177130+0000", , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 7.7114999999999996e-05 , 2022-02-03T04:12:13.384 INFO:teuthology.orchestra.run.smithi090.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: }, , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.407 INFO:teuthology.orchestra.run.smithi090.stdout: "description": "osd_op(client.4394.0:4546 4.14 4:2dd53d5e:::smithi09033386-45:head [read 0~2285785,checksum,omap-get-vals-by-keys,omap-get-keys,omap-get-vals,omap-get-header,getxattrs] snapc 0=[] RETRY=1 ondisk+retry+read+known_if_redirected+supports_pool_eio e172)", Ignoring malparsed backtrace: 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "all_read", , 2022-02-03T04:12:13.429 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127748+0000", , 2022-02-03T04:12:13.430 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 2.616e-06 Ignoring malparsed backtrace: 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "started", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.153598+0000", , 2022-02-03T04:12:13.452 INFO:teuthology.orchestra.run.smithi090.stdout: "duration": 0.000109166 Ignoring malparsed backtrace: 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.474 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "throttled", , 2022-02-03T04:12:13.475 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.127801+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: { , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "event": "waiting for peered", , 2022-02-03T04:12:13.497 INFO:teuthology.orchestra.run.smithi090.stdout: "time": "2022-02-03T04:11:59.128076+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.506366+0000", , 2022-02-03T04:12:13.916 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0.0010464000000000001 , 2022-02-03T04:12:13.917 INFO:teuthology.orchestra.run.smithi160.stdout: } Ignoring malparsed backtrace: 2022-02-03T04:12:13.958 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "reached_pg", , 2022-02-03T04:12:13.959 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:53.779973+0000", , 2022-02-03T04:12:13.960 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 9.6824000000000007e-05 Ignoring malparsed backtrace: 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "dispatched", , 2022-02-03T04:12:13.987 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:54.091856+0000", Ignoring malparsed backtrace: 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ , 2022-02-03T04:12:14.012 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.013 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "initiated", Ignoring malparsed backtrace: 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: { , 2022-02-03T04:12:14.035 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "done", Ignoring malparsed backtrace: 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.3587000000000001e-05 , 2022-02-03T04:12:14.058 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.059 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 3.5571999999999998e-05 , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.081 INFO:teuthology.orchestra.run.smithi160.stdout: { Ignoring malparsed backtrace: 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4521 , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.104 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4522 , 2022-02-03T04:12:14.127 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.128 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4523 , 2022-02-03T04:12:14.151 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.152 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "tid": 4524 , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: }, , 2022-02-03T04:12:14.177 INFO:teuthology.orchestra.run.smithi160.stdout: "events": [ Ignoring malparsed backtrace: 2022-02-03T04:12:14.199 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.139426+0000", , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 1.5132e-05 , 2022-02-03T04:12:14.200 INFO:teuthology.orchestra.run.smithi160.stdout: }, Ignoring malparsed backtrace: 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "event": "throttled", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "time": "2022-02-03T04:11:59.161837+0000", , 2022-02-03T04:12:14.222 INFO:teuthology.orchestra.run.smithi160.stdout: "duration": 0 Ignoring malparsed backtrace: 2022-02-03T04:12:14.801 INFO:teuthology.orchestra.run.smithi090.stdout:setting '_remove' omap key , 2022-02-03T04:12:14.805 INFO:teuthology.orchestra.run.smithi090.stdout:finish_remove_pgs 4.6_head removing 4.6 , 2022-02-03T04:12:14.812 INFO:teuthology.orchestra.run.smithi090.stdout:Remove successful Ignoring malparsed backtrace: 2022-02-03T04:12:37.488+0000 7f2ed9c28700 -1 mon.a@0(leader).osd e198 definitely_dead 0 , marked in osd.2. , 2022-02-03T04:12:38.188 INFO:tasks.thrashosds.thrasher:Added osd 2 Ignoring malparsed backtrace: 2022-02-03T04:12:58.017 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 , 2022-02-03T04:12:58.029 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 , 2022-02-03T04:12:58.077 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 Ignoring malparsed backtrace: 2022-02-03T04:13:16.810 INFO:teuthology.orchestra.run.smithi090.stdout:{"pg_ready":true,"pg_map":{"version":345,"stamp":"2022-02-03T04:13:16.340296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":508463744,"num_objects":323,"num_object_clones":119,"num_object_copies":969,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":322,"num_whiteouts":7,"num_read":3019,"num_read_kb":2926866,"num_write":1705,"num_write_kb":500265,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":803,"num_bytes_recovered":892237064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":137,"ondisk_log_size":137,"up":117,"acting":117,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":123,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":1225656,"kb_used_data":1034584,"kb_used_omap":56,"kb_used_meta":190471,"kb_avail":753749064,"statfs":{"total":773094113280,"available":771839041536,"internally_reserved":0,"allocated":1059414016,"data_stored":1135184085,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":58238,"internal_metadata":195042434},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":6,"apply_latency_ms":6,"commit_latency_ns":6000000,"apply_latency_ns":6000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-20,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":28060854,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.267069"},"pg_stats":[{"pgid":"4.19","version":"205'233","reported_seq":945,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141800+0000","last_change":"2022-02-03T04:12:45.100892+0000","last_active":"2022-02-03T04:13:10.141800+0000","last_peered":"2022-02-03T04:13:10.141800+0000","last_clean":"2022-02-03T04:13:10.141800+0000","last_became_active":"2022-02-03T04:12:42.134619+0000","last_became_peered":"2022-02-03T04:12:42.134619+0000","last_unstale":"2022-02-03T04:13:10.141800+0000","last_undegraded":"2022-02-03T04:13:10.141800+0000","last_fullsized":"2022-02-03T04:13:10.141800+0000","mapping_epoch":202,"log_start":"186'225","ondisk_log_start":"186'225","created":111,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'233","last_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_deep_scrub":"205'233","last_deep_scrub_stamp":"2022-02-03T04:12:45.100755+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.100755+0000","objects_scrubbed":8,"log_size":8,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:04.270829+0000","stat_sum":{"num_bytes":17271325,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":70,"num_read_kb":82530,"num_write":31,"num_write_kb":9337,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":31554836,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0],"acting":[3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"195'175","reported_seq":834,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135862+0000","last_change":"2022-02-03T04:12:41.137126+0000","last_active":"2022-02-03T04:13:10.135862+0000","last_peered":"2022-02-03T04:13:10.135862+0000","last_clean":"2022-02-03T04:13:10.135862+0000","last_became_active":"2022-02-03T04:12:41.136747+0000","last_became_peered":"2022-02-03T04:12:41.136747+0000","last_unstale":"2022-02-03T04:13:10.135862+0000","last_undegraded":"2022-02-03T04:13:10.135862+0000","last_fullsized":"2022-02-03T04:13:10.135862+0000","mapping_epoch":201,"log_start":"194'168","ondisk_log_start":"194'168","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"194'173","last_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_deep_scrub":"194'173","last_deep_scrub_stamp":"2022-02-03T04:12:32.115187+0000","last_clean_scrub_stamp":"2022-02-03T04:12:32.115187+0000","objects_scrubbed":5,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.697380+0000","stat_sum":{"num_bytes":12214460,"num_objects":5,"num_object_clones":4,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7730451,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"188'98","reported_seq":728,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149210+0000","last_change":"2022-02-03T04:13:11.149210+0000","last_active":"2022-02-03T04:13:11.149210+0000","last_peered":"2022-02-03T04:13:11.149210+0000","last_clean":"2022-02-03T04:13:11.149210+0000","last_became_active":"2022-02-03T04:13:11.148591+0000","last_became_peered":"2022-02-03T04:13:11.148591+0000","last_unstale":"2022-02-03T04:13:11.149210+0000","last_undegraded":"2022-02-03T04:13:11.149210+0000","last_fullsized":"2022-02-03T04:13:11.149210+0000","mapping_epoch":225,"log_start":"185'94","ondisk_log_start":"185'94","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"185'94","last_scrub_stamp":"2022-02-03T04:12:17.020146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.020146+0000","objects_scrubbed":4,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.330713+0000","stat_sum":{"num_bytes":8551091,"num_objects":4,"num_object_clones":3,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":7336921,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1],"acting":[3,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1","version":"217'285","reported_seq":1158,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135881+0000","last_change":"2022-02-03T04:12:59.099778+0000","last_active":"2022-02-03T04:13:10.135881+0000","last_peered":"2022-02-03T04:13:10.135881+0000","last_clean":"2022-02-03T04:13:10.135881+0000","last_became_active":"2022-02-03T04:11:54.123983+0000","last_became_peered":"2022-02-03T04:11:54.123983+0000","last_unstale":"2022-02-03T04:13:10.135881+0000","last_undegraded":"2022-02-03T04:13:10.135881+0000","last_fullsized":"2022-02-03T04:13:10.135881+0000","mapping_epoch":166,"log_start":"180'276","ondisk_log_start":"180'276","created":20,"last_epoch_clean":167,"parent":"0.0","parent_split_bits":0,"last_scrub":"217'285","last_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_deep_scrub":"217'285","last_deep_scrub_stamp":"2022-02-03T04:12:59.099658+0000","last_clean_scrub_stamp":"2022-02-03T04:12:59.099658+0000","objects_scrubbed":9,"log_size":9,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.104326+0000","stat_sum":{"num_bytes":18410394,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":49,"num_read_kb":76007,"num_write":9,"num_write_kb":3256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":29393252,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,3],"acting":[4,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":262,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139951+0000","last_change":"2022-02-03T04:13:07.931058+0000","last_active":"2022-02-03T04:13:10.139951+0000","last_peered":"2022-02-03T04:13:10.139951+0000","last_clean":"2022-02-03T04:13:10.139951+0000","last_became_active":"2022-02-03T04:12:39.139890+0000","last_became_peered":"2022-02-03T04:12:39.139890+0000","last_unstale":"2022-02-03T04:13:10.139951+0000","last_undegraded":"2022-02-03T04:13:10.139951+0000","last_fullsized":"2022-02-03T04:13:10.139951+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:07.930967+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.930967+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:37.336284+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,2],"acting":[6,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":405,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.904847+0000","last_change":"2022-02-03T04:13:11.904847+0000","last_active":"2022-02-03T04:13:11.904847+0000","last_peered":"2022-02-03T04:13:11.904847+0000","last_clean":"2022-02-03T04:13:11.904847+0000","last_became_active":"2022-02-03T04:10:54.114267+0000","last_became_peered":"2022-02-03T04:10:54.114267+0000","last_unstale":"2022-02-03T04:13:11.904847+0000","last_undegraded":"2022-02-03T04:13:11.904847+0000","last_fullsized":"2022-02-03T04:13:11.904847+0000","mapping_epoch":86,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":112,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:11.904743+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:13:11.904743+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"scrubbing for 0s","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0],"acting":[3,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138871+0000","last_change":"2022-02-03T04:12:38.170543+0000","last_active":"2022-02-03T04:13:10.138871+0000","last_peered":"2022-02-03T04:13:10.138871+0000","last_clean":"2022-02-03T04:13:10.138871+0000","last_became_active":"2022-02-03T04:12:38.170192+0000","last_became_peered":"2022-02-03T04:12:38.170192+0000","last_unstale":"2022-02-03T04:13:10.138871+0000","last_undegraded":"2022-02-03T04:13:10.138871+0000","last_fullsized":"2022-02-03T04:13:10.138871+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:26.975483+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.975483+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:49.003000+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,4],"acting":[1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":261,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145921+0000","last_change":"2022-02-03T04:12:58.163728+0000","last_active":"2022-02-03T04:13:10.145921+0000","last_peered":"2022-02-03T04:13:10.145921+0000","last_clean":"2022-02-03T04:13:10.145921+0000","last_became_active":"2022-02-03T04:11:52.474762+0000","last_became_peered":"2022-02-03T04:11:52.474762+0000","last_unstale":"2022-02-03T04:13:10.145921+0000","last_undegraded":"2022-02-03T04:13:10.145921+0000","last_fullsized":"2022-02-03T04:13:10.145921+0000","mapping_epoch":164,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":165,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:58.163634+0000","last_clean_scrub_stamp":"2022-02-03T04:12:58.163634+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:19.923361+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,4],"acting":[7,0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"188'233","reported_seq":877,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138004+0000","last_change":"2022-02-03T04:13:00.263146+0000","last_active":"2022-02-03T04:13:10.138004+0000","last_peered":"2022-02-03T04:13:10.138004+0000","last_clean":"2022-02-03T04:13:10.138004+0000","last_became_active":"2022-02-03T04:12:19.138479+0000","last_became_peered":"2022-02-03T04:12:19.138479+0000","last_unstale":"2022-02-03T04:13:10.138004+0000","last_undegraded":"2022-02-03T04:13:10.138004+0000","last_fullsized":"2022-02-03T04:13:10.138004+0000","mapping_epoch":187,"log_start":"170'227","ondisk_log_start":"170'227","created":20,"last_epoch_clean":188,"parent":"0.0","parent_split_bits":0,"last_scrub":"188'233","last_scrub_stamp":"2022-02-03T04:13:00.263058+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:00.263058+0000","objects_scrubbed":7,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:00.540542+0000","stat_sum":{"num_bytes":10856363,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":28,"num_read_kb":33070,"num_write":15,"num_write_kb":4467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":12111448,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7],"acting":[0,5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1","version":"180'182","reported_seq":858,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137716+0000","last_change":"2022-02-03T04:12:14.273852+0000","last_active":"2022-02-03T04:13:10.137716+0000","last_peered":"2022-02-03T04:13:10.137716+0000","last_clean":"2022-02-03T04:13:10.137716+0000","last_became_active":"2022-02-03T04:12:14.134184+0000","last_became_peered":"2022-02-03T04:12:14.134184+0000","last_unstale":"2022-02-03T04:13:10.137716+0000","last_undegraded":"2022-02-03T04:13:10.137716+0000","last_fullsized":"2022-02-03T04:13:10.137716+0000","mapping_epoch":185,"log_start":"180'179","ondisk_log_start":"180'179","created":19,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'182","last_scrub_stamp":"2022-02-03T04:12:14.273776+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.273776+0000","objects_scrubbed":40,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.641847+0000","stat_sum":{"num_bytes":40170136,"num_objects":40,"num_object_clones":0,"num_object_copies":120,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":40,"num_whiteouts":0,"num_read":151,"num_read_kb":11516,"num_write":192,"num_write_kb":82707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":147,"num_bytes_recovered":99722828,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4,3],"acting":[0,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":278,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.146045+0000","last_change":"2022-02-03T04:12:54.073934+0000","last_active":"2022-02-03T04:13:10.146045+0000","last_peered":"2022-02-03T04:13:10.146045+0000","last_clean":"2022-02-03T04:13:10.146045+0000","last_became_active":"2022-02-03T04:12:38.173512+0000","last_became_peered":"2022-02-03T04:12:38.173512+0000","last_unstale":"2022-02-03T04:13:10.146045+0000","last_undegraded":"2022-02-03T04:13:10.146045+0000","last_fullsized":"2022-02-03T04:13:10.146045+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:54.073816+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.073816+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.854243+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1,0],"acting":[7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"194'297","reported_seq":1072,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137892+0000","last_change":"2022-02-03T04:13:09.334393+0000","last_active":"2022-02-03T04:13:10.137892+0000","last_peered":"2022-02-03T04:13:10.137892+0000","last_clean":"2022-02-03T04:12:34.138484+0000","last_became_active":"2022-02-03T04:12:39.156972+0000","last_became_peered":"2022-02-03T04:12:39.156972+0000","last_unstale":"2022-02-03T04:13:10.137892+0000","last_undegraded":"2022-02-03T04:13:10.137892+0000","last_fullsized":"2022-02-03T04:13:10.137892+0000","mapping_epoch":199,"log_start":"180'292","ondisk_log_start":"180'292","created":20,"last_epoch_clean":186,"parent":"0.0","parent_split_bits":0,"last_scrub":"194'297","last_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_deep_scrub":"194'297","last_deep_scrub_stamp":"2022-02-03T04:12:31.444474+0000","last_clean_scrub_stamp":"2022-02-03T04:12:31.444474+0000","objects_scrubbed":6,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.194586+0000","stat_sum":{"num_bytes":12807971,"num_objects":6,"num_object_clones":4,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":1,"num_read":67,"num_read_kb":99592,"num_write":18,"num_write_kb":5711,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":19641257,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2],"acting":[0,7,5],"avail_no_missing":["0","5","7"],"object_location_counts":[{"shards":"0,5,7","objects":6}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"175'183","reported_seq":709,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141624+0000","last_change":"2022-02-03T04:12:38.967384+0000","last_active":"2022-02-03T04:13:10.141624+0000","last_peered":"2022-02-03T04:13:10.141624+0000","last_clean":"2022-02-03T04:13:10.141624+0000","last_became_active":"2022-02-03T04:11:49.124572+0000","last_became_peered":"2022-02-03T04:11:49.124572+0000","last_unstale":"2022-02-03T04:13:10.141624+0000","last_undegraded":"2022-02-03T04:13:10.141624+0000","last_fullsized":"2022-02-03T04:13:10.141624+0000","mapping_epoch":161,"log_start":"172'180","ondisk_log_start":"172'180","created":19,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'183","last_scrub_stamp":"2022-02-03T04:12:38.967274+0000","last_deep_scrub":"139'152","last_deep_scrub_stamp":"2022-02-03T04:11:25.937656+0000","last_clean_scrub_stamp":"2022-02-03T04:12:38.967274+0000","objects_scrubbed":42,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:56.752019+0000","stat_sum":{"num_bytes":39030313,"num_objects":42,"num_object_clones":0,"num_object_copies":126,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":42,"num_whiteouts":0,"num_read":121,"num_read_kb":6618,"num_write":166,"num_write_kb":68242,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":97,"num_bytes_recovered":57751167,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,6],"acting":[3,5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"17'117","reported_seq":398,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145949+0000","last_change":"2022-02-03T04:12:44.068835+0000","last_active":"2022-02-03T04:13:10.145949+0000","last_peered":"2022-02-03T04:13:10.145949+0000","last_clean":"2022-02-03T04:13:10.145949+0000","last_became_active":"2022-02-03T04:09:07.403158+0000","last_became_peered":"2022-02-03T04:09:07.403158+0000","last_unstale":"2022-02-03T04:13:10.145949+0000","last_undegraded":"2022-02-03T04:13:10.145949+0000","last_fullsized":"2022-02-03T04:13:10.145949+0000","mapping_epoch":15,"log_start":"17'114","ondisk_log_start":"17'114","created":15,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"17'117","last_scrub_stamp":"2022-02-03T04:12:44.068729+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:06.383715+0000","last_clean_scrub_stamp":"2022-02-03T04:12:44.068729+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.944660+0000","stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145093+0000","last_change":"2022-02-03T04:13:02.356908+0000","last_active":"2022-02-03T04:13:10.145093+0000","last_peered":"2022-02-03T04:13:10.145093+0000","last_clean":"2022-02-03T04:13:10.145093+0000","last_became_active":"2022-02-03T04:12:39.139320+0000","last_became_peered":"2022-02-03T04:12:39.139320+0000","last_unstale":"2022-02-03T04:13:10.145093+0000","last_undegraded":"2022-02-03T04:13:10.145093+0000","last_fullsized":"2022-02-03T04:13:10.145093+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:13:02.356806+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:11:49.553851+0000","last_clean_scrub_stamp":"2022-02-03T04:13:02.356806+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:26.019027+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2,7],"acting":[5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.5","version":"107'169","reported_seq":757,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139593+0000","last_change":"2022-02-03T04:12:35.990568+0000","last_active":"2022-02-03T04:13:10.139593+0000","last_peered":"2022-02-03T04:13:10.139593+0000","last_clean":"2022-02-03T04:13:10.139593+0000","last_became_active":"2022-02-03T04:11:55.125056+0000","last_became_peered":"2022-02-03T04:11:55.125056+0000","last_unstale":"2022-02-03T04:13:10.139593+0000","last_undegraded":"2022-02-03T04:13:10.139593+0000","last_fullsized":"2022-02-03T04:13:10.139593+0000","mapping_epoch":167,"log_start":"107'164","ondisk_log_start":"107'164","created":20,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"107'169","last_scrub_stamp":"2022-02-03T04:12:35.990452+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:35.990452+0000","objects_scrubbed":0,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:36.076686+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4,7],"acting":[6,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.0","version":"183'130","reported_seq":726,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138242+0000","last_change":"2022-02-03T04:12:44.196151+0000","last_active":"2022-02-03T04:13:10.138242+0000","last_peered":"2022-02-03T04:13:10.138242+0000","last_clean":"2022-02-03T04:13:10.138242+0000","last_became_active":"2022-02-03T04:12:44.195551+0000","last_became_peered":"2022-02-03T04:12:44.195551+0000","last_unstale":"2022-02-03T04:13:10.138242+0000","last_undegraded":"2022-02-03T04:13:10.138242+0000","last_fullsized":"2022-02-03T04:13:10.138242+0000","mapping_epoch":204,"log_start":"175'128","ondisk_log_start":"175'128","created":19,"last_epoch_clean":205,"parent":"0.0","parent_split_bits":0,"last_scrub":"159'125","last_scrub_stamp":"2022-02-03T04:11:49.779647+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:11:49.779647+0000","objects_scrubbed":32,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.261841+0000","stat_sum":{"num_bytes":34432940,"num_objects":34,"num_object_clones":0,"num_object_copies":102,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":103,"num_read_kb":8013,"num_write":134,"num_write_kb":52373,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":111,"num_bytes_recovered":73426044,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,6],"acting":[1,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":35,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.143015+0000","last_change":"2022-02-03T04:12:39.146865+0000","last_active":"2022-02-03T04:13:10.143015+0000","last_peered":"2022-02-03T04:13:10.143015+0000","last_clean":"2022-02-03T04:13:10.143015+0000","last_became_active":"2022-02-03T04:12:39.146486+0000","last_became_peered":"2022-02-03T04:12:39.146486+0000","last_unstale":"2022-02-03T04:13:10.143015+0000","last_undegraded":"2022-02-03T04:13:10.143015+0000","last_fullsized":"2022-02-03T04:13:10.143015+0000","mapping_epoch":199,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":200,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:15.983756+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:15.983756+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:40.159624+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0],"acting":[2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"181'104","reported_seq":708,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148677+0000","last_change":"2022-02-03T04:13:11.148677+0000","last_active":"2022-02-03T04:13:11.148677+0000","last_peered":"2022-02-03T04:13:11.148677+0000","last_clean":"2022-02-03T04:13:11.148677+0000","last_became_active":"2022-02-03T04:13:11.148224+0000","last_became_peered":"2022-02-03T04:13:11.148224+0000","last_unstale":"2022-02-03T04:13:11.148677+0000","last_undegraded":"2022-02-03T04:13:11.148677+0000","last_fullsized":"2022-02-03T04:13:11.148677+0000","mapping_epoch":225,"log_start":"179'102","ondisk_log_start":"179'102","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'104","last_scrub_stamp":"2022-02-03T04:12:29.543391+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:29.543391+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.770709+0000","stat_sum":{"num_bytes":7062399,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":28,"num_read_kb":25290,"num_write":9,"num_write_kb":2376,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":11208687,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0],"acting":[1,5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"175'149","reported_seq":552,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136154+0000","last_change":"2022-02-03T04:12:54.218069+0000","last_active":"2022-02-03T04:13:10.136154+0000","last_peered":"2022-02-03T04:13:10.136154+0000","last_clean":"2022-02-03T04:13:10.136154+0000","last_became_active":"2022-02-03T04:11:55.121746+0000","last_became_peered":"2022-02-03T04:11:55.121746+0000","last_unstale":"2022-02-03T04:13:10.136154+0000","last_undegraded":"2022-02-03T04:13:10.136154+0000","last_fullsized":"2022-02-03T04:13:10.136154+0000","mapping_epoch":167,"log_start":"168'146","ondisk_log_start":"168'146","created":19,"last_epoch_clean":168,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'149","last_scrub_stamp":"2022-02-03T04:12:54.217969+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:16.082766+0000","last_clean_scrub_stamp":"2022-02-03T04:12:54.217969+0000","objects_scrubbed":36,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:22.632049+0000","stat_sum":{"num_bytes":31785668,"num_objects":36,"num_object_clones":0,"num_object_copies":108,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":36,"num_whiteouts":0,"num_read":117,"num_read_kb":2973,"num_write":157,"num_write_kb":50040,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":60,"num_bytes_recovered":33520724,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,6],"acting":[4,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145937+0000","last_change":"2022-02-03T04:12:38.172034+0000","last_active":"2022-02-03T04:13:10.145937+0000","last_peered":"2022-02-03T04:13:10.145937+0000","last_clean":"2022-02-03T04:13:10.145937+0000","last_became_active":"2022-02-03T04:12:38.171675+0000","last_became_peered":"2022-02-03T04:12:38.171675+0000","last_unstale":"2022-02-03T04:13:10.145937+0000","last_undegraded":"2022-02-03T04:13:10.145937+0000","last_fullsized":"2022-02-03T04:13:10.145937+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:12:14.683074+0000","last_clean_scrub_stamp":"2022-02-03T04:12:14.683074+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:19.978125+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1,6],"acting":[5,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"203'265","reported_seq":969,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138317+0000","last_change":"2022-02-03T04:12:45.781188+0000","last_active":"2022-02-03T04:13:10.138317+0000","last_peered":"2022-02-03T04:13:10.138317+0000","last_clean":"2022-02-03T04:13:10.138317+0000","last_became_active":"2022-02-03T04:12:40.136567+0000","last_became_peered":"2022-02-03T04:12:40.136567+0000","last_unstale":"2022-02-03T04:13:10.138317+0000","last_undegraded":"2022-02-03T04:13:10.138317+0000","last_fullsized":"2022-02-03T04:13:10.138317+0000","mapping_epoch":200,"log_start":"175'261","ondisk_log_start":"175'261","created":20,"last_epoch_clean":201,"parent":"0.0","parent_split_bits":0,"last_scrub":"203'265","last_scrub_stamp":"2022-02-03T04:12:45.781046+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.781046+0000","objects_scrubbed":9,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:46.223218+0000","stat_sum":{"num_bytes":21383399,"num_objects":9,"num_object_clones":6,"num_object_copies":27,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":58,"num_read_kb":81150,"num_write":15,"num_write_kb":4365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3],"acting":[1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"174'87","reported_seq":682,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137770+0000","last_change":"2022-02-03T04:13:09.333252+0000","last_active":"2022-02-03T04:13:10.137770+0000","last_peered":"2022-02-03T04:13:10.137770+0000","last_clean":"2022-02-03T04:11:50.760433+0000","last_became_active":"2022-02-03T04:12:39.150593+0000","last_became_peered":"2022-02-03T04:12:39.150593+0000","last_unstale":"2022-02-03T04:13:10.137770+0000","last_undegraded":"2022-02-03T04:13:10.137770+0000","last_fullsized":"2022-02-03T04:13:10.137770+0000","mapping_epoch":199,"log_start":"154'84","ondisk_log_start":"154'84","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"174'87","last_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_deep_scrub":"174'87","last_deep_scrub_stamp":"2022-02-03T04:12:21.608806+0000","last_clean_scrub_stamp":"2022-02-03T04:12:21.608806+0000","objects_scrubbed":2,"log_size":3,"ondisk_log_size":3,"stats_invalid":true,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":6263240,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":3,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":100571,"num_write":24,"num_write_kb":7341,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":14523222,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4],"acting":[0,5,4],"avail_no_missing":["0","4","5"],"object_location_counts":[{"shards":"0,4,5","objects":3}],"blocked_by":[],"up_primary":1,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":37,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.138226+0000","last_change":"2022-02-03T04:12:38.171216+0000","last_active":"2022-02-03T04:13:10.138226+0000","last_peered":"2022-02-03T04:13:10.138226+0000","last_clean":"2022-02-03T04:13:10.138226+0000","last_became_active":"2022-02-03T04:12:38.170863+0000","last_became_peered":"2022-02-03T04:12:38.170863+0000","last_unstale":"2022-02-03T04:13:10.138226+0000","last_undegraded":"2022-02-03T04:13:10.138226+0000","last_fullsized":"2022-02-03T04:13:10.138226+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:17.265686+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:07.390875+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.265686+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:26.841481+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,7],"acting":[1,0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.8","version":"180'207","reported_seq":786,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145076+0000","last_change":"2022-02-03T04:12:28.523251+0000","last_active":"2022-02-03T04:13:10.145076+0000","last_peered":"2022-02-03T04:13:10.145076+0000","last_clean":"2022-02-03T04:13:10.145076+0000","last_became_active":"2022-02-03T04:11:49.126299+0000","last_became_peered":"2022-02-03T04:11:49.126299+0000","last_unstale":"2022-02-03T04:13:10.145076+0000","last_undegraded":"2022-02-03T04:13:10.145076+0000","last_fullsized":"2022-02-03T04:13:10.145076+0000","mapping_epoch":161,"log_start":"170'203","ondisk_log_start":"170'203","created":20,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'207","last_scrub_stamp":"2022-02-03T04:12:28.523125+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.523125+0000","objects_scrubbed":7,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:51.257952+0000","stat_sum":{"num_bytes":15015147,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":33,"num_read_kb":39125,"num_write":15,"num_write_kb":3897,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":7292544,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,6],"acting":[5,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"106'132","reported_seq":761,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.136037+0000","last_change":"2022-02-03T04:13:01.828747+0000","last_active":"2022-02-03T04:13:10.136037+0000","last_peered":"2022-02-03T04:13:10.136037+0000","last_clean":"2022-02-03T04:12:34.136525+0000","last_became_active":"2022-02-03T04:13:01.827636+0000","last_became_peered":"2022-02-03T04:13:01.827636+0000","last_unstale":"2022-02-03T04:13:10.136037+0000","last_undegraded":"2022-02-03T04:13:10.136037+0000","last_fullsized":"2022-02-03T04:13:10.136037+0000","mapping_epoch":219,"log_start":"104'128","ondisk_log_start":"104'128","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"106'132","last_scrub_stamp":"2022-02-03T04:11:35.694822+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:11:35.694822+0000","objects_scrubbed":0,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"queued for scrub","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,3],"acting":[4,3,6],"avail_no_missing":["4","1","3","5","6"],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.a","version":"179'246","reported_seq":943,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.149610+0000","last_change":"2022-02-03T04:13:11.149610+0000","last_active":"2022-02-03T04:13:11.149610+0000","last_peered":"2022-02-03T04:13:11.149610+0000","last_clean":"2022-02-03T04:13:11.149610+0000","last_became_active":"2022-02-03T04:13:11.149105+0000","last_became_peered":"2022-02-03T04:13:11.149105+0000","last_unstale":"2022-02-03T04:13:11.149610+0000","last_undegraded":"2022-02-03T04:13:11.149610+0000","last_fullsized":"2022-02-03T04:13:11.149610+0000","mapping_epoch":225,"log_start":"163'239","ondisk_log_start":"163'239","created":20,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":0,"last_scrub":"179'246","last_scrub_stamp":"2022-02-03T04:13:09.942797+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:09.942797+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:13.272102+0000","stat_sum":{"num_bytes":16985933,"num_objects":7,"num_object_clones":4,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":312,"num_read_kb":383815,"num_write":108,"num_write_kb":29533,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":28,"num_bytes_recovered":43843094,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1,7],"acting":[6,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.b","version":"181'222","reported_seq":984,"reported_epoch":225,"state":"active+remapped+backfill_toofull","last_fresh":"2022-02-03T04:13:10.137748+0000","last_change":"2022-02-03T04:13:09.333972+0000","last_active":"2022-02-03T04:13:10.137748+0000","last_peered":"2022-02-03T04:13:10.137748+0000","last_clean":"2022-02-03T04:12:34.138355+0000","last_became_active":"2022-02-03T04:12:39.156898+0000","last_became_peered":"2022-02-03T04:12:39.156898+0000","last_unstale":"2022-02-03T04:13:10.137748+0000","last_undegraded":"2022-02-03T04:13:10.137748+0000","last_fullsized":"2022-02-03T04:13:10.137748+0000","mapping_epoch":199,"log_start":"180'216","ondisk_log_start":"180'216","created":20,"last_epoch_clean":174,"parent":"0.0","parent_split_bits":0,"last_scrub":"175'213","last_scrub_stamp":"2022-02-03T04:12:03.157062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:03.157062+0000","objects_scrubbed":12,"log_size":6,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:23.800825+0000","stat_sum":{"num_bytes":26100611,"num_objects":12,"num_object_clones":9,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":12,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":240,"num_read_kb":269804,"num_write":125,"num_write_kb":33732,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":50,"num_bytes_recovered":84512801,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4],"acting":[0,4,3],"avail_no_missing":["0","3","4"],"object_location_counts":[{"shards":"0,3,4","objects":12}],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"191'207","reported_seq":896,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.135993+0000","last_change":"2022-02-03T04:12:30.198470+0000","last_active":"2022-02-03T04:13:10.135993+0000","last_peered":"2022-02-03T04:13:10.135993+0000","last_clean":"2022-02-03T04:13:10.135993+0000","last_became_active":"2022-02-03T04:12:26.185680+0000","last_became_peered":"2022-02-03T04:12:26.185680+0000","last_unstale":"2022-02-03T04:13:10.135993+0000","last_undegraded":"2022-02-03T04:13:10.135993+0000","last_fullsized":"2022-02-03T04:13:10.135993+0000","mapping_epoch":190,"log_start":"191'194","ondisk_log_start":"191'194","created":20,"last_epoch_clean":191,"parent":"0.0","parent_split_bits":0,"last_scrub":"191'205","last_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_deep_scrub":"191'205","last_deep_scrub_stamp":"2022-02-03T04:12:27.250393+0000","last_clean_scrub_stamp":"2022-02-03T04:12:27.250393+0000","objects_scrubbed":13,"log_size":13,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:55.183152+0000","stat_sum":{"num_bytes":28373789,"num_objects":13,"num_object_clones":10,"num_object_copies":39,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":279,"num_read_kb":308741,"num_write":131,"num_write_kb":35658,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":40,"num_bytes_recovered":65927711,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":4,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6],"acting":[4,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.d","version":"180'145","reported_seq":865,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136129+0000","last_change":"2022-02-03T04:13:07.925817+0000","last_active":"2022-02-03T04:13:10.136129+0000","last_peered":"2022-02-03T04:13:10.136129+0000","last_clean":"2022-02-03T04:13:10.136129+0000","last_became_active":"2022-02-03T04:12:42.135593+0000","last_became_peered":"2022-02-03T04:12:42.135593+0000","last_unstale":"2022-02-03T04:13:10.136129+0000","last_undegraded":"2022-02-03T04:13:10.136129+0000","last_fullsized":"2022-02-03T04:13:10.136129+0000","mapping_epoch":202,"log_start":"180'141","ondisk_log_start":"180'141","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"180'145","last_scrub_stamp":"2022-02-03T04:13:07.925709+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:13:07.925709+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.394391+0000","stat_sum":{"num_bytes":14840047,"num_objects":8,"num_object_clones":6,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":186,"num_read_kb":206842,"num_write":62,"num_write_kb":15707,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":36,"num_bytes_recovered":50867939,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,1],"acting":[4,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.e","version":"190'83","reported_seq":653,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136121+0000","last_change":"2022-02-03T04:12:42.136823+0000","last_active":"2022-02-03T04:13:10.136121+0000","last_peered":"2022-02-03T04:13:10.136121+0000","last_clean":"2022-02-03T04:13:10.136121+0000","last_became_active":"2022-02-03T04:12:42.136336+0000","last_became_peered":"2022-02-03T04:12:42.136336+0000","last_unstale":"2022-02-03T04:13:10.136121+0000","last_undegraded":"2022-02-03T04:13:10.136121+0000","last_fullsized":"2022-02-03T04:13:10.136121+0000","mapping_epoch":202,"log_start":"171'80","ondisk_log_start":"171'80","created":20,"last_epoch_clean":203,"parent":"0.0","parent_split_bits":0,"last_scrub":"190'83","last_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_deep_scrub":"190'83","last_deep_scrub_stamp":"2022-02-03T04:12:26.146343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:26.146343+0000","objects_scrubbed":3,"log_size":3,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:42.647507+0000","stat_sum":{"num_bytes":8219415,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":88,"num_read_kb":130274,"num_write":43,"num_write_kb":12307,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":21911059,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1],"acting":[4,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"181'279","reported_seq":1097,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.139862+0000","last_change":"2022-02-03T04:12:41.137180+0000","last_active":"2022-02-03T04:13:10.139862+0000","last_peered":"2022-02-03T04:13:10.139862+0000","last_clean":"2022-02-03T04:13:10.139862+0000","last_became_active":"2022-02-03T04:12:41.136735+0000","last_became_peered":"2022-02-03T04:12:41.136735+0000","last_unstale":"2022-02-03T04:13:10.139862+0000","last_undegraded":"2022-02-03T04:13:10.139862+0000","last_fullsized":"2022-02-03T04:13:10.139862+0000","mapping_epoch":201,"log_start":"180'277","ondisk_log_start":"180'277","created":20,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":0,"last_scrub":"181'279","last_scrub_stamp":"2022-02-03T04:12:11.070321+0000","last_deep_scrub":"87'109","last_deep_scrub_stamp":"2022-02-03T04:10:26.906110+0000","last_clean_scrub_stamp":"2022-02-03T04:12:11.070321+0000","objects_scrubbed":11,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:15.311493+0000","stat_sum":{"num_bytes":26457274,"num_objects":11,"num_object_clones":7,"num_object_copies":33,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":425,"num_read_kb":535070,"num_write":129,"num_write_kb":32509,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":89376022,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":7,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4],"acting":[1,3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":422,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141638+0000","last_change":"2022-02-03T04:12:38.170890+0000","last_active":"2022-02-03T04:13:10.141638+0000","last_peered":"2022-02-03T04:13:10.141638+0000","last_clean":"2022-02-03T04:13:10.141638+0000","last_became_active":"2022-02-03T04:12:38.170384+0000","last_became_peered":"2022-02-03T04:12:38.170384+0000","last_unstale":"2022-02-03T04:13:10.141638+0000","last_undegraded":"2022-02-03T04:13:10.141638+0000","last_fullsized":"2022-02-03T04:13:10.141638+0000","mapping_epoch":198,"log_start":"0'0","ondisk_log_start":"0'0","created":111,"last_epoch_clean":199,"parent":"0.0","parent_split_bits":5,"last_scrub":"0'0","last_scrub_stamp":"2022-02-03T04:12:12.099852+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:10:51.035132+0000","last_clean_scrub_stamp":"2022-02-03T04:12:12.099852+0000","objects_scrubbed":0,"log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:13.748445+0000","stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6],"acting":[3,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.11","version":"181'298","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.141878+0000","last_change":"2022-02-03T04:12:23.962311+0000","last_active":"2022-02-03T04:13:10.141878+0000","last_peered":"2022-02-03T04:13:10.141878+0000","last_clean":"2022-02-03T04:13:10.141878+0000","last_became_active":"2022-02-03T04:10:59.113356+0000","last_became_peered":"2022-02-03T04:10:59.113356+0000","last_unstale":"2022-02-03T04:13:10.141878+0000","last_undegraded":"2022-02-03T04:13:10.141878+0000","last_fullsized":"2022-02-03T04:13:10.141878+0000","mapping_epoch":116,"log_start":"175'294","ondisk_log_start":"175'294","created":111,"last_epoch_clean":117,"parent":"0.0","parent_split_bits":5,"last_scrub":"181'298","last_scrub_stamp":"2022-02-03T04:12:23.962153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:23.962153+0000","objects_scrubbed":8,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:39.012107+0000","stat_sum":{"num_bytes":17993720,"num_objects":8,"num_object_clones":5,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":1,"num_read":101,"num_read_kb":136451,"num_write":36,"num_write_kb":9139,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":5,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6],"acting":[3,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"190'103","reported_seq":717,"reported_epoch":226,"state":"active+clean","last_fresh":"2022-02-03T04:13:11.148680+0000","last_change":"2022-02-03T04:13:11.148680+0000","last_active":"2022-02-03T04:13:11.148680+0000","last_peered":"2022-02-03T04:13:11.148680+0000","last_clean":"2022-02-03T04:13:11.148680+0000","last_became_active":"2022-02-03T04:13:11.148207+0000","last_became_peered":"2022-02-03T04:13:11.148207+0000","last_unstale":"2022-02-03T04:13:11.148680+0000","last_undegraded":"2022-02-03T04:13:11.148680+0000","last_fullsized":"2022-02-03T04:13:11.148680+0000","mapping_epoch":225,"log_start":"188'101","ondisk_log_start":"188'101","created":111,"last_epoch_clean":226,"parent":"0.0","parent_split_bits":5,"last_scrub":"188'101","last_scrub_stamp":"2022-02-03T04:12:24.966472+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:24.966472+0000","objects_scrubbed":3,"log_size":2,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:34.440143+0000","stat_sum":{"num_bytes":6433973,"num_objects":3,"num_object_clones":2,"num_object_copies":9,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":4339807,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":2,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2],"acting":[1,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"191'204","reported_seq":956,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.136062+0000","last_change":"2022-02-03T04:13:04.736263+0000","last_active":"2022-02-03T04:13:10.136062+0000","last_peered":"2022-02-03T04:13:10.136062+0000","last_clean":"2022-02-03T04:13:10.136062+0000","last_became_active":"2022-02-03T04:13:04.735841+0000","last_became_peered":"2022-02-03T04:13:04.735841+0000","last_unstale":"2022-02-03T04:13:10.136062+0000","last_undegraded":"2022-02-03T04:13:10.136062+0000","last_fullsized":"2022-02-03T04:13:10.136062+0000","mapping_epoch":222,"log_start":"171'199","ondisk_log_start":"171'199","created":111,"last_epoch_clean":223,"parent":"0.0","parent_split_bits":5,"last_scrub":"191'204","last_scrub_stamp":"2022-02-03T04:12:28.692566+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:28.692566+0000","objects_scrubbed":5,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:57.056637+0000","stat_sum":{"num_bytes":10499325,"num_objects":5,"num_object_clones":3,"num_object_copies":15,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":1,"num_read":27,"num_read_kb":27222,"num_write":10,"num_write_kb":2342,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":26308626,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":1,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,2],"acting":[4,6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"186'327","reported_seq":1254,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.142057+0000","last_change":"2022-02-03T04:12:41.134599+0000","last_active":"2022-02-03T04:13:10.142057+0000","last_peered":"2022-02-03T04:13:10.142057+0000","last_clean":"2022-02-03T04:13:10.142057+0000","last_became_active":"2022-02-03T04:12:41.134104+0000","last_became_peered":"2022-02-03T04:12:41.134104+0000","last_unstale":"2022-02-03T04:13:10.142057+0000","last_undegraded":"2022-02-03T04:13:10.142057+0000","last_fullsized":"2022-02-03T04:13:10.142057+0000","mapping_epoch":201,"log_start":"186'323","ondisk_log_start":"186'323","created":111,"last_epoch_clean":202,"parent":"0.0","parent_split_bits":5,"last_scrub":"186'327","last_scrub_stamp":"2022-02-03T04:12:17.985205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.985205+0000","objects_scrubbed":16,"log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:47.548621+0000","stat_sum":{"num_bytes":31091584,"num_objects":16,"num_object_clones":12,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":156,"num_read_kb":163033,"num_write":48,"num_write_kb":15182,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":48,"num_bytes_recovered":81153762,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":6,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7],"acting":[3,1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.15","version":"180'347","reported_seq":999,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.145122+0000","last_change":"2022-02-03T04:12:17.660361+0000","last_active":"2022-02-03T04:13:10.145122+0000","last_peered":"2022-02-03T04:13:10.145122+0000","last_clean":"2022-02-03T04:13:10.145122+0000","last_became_active":"2022-02-03T04:11:49.126110+0000","last_became_peered":"2022-02-03T04:11:49.126110+0000","last_unstale":"2022-02-03T04:13:10.145122+0000","last_undegraded":"2022-02-03T04:13:10.145122+0000","last_fullsized":"2022-02-03T04:13:10.145122+0000","mapping_epoch":161,"log_start":"180'342","ondisk_log_start":"180'342","created":111,"last_epoch_clean":162,"parent":"0.0","parent_split_bits":5,"last_scrub":"180'347","last_scrub_stamp":"2022-02-03T04:12:17.660263+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2022-02-03T04:09:17.084343+0000","last_clean_scrub_stamp":"2022-02-03T04:12:17.660263+0000","objects_scrubbed":15,"log_size":5,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:13:28.902662+0000","stat_sum":{"num_bytes":32080619,"num_objects":15,"num_object_clones":11,"num_object_copies":45,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":1,"num_read":139,"num_read_kb":154239,"num_write":64,"num_write_kb":16178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":12,"num_bytes_recovered":18782862,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":9,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3],"acting":[5,7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.16","version":"205'302","reported_seq":1042,"reported_epoch":225,"state":"active+clean","last_fresh":"2022-02-03T04:13:10.137756+0000","last_change":"2022-02-03T04:12:45.157910+0000","last_active":"2022-02-03T04:13:10.137756+0000","last_peered":"2022-02-03T04:13:10.137756+0000","last_clean":"2022-02-03T04:13:10.137756+0000","last_became_active":"2022-02-03T04:11:29.381416+0000","last_became_peered":"2022-02-03T04:11:29.381416+0000","last_unstale":"2022-02-03T04:13:10.137756+0000","last_undegraded":"2022-02-03T04:13:10.137756+0000","last_fullsized":"2022-02-03T04:13:10.137756+0000","mapping_epoch":142,"log_start":"180'295","ondisk_log_start":"180'295","created":111,"last_epoch_clean":143,"parent":"0.0","parent_split_bits":5,"last_scrub":"205'302","last_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_deep_scrub":"205'302","last_deep_scrub_stamp":"2022-02-03T04:12:45.157813+0000","last_clean_scrub_stamp":"2022-02-03T04:12:45.157813+0000","objects_scrubbed":7,"log_size":7,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2022-02-03T04:14:12.020590+0000","stat_sum":{"num_bytes":13542240,"num_objects":7,"num_object_clones":5,"num_object_copies":21,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":1,"num_read":37,"num_read_kb":44820,"num_write":5,"num_write_kb":1450,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":3,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,7],"acting":[0,3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":26,"stat_sum":{"num_bytes":362454319,"num_objects":169,"num_object_clones":119,"num_object_copies":507,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":27,"num_objects_unfound":0,"num_objects_dirty":168,"num_whiteouts":7,"num_read":2411,"num_read_kb":2897646,"num_write":897,"num_write_kb":244487,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":388,"num_bytes_recovered":627816301,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":77,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":772018176,"data_stored":853278279,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},"log_size":123,"ondisk_log_size":123,"up":78,"acting":78,"num_store_stats":8},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":145419057,"num_objects":152,"num_object_clones":0,"num_object_copies":456,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":152,"num_whiteouts":0,"num_read":492,"num_read_kb":29120,"num_write":649,"num_write_kb":253362,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":415,"num_bytes_recovered":264420763,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":276406272,"data_stored":275922081,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},"log_size":11,"ondisk_log_size":11,"up":12,"acting":12,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":3,"acting":3,"num_store_stats":3},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":24,"acting":24,"num_store_stats":8}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574901,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":137288,"kb_used_data":113088,"kb_used_omap":0,"kb_used_meta":24192,"kb_avail":94234552,"statfs":{"total":96636764160,"available":96496181248,"internally_reserved":0,"allocated":115802112,"data_stored":135333029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24772608},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.44800000000000001,"15min":0.42799999999999999},"min":{"1min":0.35199999999999998,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.78700000000000003,"5min":0.874,"15min":0.874},"last":0.51200000000000001},{"interface":"front","average":{"1min":0.83099999999999996,"5min":0.55100000000000005,"15min":0.54300000000000004},"min":{"1min":0.377,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":7.3339999999999996,"5min":7.3339999999999996,"15min":7.3339999999999996},"last":0.41699999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.54400000000000004,"5min":0.50900000000000001,"15min":0.54100000000000004},"min":{"1min":0.39200000000000002,"5min":0.307,"15min":0.307},"max":{"1min":0.67700000000000005,"5min":3.4550000000000001,"15min":3.4550000000000001},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.53600000000000003,"15min":0.59099999999999997},"min":{"1min":0.40899999999999997,"5min":0.27900000000000003,"15min":0.27900000000000003},"max":{"1min":0.70499999999999996,"5min":3.8919999999999999,"15min":3.8919999999999999},"last":0.497}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.44900000000000001,"15min":0.45100000000000001},"min":{"1min":0.313,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.58099999999999996,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54300000000000004},{"interface":"front","average":{"1min":0.442,"5min":0.46899999999999997,"15min":0.47299999999999998},"min":{"1min":0.33500000000000002,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.67700000000000005,"5min":0.67700000000000005,"15min":0.67700000000000005},"last":0.48699999999999999}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.46999999999999997,"15min":0.46400000000000002},"min":{"1min":0.315,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.69499999999999995,"5min":0.79500000000000004,"15min":0.79500000000000004},"last":0.52700000000000002},{"interface":"front","average":{"1min":0.55100000000000005,"5min":0.50600000000000001,"15min":0.495},"min":{"1min":0.372,"5min":0.34999999999999998,"15min":0.34999999999999998},"max":{"1min":0.82799999999999996,"5min":0.82799999999999996,"15min":0.82799999999999996},"last":0.55300000000000005}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"min":{"1min":0.27300000000000002,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.75,"5min":0.75,"15min":0.75},"last":0.44900000000000001},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.59899999999999998,"5min":0.59899999999999998,"15min":0.59899999999999998},"last":0.35799999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.47299999999999998,"5min":0.41899999999999998,"15min":0.41399999999999998},"min":{"1min":0.29699999999999999,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.77200000000000002,"5min":0.77200000000000002,"15min":0.77200000000000002},"last":0.42799999999999999},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.46000000000000002,"15min":0.46400000000000002},"min":{"1min":0.30599999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.71099999999999997,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.46300000000000002}]},{"osd":6,"last update":"Thu Feb 3 04:13:14 2022","interfaces":[{"interface":"back","average":{"1min":0.45400000000000001,"5min":0.442,"15min":0.438},"min":{"1min":0.30499999999999999,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.65300000000000002,"5min":0.69499999999999995,"15min":0.69499999999999995},"last":0.40500000000000003},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.50700000000000001,"15min":0.49299999999999999},"min":{"1min":0.35699999999999998,"5min":0.249,"15min":0.249},"max":{"1min":0.879,"5min":0.879,"15min":0.879},"last":0.58099999999999996}]}]},{"osd":6,"up_from":13,"seq":55834574902,"num_pgs":18,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":166740,"kb_used_data":137820,"kb_used_omap":0,"kb_used_meta":28672,"kb_avail":94205100,"statfs":{"total":96636764160,"available":96466022400,"internally_reserved":0,"allocated":141127680,"data_stored":152810273,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":29360128},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.50900000000000001,"15min":0.58799999999999997},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.66700000000000004,"5min":4.3019999999999996,"15min":4.3019999999999996},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.5,"15min":0.54200000000000004},"min":{"1min":0.31900000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.71599999999999997,"5min":2.7890000000000001,"15min":2.7890000000000001},"last":0.60899999999999999}]},{"osd":1,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.59499999999999997,"15min":0.751},"min":{"1min":0.33500000000000002,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.72499999999999998,"5min":4.5999999999999996,"15min":4.5999999999999996},"last":0.54900000000000004},{"interface":"front","average":{"1min":0.502,"5min":0.495,"15min":0.53100000000000003},"min":{"1min":0.34599999999999997,"5min":0.307,"15min":0.307},"max":{"1min":0.65100000000000002,"5min":2.6429999999999998,"15min":2.6429999999999998},"last":0.67700000000000005}]},{"osd":2,"last update":"Thu Feb 3 04:11:07 2022","interfaces":[{"interface":"back","average":{"1min":0.436,"5min":0.64100000000000001,"15min":0.67500000000000004},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.64000000000000001,"5min":4.383,"15min":4.383},"last":0.59999999999999998},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.624,"15min":0.64700000000000002},"min":{"1min":0.33000000000000002,"5min":0.33000000000000002,"15min":0.33000000000000002},"max":{"1min":0.879,"5min":4.0819999999999999,"15min":4.0819999999999999},"last":0.65000000000000002}]},{"osd":3,"last update":"Thu Feb 3 04:12:45 2022","interfaces":[{"interface":"back","average":{"1min":0.47899999999999998,"5min":0.53300000000000003,"15min":0.56699999999999995},"min":{"1min":0.33900000000000002,"5min":0.28199999999999997,"15min":0.28199999999999997},"max":{"1min":0.64200000000000002,"5min":2.6840000000000002,"15min":2.6840000000000002},"last":0.68700000000000006},{"interface":"front","average":{"1min":0.497,"5min":0.59299999999999997,"15min":0.64100000000000001},"min":{"1min":0.35699999999999998,"5min":0.35699999999999998,"15min":0.35699999999999998},"max":{"1min":0.64800000000000002,"5min":4.3490000000000002,"15min":4.3490000000000002},"last":0.73999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:24 2022","interfaces":[{"interface":"back","average":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"min":{"1min":0.26500000000000001,"5min":0.26500000000000001,"15min":0.26500000000000001},"max":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"last":0.66500000000000004},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29599999999999999,"5min":0.29599999999999999,"15min":0.29599999999999999},"max":{"1min":0.63300000000000001,"5min":0.63300000000000001,"15min":0.63300000000000001},"last":0.504}]},{"osd":5,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.438,"15min":0.42999999999999999},"min":{"1min":0.29499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64400000000000002,"5min":0.79800000000000004,"15min":0.79800000000000004},"last":0.627},{"interface":"front","average":{"1min":0.52000000000000002,"5min":0.54700000000000004,"15min":0.626},"min":{"1min":0.36099999999999999,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.70199999999999996,"5min":5.3310000000000004,"15min":5.3310000000000004},"last":0.63400000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52400000000000002,"15min":0.56200000000000006},"min":{"1min":0.32800000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.86799999999999999,"5min":2.746,"15min":2.746},"last":0.56299999999999994},{"interface":"front","average":{"1min":0.55500000000000005,"5min":0.51300000000000001,"15min":0.51500000000000001},"min":{"1min":0.38100000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.79000000000000004,"5min":1.103,"15min":1.103},"last":0.70699999999999996}]}]},{"osd":1,"up_from":13,"seq":55834574904,"num_pgs":20,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":164620,"kb_used_data":133012,"kb_used_omap":0,"kb_used_meta":31360,"kb_avail":94207220,"statfs":{"total":96636764160,"available":96468193280,"internally_reserved":0,"allocated":136204288,"data_stored":136648473,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":32112640},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.399,"5min":0.51000000000000001,"15min":0.371},"min":{"1min":0.16900000000000001,"5min":0.16900000000000001,"15min":0.16900000000000001},"max":{"1min":22.076000000000001,"5min":22.076000000000001,"15min":22.076000000000001},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.43099999999999999,"5min":0.35099999999999998,"15min":0.34100000000000003},"min":{"1min":0.193,"5min":0.193,"15min":0.193},"max":{"1min":2.1589999999999998,"5min":2.1589999999999998,"15min":2.1589999999999998},"last":0.42699999999999999}]},{"osd":2,"last update":"Thu Feb 3 04:12:07 2022","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.318,"15min":0.30599999999999999},"min":{"1min":0.19500000000000001,"5min":0.193,"15min":0.193},"max":{"1min":1.4630000000000001,"5min":1.4630000000000001,"15min":1.4630000000000001},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.32300000000000001,"5min":0.32900000000000001,"15min":0.32800000000000001},"min":{"1min":0.24299999999999999,"5min":0.223,"15min":0.223},"max":{"1min":0.41599999999999998,"5min":0.88500000000000001,"15min":0.88500000000000001},"last":0.38500000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:48 2022","interfaces":[{"interface":"back","average":{"1min":0.32200000000000001,"5min":0.34799999999999998,"15min":0.35099999999999998},"min":{"1min":0.24399999999999999,"5min":0.22600000000000001,"15min":0.22600000000000001},"max":{"1min":0.51100000000000001,"5min":0.878,"15min":0.878},"last":0.45200000000000001},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.36099999999999999,"15min":0.35899999999999999},"min":{"1min":0.20000000000000001,"5min":0.20000000000000001,"15min":0.20000000000000001},"max":{"1min":0.46100000000000002,"5min":1.5429999999999999,"15min":1.5429999999999999},"last":0.33900000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.434,"5min":0.434,"15min":0.434},"min":{"1min":0.28399999999999997,"5min":0.28399999999999997,"15min":0.28399999999999997},"max":{"1min":0.61699999999999999,"5min":0.61699999999999999,"15min":0.61699999999999999},"last":0.625},{"interface":"front","average":{"1min":0.48399999999999999,"5min":0.48399999999999999,"15min":0.48399999999999999},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.628,"5min":0.628,"15min":0.628},"last":0.66700000000000004}]},{"osd":5,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":0.67600000000000005,"15min":0.60499999999999998},"min":{"1min":0.312,"5min":0.309,"15min":0.309},"max":{"1min":12.002000000000001,"5min":12.002000000000001,"15min":12.002000000000001},"last":0.58999999999999997},{"interface":"front","average":{"1min":1.1299999999999999,"5min":0.65900000000000003,"15min":0.59699999999999998},"min":{"1min":0.34300000000000003,"5min":0.27100000000000002,"15min":0.27100000000000002},"max":{"1min":11.265000000000001,"5min":11.265000000000001,"15min":11.265000000000001},"last":0.61199999999999999}]},{"osd":6,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":0.60799999999999998,"5min":0.53000000000000003,"15min":0.52000000000000002},"min":{"1min":0.29799999999999999,"5min":0.28599999999999998,"15min":0.28599999999999998},"max":{"1min":2.2120000000000002,"5min":2.2120000000000002,"15min":2.2120000000000002},"last":0.55200000000000005},{"interface":"front","average":{"1min":1.1160000000000001,"5min":0.65400000000000003,"15min":0.58199999999999996},"min":{"1min":0.372,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":11.972,"5min":11.972,"15min":11.972},"last":0.63700000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:13:07 2022","interfaces":[{"interface":"back","average":{"1min":1.089,"5min":0.66000000000000003,"15min":0.60599999999999998},"min":{"1min":0.38200000000000001,"5min":0.36899999999999999,"15min":0.36899999999999999},"max":{"1min":11.298,"5min":11.298,"15min":11.298},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.66500000000000004,"5min":0.58499999999999996,"15min":0.58599999999999997},"min":{"1min":0.41499999999999998,"5min":0.309,"15min":0.309},"max":{"1min":2.1880000000000002,"5min":2.1880000000000002,"15min":2.1880000000000002},"last":0.57599999999999996}]}]},{"osd":0,"up_from":13,"seq":55834574901,"num_pgs":16,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":146864,"kb_used_data":123176,"kb_used_omap":0,"kb_used_meta":23680,"kb_avail":94224976,"statfs":{"total":96636764160,"available":96486375424,"internally_reserved":0,"allocated":126132224,"data_stored":142235603,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":24248320},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.30299999999999999,"5min":0.318,"15min":0.318},"min":{"1min":0.188,"5min":0.186,"15min":0.186},"max":{"1min":0.46800000000000003,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.35999999999999999,"5min":0.373,"15min":0.34999999999999998},"min":{"1min":0.23599999999999999,"5min":0.218,"15min":0.218},"max":{"1min":0.88500000000000001,"5min":1.5009999999999999,"15min":1.5009999999999999},"last":0.53000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:09 2022","interfaces":[{"interface":"back","average":{"1min":0.46300000000000002,"5min":0.379,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.23000000000000001,"15min":0.23000000000000001},"max":{"1min":1.5669999999999999,"5min":1.5669999999999999,"15min":1.5669999999999999},"last":0.372},{"interface":"front","average":{"1min":0.432,"5min":0.38500000000000001,"15min":0.377},"min":{"1min":0.224,"5min":0.224,"15min":0.224},"max":{"1min":1.875,"5min":1.875,"15min":1.875},"last":0.38600000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.42199999999999999,"15min":0.42999999999999999},"min":{"1min":0.20399999999999999,"5min":0.19700000000000001,"15min":0.19700000000000001},"max":{"1min":0.92400000000000004,"5min":1.605,"15min":1.605},"last":0.46300000000000002},{"interface":"front","average":{"1min":0.314,"5min":0.38200000000000001,"15min":0.40699999999999997},"min":{"1min":0.221,"5min":0.221,"15min":0.221},"max":{"1min":0.497,"5min":0.97799999999999998,"15min":0.97799999999999998},"last":0.35999999999999999}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.495,"5min":0.495,"15min":0.495},"min":{"1min":0.26800000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.48899999999999999,"5min":0.48899999999999999,"15min":0.48899999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.47899999999999998}]},{"osd":5,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54600000000000004,"5min":0.52600000000000002,"15min":0.52300000000000002},"min":{"1min":0.35999999999999999,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.81699999999999995,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.58099999999999996},{"interface":"front","average":{"1min":0.55200000000000005,"5min":0.55900000000000005,"15min":0.55800000000000005},"min":{"1min":0.32800000000000001,"5min":0.32800000000000001,"15min":0.32800000000000001},"max":{"1min":0.84399999999999997,"5min":1.105,"15min":1.105},"last":0.54700000000000004}]},{"osd":6,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54700000000000004,"5min":0.55900000000000005,"15min":0.54900000000000004},"min":{"1min":0.29999999999999999,"5min":0.29999999999999999,"15min":0.29999999999999999},"max":{"1min":0.98499999999999999,"5min":1.639,"15min":1.639},"last":0.66200000000000003},{"interface":"front","average":{"1min":0.53100000000000003,"5min":0.55000000000000004,"15min":0.55300000000000005},"min":{"1min":0.38700000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.78500000000000003,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.51500000000000001}]},{"osd":7,"last update":"Thu Feb 3 04:12:12 2022","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.56100000000000005,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.35899999999999999,"15min":0.35899999999999999},"max":{"1min":0.70499999999999996,"5min":0.88,"15min":0.88},"last":0.441},{"interface":"front","average":{"1min":0.58699999999999997,"5min":0.57499999999999996,"15min":0.57299999999999995},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":1.2250000000000001,"5min":1.2250000000000001,"15min":1.2250000000000001},"last":0.67700000000000005}]}]},{"osd":2,"up_from":195,"seq":837518622731,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":87544,"kb_used_data":72560,"kb_used_omap":18,"kb_used_meta":14957,"kb_avail":94284296,"statfs":{"total":96636764160,"available":96547119104,"internally_reserved":0,"allocated":74301440,"data_stored":74704659,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":19126,"internal_metadata":15316298},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.25700000000000001}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.28199999999999997}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35099999999999998}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.44900000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45900000000000002}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48699999999999999}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.47399999999999998}]}]},{"osd":3,"up_from":42,"seq":180388626477,"num_pgs":17,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":248144,"kb_used_data":218760,"kb_used_omap":1,"kb_used_meta":29374,"kb_avail":94123696,"statfs":{"total":96636764160,"available":96382664704,"internally_reserved":0,"allocated":224010240,"data_stored":245797411,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1080,"internal_metadata":30079944},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.26300000000000001,"5min":0.29299999999999998,"15min":0.29999999999999999},"min":{"1min":0.19800000000000001,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.33800000000000002,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.375},{"interface":"front","average":{"1min":0.32700000000000001,"5min":0.33500000000000002,"15min":0.33200000000000002},"min":{"1min":0.26900000000000002,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.40200000000000002,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.35499999999999998}]},{"osd":1,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.36299999999999999,"5min":0.34999999999999998,"15min":0.34399999999999997},"min":{"1min":0.221,"5min":0.216,"15min":0.216},"max":{"1min":1.355,"5min":1.355,"15min":1.355},"last":0.38700000000000001},{"interface":"front","average":{"1min":0.36699999999999999,"5min":0.35399999999999998,"15min":0.34899999999999998},"min":{"1min":0.247,"5min":0.185,"15min":0.185},"max":{"1min":0.64800000000000002,"5min":1.024,"15min":1.024},"last":0.28000000000000003}]},{"osd":2,"last update":"Thu Feb 3 04:11:45 2022","interfaces":[{"interface":"back","average":{"1min":0.32500000000000001,"5min":0.36299999999999999,"15min":0.36899999999999999},"min":{"1min":0.26000000000000001,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.629,"5min":0.67500000000000004,"15min":0.67500000000000004},"last":0.32600000000000001},{"interface":"front","average":{"1min":0.33100000000000002,"5min":0.34300000000000003,"15min":0.34499999999999997},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.56699999999999995,"5min":0.61599999999999999,"15min":0.61599999999999999},"last":0.34200000000000003}]},{"osd":4,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.35199999999999998,"5min":0.35199999999999998,"15min":0.35199999999999998},"max":{"1min":0.625,"5min":0.625,"15min":0.625},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.51000000000000001,"5min":0.51000000000000001,"15min":0.51000000000000001},"min":{"1min":0.32000000000000001,"5min":0.32000000000000001,"15min":0.32000000000000001},"max":{"1min":0.74199999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"last":0.56000000000000005}]},{"osd":5,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.48999999999999999,"15min":0.48999999999999999},"min":{"1min":0.36499999999999999,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.83999999999999997,"5min":1.004,"15min":1.004},"last":0.49399999999999999},{"interface":"front","average":{"1min":0.501,"5min":0.53800000000000003,"15min":0.55000000000000004},"min":{"1min":0.35499999999999998,"5min":0.318,"15min":0.318},"max":{"1min":0.90800000000000003,"5min":1.1479999999999999,"15min":1.1479999999999999},"last":0.57199999999999995}]},{"osd":6,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.53700000000000003,"5min":0.53800000000000003,"15min":0.54800000000000004},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":1.2969999999999999,"5min":1.2969999999999999,"15min":1.2969999999999999},"last":0.504},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.51800000000000002,"15min":0.51900000000000002},"min":{"1min":0.37,"5min":0.308,"15min":0.308},"max":{"1min":0.78000000000000003,"5min":0.94199999999999995,"15min":0.94199999999999995},"last":0.58699999999999997}]},{"osd":7,"last update":"Thu Feb 3 04:12:50 2022","interfaces":[{"interface":"back","average":{"1min":0.51900000000000002,"5min":0.53200000000000003,"15min":0.54200000000000004},"min":{"1min":0.38500000000000001,"5min":0.29399999999999998,"15min":0.29399999999999998},"max":{"1min":0.749,"5min":1.034,"15min":1.034},"last":0.52900000000000003},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54300000000000004,"15min":0.54800000000000004},"min":{"1min":0.39700000000000002,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.89000000000000001,"5min":0.99099999999999999,"15min":0.99099999999999999},"last":0.61199999999999999}]}]},{"osd":4,"up_from":134,"seq":575525617689,"num_pgs":15,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":175788,"kb_used_data":153636,"kb_used_omap":37,"kb_used_meta":22106,"kb_avail":94196052,"statfs":{"total":96636764160,"available":96456757248,"internally_reserved":0,"allocated":157323264,"data_stored":158664501,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":38032,"internal_metadata":22637424},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46800000000000003,"5min":0.46800000000000003,"15min":0.46800000000000003},"min":{"1min":0.30199999999999999,"5min":0.30199999999999999,"15min":0.30199999999999999},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.47199999999999998},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.56399999999999995}]},{"osd":1,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.46600000000000003,"5min":0.46600000000000003,"15min":0.46600000000000003},"min":{"1min":0.36199999999999999,"5min":0.36199999999999999,"15min":0.36199999999999999},"max":{"1min":0.57599999999999996,"5min":0.57599999999999996,"15min":0.57599999999999996},"last":0.53700000000000003},{"interface":"front","average":{"1min":0.47399999999999998,"5min":0.47399999999999998,"15min":0.47399999999999998},"min":{"1min":0.35599999999999998,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.624}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.57599999999999996}]},{"osd":3,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.443,"5min":0.443,"15min":0.443},"min":{"1min":0.33400000000000002,"5min":0.33400000000000002,"15min":0.33400000000000002},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.505},{"interface":"front","average":{"1min":0.46899999999999997,"5min":0.46899999999999997,"15min":0.46899999999999997},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.52100000000000002}]},{"osd":5,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.41899999999999998,"5min":0.41899999999999998,"15min":0.41899999999999998},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.73099999999999998,"5min":0.73099999999999998,"15min":0.73099999999999998},"last":0.59299999999999997},{"interface":"front","average":{"1min":0.41399999999999998,"5min":0.41399999999999998,"15min":0.41399999999999998},"min":{"1min":0.30099999999999999,"5min":0.30099999999999999,"15min":0.30099999999999999},"max":{"1min":0.61399999999999999,"5min":0.61399999999999999,"15min":0.61399999999999999},"last":0.60099999999999998}]},{"osd":6,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.83199999999999996,"5min":0.83199999999999996,"15min":0.83199999999999996},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.313,"5min":0.313,"15min":0.313},"max":{"1min":0.66300000000000003,"5min":0.66300000000000003,"15min":0.66300000000000003},"last":0.54900000000000004}]},{"osd":7,"last update":"Thu Feb 3 04:12:20 2022","interfaces":[{"interface":"back","average":{"1min":0.47999999999999998,"5min":0.47999999999999998,"15min":0.47999999999999998},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.80700000000000005,"5min":0.80700000000000005,"15min":0.80700000000000005},"last":0.65400000000000003},{"interface":"front","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.61499999999999999}]}]},{"osd":5,"up_from":13,"seq":55834574901,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":98668,"kb_used_data":82532,"kb_used_omap":0,"kb_used_meta":16128,"kb_avail":94273172,"statfs":{"total":96636764160,"available":96535728128,"internally_reserved":0,"allocated":84512768,"data_stored":88990136,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":16515072},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.46500000000000002,"5min":0.44400000000000001,"15min":0.45100000000000001},"min":{"1min":0.253,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.60299999999999998,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.36199999999999999},{"interface":"front","average":{"1min":0.48999999999999999,"5min":0.42799999999999999,"15min":0.41999999999999998},"min":{"1min":0.32600000000000001,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.60999999999999999,"5min":0.63700000000000001,"15min":0.63700000000000001},"last":0.379}]},{"osd":1,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.49399999999999999,"5min":0.45200000000000001,"15min":0.45400000000000001},"min":{"1min":0.33000000000000002,"5min":0.24099999999999999,"15min":0.24099999999999999},"max":{"1min":0.63300000000000001,"5min":0.94399999999999995,"15min":0.94399999999999995},"last":0.40899999999999997},{"interface":"front","average":{"1min":0.45600000000000002,"5min":0.44,"15min":0.436},"min":{"1min":0.27000000000000002,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.56999999999999995,"5min":0.68999999999999995,"15min":0.68999999999999995},"last":0.58399999999999996}]},{"osd":2,"last update":"Thu Feb 3 04:12:05 2022","interfaces":[{"interface":"back","average":{"1min":0.41499999999999998,"5min":0.49399999999999999,"15min":0.49199999999999999},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.50900000000000001,"5min":3.121,"15min":3.121},"last":0.42999999999999999},{"interface":"front","average":{"1min":0.441,"5min":0.50800000000000001,"15min":0.498},"min":{"1min":0.34000000000000002,"5min":0.34000000000000002,"15min":0.34000000000000002},"max":{"1min":0.60099999999999998,"5min":3.1509999999999998,"15min":3.1509999999999998},"last":0.44900000000000001}]},{"osd":3,"last update":"Thu Feb 3 04:12:43 2022","interfaces":[{"interface":"back","average":{"1min":0.47699999999999998,"5min":0.45800000000000002,"15min":0.46000000000000002},"min":{"1min":0.28499999999999998,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.46800000000000003},{"interface":"front","average":{"1min":0.51100000000000001,"5min":0.50800000000000001,"15min":0.51200000000000001},"min":{"1min":0.35799999999999998,"5min":0.34899999999999998,"15min":0.34899999999999998},"max":{"1min":0.61799999999999999,"5min":0.61799999999999999,"15min":0.61799999999999999},"last":0.52700000000000002}]},{"osd":4,"last update":"Thu Feb 3 04:12:21 2022","interfaces":[{"interface":"back","average":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"min":{"1min":0.23699999999999999,"5min":0.23699999999999999,"15min":0.23699999999999999},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.48999999999999999},{"interface":"front","average":{"1min":0.40100000000000002,"5min":0.40100000000000002,"15min":0.40100000000000002},"min":{"1min":0.27000000000000002,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.66700000000000004,"5min":0.66700000000000004,"15min":0.66700000000000004},"last":0.50700000000000001}]},{"osd":6,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.42299999999999999,"5min":0.40400000000000003,"15min":0.40000000000000002},"min":{"1min":0.28499999999999998,"5min":0.26800000000000002,"15min":0.26800000000000002},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.499},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.45500000000000002,"15min":0.45300000000000001},"min":{"1min":0.34399999999999997,"5min":0.28299999999999997,"15min":0.28299999999999997},"max":{"1min":0.81499999999999995,"5min":0.81499999999999995,"15min":0.81499999999999995},"last":0.56799999999999995}]},{"osd":7,"last update":"Thu Feb 3 04:13:08 2022","interfaces":[{"interface":"back","average":{"1min":0.501,"5min":0.44700000000000001,"15min":0.443},"min":{"1min":0.34899999999999998,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.85499999999999998,"5min":0.85499999999999998,"15min":0.85499999999999998},"last":0.53800000000000003},{"interface":"front","average":{"1min":0.48499999999999999,"5min":0.46999999999999997,"15min":0.47799999999999998},"min":{"1min":0.32000000000000001,"5min":0.29299999999999998,"15min":0.29299999999999998},"max":{"1min":0.78800000000000003,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.54500000000000004}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":21385216,"data_stored":21358053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":50597888,"data_stored":50506150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46559232,"data_stored":46470278,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":3780,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24190976,"data_stored":24145696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":65728512,"data_stored":65613573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":77864960,"data_stored":94686482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":113643520,"data_stored":114740505,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":51744768,"data_stored":52797484,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1618,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":172240896,"data_stored":194742139,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":109588480,"data_stored":111644308,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":59150336,"data_stored":64295318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":73691136,"data_stored":86117857,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":114094080,"data_stored":134254186,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} , 2022-02-03T04:13:16.818 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph status --format=json , 2022-02-03T04:13:17.180 INFO:teuthology.orchestra.run.smithi090.stdout: Ignoring malparsed backtrace: 2022-02-03T04:13:50.249 DEBUG:teuthology.orchestra.run.smithi090:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2022-02-03T04:13:50.547 INFO:teuthology.orchestra.run.smithi090.stdout: , dumped all Ignoring malparsed backtrace: 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:{ , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout: "success": "osd_debug_deep_scrub_sleep = '0.000000' (not observed, change may require restart) " , 2022-02-03T04:14:14.180 INFO:teuthology.orchestra.run.smithi090.stdout:} Ignoring malparsed backtrace: 2022-02-03T04:14:56.976 INFO:teuthology.misc:Shutting down osd daemons... , 2022-02-03T04:14:56.976 DEBUG:tasks.ceph.osd.0:waiting for process to exit , 2022-02-03T04:14:56.977 INFO:teuthology.orchestra.run:waiting for 300 Ignoring malparsed backtrace: 2022-02-03T04:15:00.089 DEBUG:teuthology.orchestra.run.smithi090:> sudo tar cz -f - -C /var/lib/ceph/crash -- . , 2022-02-03T04:15:00.120 DEBUG:teuthology.misc:Transferring archived files from smithi160:/var/lib/ceph/crash to /home/teuthworker/archive/yuriw-2022-02-03_02:33:02-rados-wip-yuri8-testing-2022-02-02-1557-quincy-distro-default-smithi/6657187/remote/smithi160/crash , 2022-02-03T04:15:00.122 DEBUG:teuthology.orchestra.run.smithi160:> sudo tar cz -f - -C /var/lib/ceph/crash -- . Ignoring malparsed backtrace: 2022-02-03T04:15:17.938 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog , 2022-02-03T04:15:17.951 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... , 2022-02-03T04:15:17.952 DEBUG:teuthology.orchestra.run.smithi090:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart Found 11 distinct failure reasons Failure: SELinux denials found on ubuntu@smithi065.front.sepia.ceph.com: ['type=AVC msg=audit(1643867482.856:2980): avc: denied { setgid } for pid=17626 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643867419.212:2844): avc: denied { setgid } for pid=15098 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643867420.446:2853): avc: denied { setgid } for pid=15121 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643867420.242:2849): avc: denied { setgid } for pid=15108 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643867481.854:2978): avc: denied { setgid } for pid=17617 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tclass=capability permissive=1'] 90 jobs suites intersection: [] suites union: ['0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '1-install/octopus', '1-install/pacific', '1-pg-log-overrides/normal_pg_log', '1-pg-log-overrides/short_pg_log', '2-inject-leak/mon', '2-inject-leak/none', '2-inject-leak/osd', '2-recovery-overrides/{default}', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{default}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', '3-scrub-overrides/{max-simultaneous-scrubs-3}', 'backoff/normal', 'backoff/peering', 'backoff/peering_and_degraded', 'centos_latest}', 'ceph', 'cluster/{12-osds', 'clusters/3-mons', 'clusters/9-mons', 'clusters/{fixed-2', 'clusters/{fixed-4', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'crc-failures/default', 'd-balancer/crush-compat', 'd-balancer/on', 'd-thrash/default/{default', 'd-thrash/none', 'debug/mgr', 'fast/fast', 'fast/normal', 'mgr_ttl_cache/disable', 'mgr_ttl_cache/enable', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/few', 'msgr-failures/many', 'msgr-failures/mon-delay', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'no_pools', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-lz4', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zlib', 'objectstore/bluestore-comp-zstd', 'objectstore/bluestore-hybrid', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/basic/{ceph', 'rados/dashboard/{0-single-container-host', 'rados/mgr/{clusters/{2-node-mgr}', 'rados/monthrash/{ceph', 'rados/multimon/{clusters/6', 'rados/multimon/{clusters/9', 'rados/objectstore/{backends/filestore-idempotent', 'rados/objectstore/{backends/filestore-idempotent-aio-journal', 'rados/objectstore/{backends/fusestore', 'rados/objectstore/{backends/objectcacher-stress', 'rados/objectstore/{backends/objectstore-filestore-memstore', 'rados/singleton-bluestore/{all/cephtool', 'rados/singleton-nomsgr/{all/cache-fs-trunc', 'rados/singleton-nomsgr/{all/ceph-post-file', 'rados/singleton-nomsgr/{all/health-warnings', 'rados/singleton-nomsgr/{all/lazy_omap_stats_output', 'rados/singleton-nomsgr/{all/librados_hello_world', 'rados/singleton-nomsgr/{all/msgr', 'rados/singleton-nomsgr/{all/osd_stale_reads', 'rados/singleton-nomsgr/{all/pool-access', 'rados/singleton-nomsgr/{all/recovery-unfound-found', 'rados/singleton-nomsgr/{all/version-number-sanity', 'rados/singleton/{all/divergent_priors2', 'rados/singleton/{all/erasure-code-nonregression', 'rados/singleton/{all/max-pg-per-osd.from-primary', 'rados/singleton/{all/osd-recovery', 'rados/singleton/{all/osd-recovery-incomplete', 'rados/singleton/{all/radostool', 'rados/singleton/{all/random-eio', 'rados/singleton/{all/test-noautoscale-flag', 'rados/singleton/{all/thrash-eio', 'rados/singleton/{all/thrash-rados/{thrash-rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/standalone/{supported-random-distro$/{centos_8}', 'rados/thrash-erasure-code-big/{ceph', 'rados/thrash-erasure-code-isa/{arch/x86_64', 'rados/thrash-erasure-code-overwrites/{bluestore-bitmap', 'rados/thrash-erasure-code-shec/{ceph', 'rados/thrash-erasure-code/{ceph', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'rados/valgrind-leaks/{1-start', 'rados/verify/{centos_latest', 'random-objectstore$/{bluestore-bitmap}', 'random-objectstore$/{bluestore-comp-lz4}', 'random-objectstore$/{bluestore-comp-zlib}', 'random-objectstore$/{bluestore-low-osd-mem-target}', 'random-objectstore$/{bluestore-stupid}', 'recovery-overrides/{default}', 'recovery-overrides/{more-active-recovery}', 'recovery-overrides/{more-async-partial-recovery}', 'recovery-overrides/{more-async-recovery}', 'recovery-overrides/{more-partial-recovery}', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'tasks/crash}', 'tasks/dashboard}', 'tasks/e2e}', 'tasks/mon_clock_no_skews}', 'tasks/mon_recovery', 'tasks/mon_recovery}', 'tasks/progress}', 'tasks/prometheus}', 'tasks/rados_api_tests', 'tasks/rados_cls_all', 'tasks/rados_python}', 'tasks/rados_stress_watch}', 'tasks/rados_striper}', 'tasks/rados_workunit_loadgen_mix}', 'thrashers/careful', 'thrashers/default', 'thrashers/fastread', 'thrashers/mapgap', 'thrashers/minsize_recovery', 'thrashers/morepggrow', 'thrashers/none', 'thrashers/one', 'thrashers/pggrow', 'thrashers/sync', 'thrashers/sync-many', 'thrashosds-health', 'thrashosds-health}', 'three-plus-one}', 'validater/lockdep}', 'validater/valgrind}', 'workloads/admin_socket_objecter_requests}', 'workloads/c2c}', 'workloads/cache}', 'workloads/dedup-io-snaps}', 'workloads/ec-pool-snaps-few-objects-overwrites}', 'workloads/ec-rados-plugin=isa-k=2-m=1}', 'workloads/ec-rados-plugin=jerasure-k=4-m=2}', 'workloads/ec-rados-plugin=lrc-k=4-m=2-l=3}', 'workloads/ec-rados-plugin=shec-k=4-m=3-c=2}', 'workloads/ec-small-objects-fast-read-overwrites}', 'workloads/ec-small-objects-overwrites}', 'workloads/ec-small-objects}', 'workloads/pool-snaps-few-objects}', 'workloads/rados_5925}', 'workloads/rados_api_tests}', 'workloads/rados_mon_osdmap_prune}', 'workloads/rados_mon_workunits}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench}', 'workloads/redirect_set_object}', 'workloads/redirect}', 'workloads/small-objects-balanced}', 'workloads/snaps-few-objects-balanced}', 'workloads/snaps-few-objects}', 'workloads/test_rbd_api}'] Failure: Command failed on smithi104 with status 1: 'sudo yum install -y kernel' 16 jobs: ['6657418', '6657372', '6657431', '6657491', '6657269', '6657335', '6657446', '6657465', '6657392', '6657281', '6657328', '6657207', '6657406', '6657312', '6657191', '6657248'] suites intersection: [] suites union: ['0-nvme-loop', '0-size-min-size-overrides/2-size-2-min-size', '0-size-min-size-overrides/3-size-2-min-size', '0-start', '1-install/nautilus-v1only', '1-install/pacific', '1-start', '1-tasks', '2-ops/repave-all}', '2-ops/rm-zap-add}', '2-ops/rm-zap-flag}', '2-ops/rm-zap-wait}', '2-ops/rmdir-reactivate}', '2-services/basic', '3-final}', 'agent/off', 'agent/on', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'd-balancer/on', 'fixed-2', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/none', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'rados', 'rados/cephadm/osds/{0-distro/centos_8.2_container_tools_3.0', 'rados/cephadm/osds/{0-distro/centos_8.3_container_tools_3.0', 'rados/cephadm/smoke-singlehost/{0-random-distro$/{centos_8.2_container_tools_3.0}', 'rados/cephadm/smoke/{0-distro/centos_8.2_container_tools_3.0', 'rados/cephadm/smoke/{0-distro/centos_8.3_container_tools_3.0', 'rados/singleton/{all/lost-unfound-delete', 'rados/thrash-old-clients/{0-distro$/{centos_8.3_container_tools_3.0}', 'rados/upgrade/parallel/{0-random-distro$/{centos_8.3_container_tools_3.0}', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'start}', 'supported-random-distro$/{ubuntu_latest}}', 'test_rbd_api', 'test_rbd_python}}', 'thrashers/careful', 'thrashers/default', 'thrashosds-health', 'three-plus-one}', 'upgrade-sequence', 'workload/{ec-rados-default', 'workloads/cache-snaps}', 'workloads/radosbench}'] Failure: Command failed on smithi204 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:fc4f59a13b5cfe31b1d75dc7e873c108d04bff91 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 2fae4342-84ac-11ec-8c35-001a4aab830c -- ceph mon dump -f json' 1 jobs: ['6657265'] suites: ['0-nvme-loop', '1-start', '2-ops/rm-zap-wait}', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_3.0'] Failure: SELinux denials found on ubuntu@smithi125.front.sepia.ceph.com: ['type=AVC msg=audit(1643866443.420:2853): avc: denied { setgid } for pid=15125 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643866498.127:2978): avc: denied { setgid } for pid=17623 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643866442.488:2848): avc: denied { setgid } for pid=15115 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643866499.055:2983): avc: denied { setgid } for pid=17634 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tclass=capability permissive=1'] 4 jobs: ['6657346', '6657237', '6657243', '6657420'] suites intersection: ['rados'] suites union: ['0-size-min-size-overrides/3-size-2-min-size', '1-install/nautilus', '1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-partial-recovery}', '3-scrub-overrides/{default}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'clusters/{openstack', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'd-balancer/on', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/few', 'msgr-failures/osd-dispatch-delay', 'msgr/async', 'objectstore/bluestore-bitmap', 'objectstore/filestore-xfs', 'openstack}', 'rados', 'rados/singleton-nomsgr/{all/admin_socket_output', 'rados/singleton/{all/pg-removal-interruption', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{centos_8}', 'supported-random-distro$/{centos_8}}', 'thrashers/mapgap', 'thrashers/morepggrow', 'thrashosds-health', 'three-plus-one}', 'workloads/cache-pool-snaps-readproxy}', 'workloads/snaps-few-objects}'] Failure: Command failed on smithi005 with status 127: 'sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:fc4f59a13b5cfe31b1d75dc7e873c108d04bff91 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 45222710-84ad-11ec-8c35-001a4aab830c -- bash -c \'set -e\nset -x\nceph orch ps\nHOST=$(hostname -s)\nOSD=$(ceph orch ps $HOST | grep osd | head -n 1 | awk \'"\'"\'{print $1}\'"\'"\')\necho "host $HOST, osd $OSD"\nceph orch daemon stop $OSD\nwhile ceph orch ps | grep $OSD | grep running ; do sleep 5 ; done\nceph auth export $OSD > k\nceph orch daemon rm $OSD --force\nceph orch ps --refresh\nwhile ceph orch ps | grep $OSD ; do sleep 5 ; done\nceph auth add $OSD -i k\nceph cephadm osd activate $HOST\nwhile ! ceph orch ps | grep $OSD | grep running ; do sleep 5 ; done\n\'' 2 jobs: ['6657284', '6657367'] suites intersection: ['0-nvme-loop', '1-start', '2-ops/rmdir-reactivate}'] suites union: ['0-nvme-loop', '1-start', '2-ops/rmdir-reactivate}', 'rados/cephadm/osds/{0-distro/centos_8.stream_container_tools_crun', 'rados/cephadm/osds/{0-distro/rhel_8.4_container_tools_rhel8'] Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --set_chunk --enable_dedup --low_tier_pool low_tier --dedup_chunk_size 131072 --dedup_chunk_algo fastcdc --max-ops 1500 --objects 50 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 0 --op read 100 --op write 25 --op delete 10 --op snap_create 10 --op snap_remove 10 --op rollback 10 --op set_chunk 30 --op tier_promote 10 --op tier_evict 10 --op tier_flush 5 --op write_excl 25 --pool unique_pool_0' 1 jobs: ['6657187'] suites: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{centos_8}', 'thrashers/default', 'thrashosds-health', 'workloads/dedup-io-snaps}'] Timeout 6h running clone.client.0/qa/workunits/rados/test.sh 1 jobs: ['6657473'] suites: ['ceph', 'clusters/{fixed-2', 'd-thrash/default/{default', 'mon_election/connectivity', 'msgr-failures/few', 'msgr/async-v2only', 'objectstore/bluestore-low-osd-mem-target', 'openstack}', 'rados', 'rados/verify/{centos_latest', 'tasks/rados_api_tests', 'thrashosds-health}', 'validater/valgrind}'] Failure: Command failed (workunit test cephadm/test_cephadm.sh) on smithi006 with status 126: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fc4f59a13b5cfe31b1d75dc7e873c108d04bff91 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephadm/test_cephadm.sh' 2 jobs: ['6657398', '6657275'] suites intersection: ['task/test_cephadm}'] suites union: ['mon_election/classic', 'mon_election/connectivity', 'rados/cephadm/workunits/{agent/off', 'rados/cephadm/workunits/{agent/on', 'task/test_cephadm}'] Failure: Command failed (workunit test rados/test.sh) on smithi137 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=fc4f59a13b5cfe31b1d75dc7e873c108d04bff91 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rados/test.sh' 1 jobs: ['6657413'] suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', '3-scrub-overrides/{max-simultaneous-scrubs-2}', 'backoff/peering', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/osd-dispatch-delay', 'msgr/async-v2only', 'objectstore/bluestore-stupid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/none', 'thrashosds-health', 'workloads/rados_api_tests}'] Failure: SELinux denials found on ubuntu@smithi040.front.sepia.ceph.com: ['type=AVC msg=audit(1643867339.108:2937): avc: denied { setgid } for pid=16490 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:groupadd_t:s0-s0:c0.c1023 tclass=capability permissive=1', 'type=AVC msg=audit(1643867340.060:2942): avc: denied { setgid } for pid=16500 comm="sss_cache" capability=6 scontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tcontext=unconfined_u:unconfined_r:useradd_t:s0-s0:c0.c1023 tclass=capability permissive=1'] 1 jobs: ['6657371'] suites: ['0-size-min-size-overrides/2-size-2-min-size', '1-install/nautilus-v2only', 'backoff/peering', 'ceph', 'clusters/{openstack', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'rados', 'rados/thrash-old-clients/{0-distro$/{centos_8.stream_container_tools}', 'thrashers/mapgap', 'thrashosds-health', 'three-plus-one}', 'workloads/rbd_cls}'] Failure: Test failure: test_update_export_with_invalid_values (tasks.cephfs.test_nfs.TestNFS) 1 jobs: ['6657199'] suites: ['mon_election/classic', 'rados/cephadm/workunits/{agent/on', 'task/test_nfs}']