Found 439 jobs Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f5374aa79cd] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f5374aa7ba8] Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-29T16:45:29.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T16:45:30.090 INFO:teuthology.orchestra.run.smithi087.stdout: Ignoring malparsed backtrace: 2021-01-29T16:46:32.264 INFO:teuthology.orchestra.run:waiting for 300 , 2021-01-29T16:46:32.311 INFO:tasks.ceph.mon.a:Stopped , 2021-01-29T16:46:32.312 INFO:tasks.ceph:Checking cluster log for badness... Ignoring malparsed backtrace: 2021-01-29T16:50:28.361 INFO:teuthology.task.internal.syslog:Checking logs for errors... , 2021-01-29T16:50:28.363 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com , 2021-01-29T16:50:28.363 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f5374aa79cd] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f5374aa7ba8] Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-29T16:45:29.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T16:45:30.090 INFO:teuthology.orchestra.run.smithi087.stdout: Ignoring malparsed backtrace: 2021-01-29T16:46:32.264 INFO:teuthology.orchestra.run:waiting for 300 , 2021-01-29T16:46:32.311 INFO:tasks.ceph.mon.a:Stopped , 2021-01-29T16:46:32.312 INFO:tasks.ceph:Checking cluster log for badness... Ignoring malparsed backtrace: 2021-01-29T16:50:28.361 INFO:teuthology.task.internal.syslog:Checking logs for errors... , 2021-01-29T16:50:28.363 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com , 2021-01-29T16:50:28.363 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f5374aa79cd] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f5374aa7ba8] Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-29T16:45:29.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T16:45:30.090 INFO:teuthology.orchestra.run.smithi087.stdout: Ignoring malparsed backtrace: 2021-01-29T16:46:32.264 INFO:teuthology.orchestra.run:waiting for 300 , 2021-01-29T16:46:32.311 INFO:tasks.ceph.mon.a:Stopped , 2021-01-29T16:46:32.312 INFO:tasks.ceph:Checking cluster log for badness... Ignoring malparsed backtrace: 2021-01-29T16:50:28.361 INFO:teuthology.task.internal.syslog:Checking logs for errors... , 2021-01-29T16:50:28.363 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com , 2021-01-29T16:50:28.363 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f5374aa79cd] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f5374aa7ba8] Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-29T16:45:29.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T16:45:30.090 INFO:teuthology.orchestra.run.smithi087.stdout: Ignoring malparsed backtrace: 2021-01-29T16:46:32.264 INFO:teuthology.orchestra.run:waiting for 300 , 2021-01-29T16:46:32.311 INFO:tasks.ceph.mon.a:Stopped , 2021-01-29T16:46:32.312 INFO:tasks.ceph:Checking cluster log for badness... Ignoring malparsed backtrace: 2021-01-29T16:50:28.361 INFO:teuthology.task.internal.syslog:Checking logs for errors... , 2021-01-29T16:50:28.363 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com , 2021-01-29T16:50:28.363 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_assert_fail(char const*, char const*, int, char const*)+0x14b) [0x7f5374aa79cd] , 2: (ceph::__ceph_assertf_fail(char const*, char const*, int, char const*, char const*, ...)+0) [0x7f5374aa7ba8] Ignoring malparsed backtrace: instructed osd(s) 5 to deep-scrub , 2021-01-29T16:45:29.791 DEBUG:teuthology.orchestra.run.smithi087:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T16:45:30.090 INFO:teuthology.orchestra.run.smithi087.stdout: Ignoring malparsed backtrace: 2021-01-29T16:46:32.264 INFO:teuthology.orchestra.run:waiting for 300 , 2021-01-29T16:46:32.311 INFO:tasks.ceph.mon.a:Stopped , 2021-01-29T16:46:32.312 INFO:tasks.ceph:Checking cluster log for badness... Ignoring malparsed backtrace: 2021-01-29T16:50:28.361 INFO:teuthology.task.internal.syslog:Checking logs for errors... , 2021-01-29T16:50:28.363 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi087.front.sepia.ceph.com , 2021-01-29T16:50:28.363 DEBUG:teuthology.orchestra.run.smithi087:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/*.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fde757ed15a] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x666) [0x55bfbfa77fe6] Ignoring malparsed backtrace: 2021-01-29T15:58:20.598 INFO:teuthology.orchestra.run.smithi067.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. , 2021-01-29T15:58:20.608 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops , 2021-01-29T15:58:20.786 INFO:teuthology.orchestra.run.smithi067.stdout:ERROR: (22) Invalid argument Ignoring malparsed backtrace: 2021-01-29T15:58:43.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 , 2021-01-29T15:58:43.760 INFO:teuthology.orchestra.run.smithi067.stdout:64424509480 , 2021-01-29T15:58:43.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509480 got 64424509480 for osd.2 Ignoring malparsed backtrace: 2021-01-29T15:58:52.402 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2021-01-29T15:58:35.676485+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=35, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) , 2021-01-29T15:58:52.402 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2021-01-29T15:58:27.421583+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) , 2021-01-29T15:58:52.403 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2021-01-29T15:57:43.068254+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=57, tm_sec=43, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) Ignoring malparsed backtrace: 2021-01-29T15:59:33.947 INFO:tasks.ceph.mgr.x:Stopped , 2021-01-29T15:59:33.948 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-29T15:59:33.948 DEBUG:tasks.ceph.mon.a:waiting for process to exit Ignoring malparsed backtrace: 2021-01-29T16:00:36.936 DEBUG:teuthology.orchestra.run.smithi205:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits , 2021-01-29T16:00:37.017 DEBUG:teuthology.run_tasks:Unwinding manager clock , 2021-01-29T16:00:37.030 INFO:teuthology.task.clock:Checking final clock skew... Ignoring malparsed backtrace: IndexError: list index out of range , 2021-01-29T16:01:02.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2021-01-29T16:01:02.089 INFO:teuthology.task.internal:Not uploading archives. Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fde757ed15a] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x666) [0x55bfbfa77fe6] Ignoring malparsed backtrace: 2021-01-29T15:58:20.598 INFO:teuthology.orchestra.run.smithi067.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. , 2021-01-29T15:58:20.608 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops , 2021-01-29T15:58:20.786 INFO:teuthology.orchestra.run.smithi067.stdout:ERROR: (22) Invalid argument Ignoring malparsed backtrace: 2021-01-29T15:58:43.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 , 2021-01-29T15:58:43.760 INFO:teuthology.orchestra.run.smithi067.stdout:64424509480 , 2021-01-29T15:58:43.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509480 got 64424509480 for osd.2 Ignoring malparsed backtrace: 2021-01-29T15:58:52.402 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2021-01-29T15:58:35.676485+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=35, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) , 2021-01-29T15:58:52.402 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2021-01-29T15:58:27.421583+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) , 2021-01-29T15:58:52.403 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2021-01-29T15:57:43.068254+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=57, tm_sec=43, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) Ignoring malparsed backtrace: 2021-01-29T15:59:33.947 INFO:tasks.ceph.mgr.x:Stopped , 2021-01-29T15:59:33.948 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-29T15:59:33.948 DEBUG:tasks.ceph.mon.a:waiting for process to exit Ignoring malparsed backtrace: 2021-01-29T16:00:36.936 DEBUG:teuthology.orchestra.run.smithi205:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits , 2021-01-29T16:00:37.017 DEBUG:teuthology.run_tasks:Unwinding manager clock , 2021-01-29T16:00:37.030 INFO:teuthology.task.clock:Checking final clock skew... Ignoring malparsed backtrace: IndexError: list index out of range , 2021-01-29T16:01:02.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2021-01-29T16:01:02.089 INFO:teuthology.task.internal:Not uploading archives. Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7fde757ed15a] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x666) [0x55bfbfa77fe6] Ignoring malparsed backtrace: 2021-01-29T15:58:20.598 INFO:teuthology.orchestra.run.smithi067.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. , 2021-01-29T15:58:20.608 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops , 2021-01-29T15:58:20.786 INFO:teuthology.orchestra.run.smithi067.stdout:ERROR: (22) Invalid argument Ignoring malparsed backtrace: 2021-01-29T15:58:43.471 DEBUG:teuthology.orchestra.run.smithi067:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 , 2021-01-29T15:58:43.760 INFO:teuthology.orchestra.run.smithi067.stdout:64424509480 , 2021-01-29T15:58:43.773 INFO:tasks.ceph.ceph_manager.ceph:need seq 64424509480 got 64424509480 for osd.2 Ignoring malparsed backtrace: 2021-01-29T15:58:52.402 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2021-01-29T15:58:35.676485+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=35, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) , 2021-01-29T15:58:52.402 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2021-01-29T15:58:27.421583+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=27, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) , 2021-01-29T15:58:52.403 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2021-01-29T15:57:43.068254+0000 time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=57, tm_sec=43, tm_wday=4, tm_yday=29, tm_isdst=-1) <= time.struct_time(tm_year=2021, tm_mon=1, tm_mday=29, tm_hour=15, tm_min=58, tm_sec=47, tm_wday=4, tm_yday=29, tm_isdst=0) Ignoring malparsed backtrace: 2021-01-29T15:59:33.947 INFO:tasks.ceph.mgr.x:Stopped , 2021-01-29T15:59:33.948 INFO:teuthology.misc:Shutting down mon daemons... , 2021-01-29T15:59:33.948 DEBUG:tasks.ceph.mon.a:waiting for process to exit Ignoring malparsed backtrace: 2021-01-29T16:00:36.936 DEBUG:teuthology.orchestra.run.smithi205:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits , 2021-01-29T16:00:37.017 DEBUG:teuthology.run_tasks:Unwinding manager clock , 2021-01-29T16:00:37.030 INFO:teuthology.task.clock:Checking final clock skew... Ignoring malparsed backtrace: IndexError: list index out of range , 2021-01-29T16:01:02.075 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload , 2021-01-29T16:01:02.089 INFO:teuthology.task.internal:Not uploading archives. Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f30135d315a] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x666) [0x55fd1cf11fe6] Ignoring malparsed backtrace: 2021-01-29T13:55:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument , 2021-01-29T13:55:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. , 2021-01-29T13:55:49.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops Ignoring malparsed backtrace: 2021-01-29T13:56:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:oload 1000 , 2021-01-29T13:56:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:max_change 3 , 2021-01-29T13:56:38.517 INFO:teuthology.orchestra.run.smithi183.stdout:max_change_osds 4 Ignoring malparsed backtrace: set osd.3 primary-affinity to 1 (8655362) , 2021-01-29T13:56:51.495 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 , 2021-01-29T13:56:52.480+0000 7f8f78ab0700 -1 osd.2 132 handle_osd_map injecting map crc failure Ignoring malparsed backtrace: 2021-01-29T13:57:08.429 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2021-01-29T13:57:06.667864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20305121604,"num_objects":6822,"num_object_clones":0,"num_object_copies":19368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2076,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":25509,"num_write_kb":14727220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2477,"num_bytes_recovered":5602499186,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15129,"ondisk_log_size":15129,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":24946968,"kb_used_data":24625140,"kb_used_omap":1,"kb_used_meta":321598,"kb_avail":730027752,"statfs":{"total":773094113280,"available":747548418048,"internally_reserved":0,"allocated":25216143360,"data_stored":30051268153,"data_compressed":504955484,"data_compressed_allocated":4927905792,"data_compressed_original":9855811584,"omap_allocated":1944,"internal_metadata":329316456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-170,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":394035071,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.133172"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"145","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847683+0000","last_change":"2021-01-29T13:55:57.162929+0000","last_active":"2021-01-29T13:57:00.847683+0000","last_peered":"2021-01-29T13:57:00.847683+0000","last_clean":"2021-01-29T13:57:00.847683+0000","last_became_active":"2021-01-29T13:52:24.188931+0000","last_became_peered":"2021-01-29T13:52:24.188931+0000","last_unstale":"2021-01-29T13:57:00.847683+0000","last_undegraded":"2021-01-29T13:57:00.847683+0000","last_fullsized":"2021-01-29T13:57:00.847683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:57.162808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:57.162808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"120'6449","reported_seq":"8595","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.652824+0000","last_change":"2021-01-29T13:55:45.625490+0000","last_active":"2021-01-29T13:57:00.652824+0000","last_peered":"2021-01-29T13:57:00.652824+0000","last_clean":"2021-01-29T13:57:00.652824+0000","last_became_active":"2021-01-29T13:52:39.830011+0000","last_became_peered":"2021-01-29T13:52:39.830011+0000","last_unstale":"2021-01-29T13:57:00.652824+0000","last_undegraded":"2021-01-29T13:57:00.652824+0000","last_fullsized":"2021-01-29T13:57:00.652824+0000","mapping_epoch":26,"log_start":"72'3403","ondisk_log_start":"72'3403","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6250","last_scrub_stamp":"2021-01-29T13:55:45.625379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:45.625379+0000","log_size":3046,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2928382292,"num_objects":986,"num_object_clones":0,"num_object_copies":1972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2501,"num_read_kb":1252,"num_write":5879,"num_write_kb":1639641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3315,"num_flush":761,"num_flush_kb":2192275,"num_evict":269,"num_evict_kb":760560,"num_promote":1249,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"112","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.552366+0000","last_change":"2021-01-29T13:55:42.661441+0000","last_active":"2021-01-29T13:57:00.552366+0000","last_peered":"2021-01-29T13:57:00.552366+0000","last_clean":"2021-01-29T13:57:00.552366+0000","last_became_active":"2021-01-29T13:53:29.493255+0000","last_became_peered":"2021-01-29T13:53:29.493255+0000","last_unstale":"2021-01-29T13:57:00.552366+0000","last_undegraded":"2021-01-29T13:57:00.552366+0000","last_fullsized":"2021-01-29T13:57:00.552366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:42.661371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:42.661371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"120'671","reported_seq":"1016","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:05.597246+0000","last_change":"2021-01-29T13:56:47.680232+0000","last_active":"2021-01-29T13:57:05.597246+0000","last_peered":"2021-01-29T13:57:05.597246+0000","last_clean":"2021-01-29T13:56:36.386610+0000","last_became_active":"2021-01-29T13:56:47.674484+0000","last_became_peered":"2021-01-29T13:56:47.674484+0000","last_unstale":"2021-01-29T13:57:05.597246+0000","last_undegraded":"2021-01-29T13:57:05.597246+0000","last_fullsized":"2021-01-29T13:57:05.597246+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'570","last_scrub_stamp":"2021-01-29T13:55:44.911108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:44.911108+0000","log_size":671,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2038945493,"num_objects":671,"num_object_clones":0,"num_object_copies":2684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":590,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":1991482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":601,"num_bytes_recovered":1847436236,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[6,2,4,7],"avail_no_missing":["6(0)","2(1)","4(2)","7(3)"],"object_location_counts":[{"shards":"2(1),4(2),6(0),7(3)","objects":671}],"blocked_by":[],"up_primary":0,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"142","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:01.550240+0000","last_change":"2021-01-29T13:57:01.550191+0000","last_active":"2021-01-29T13:57:01.550240+0000","last_peered":"2021-01-29T13:57:01.550240+0000","last_clean":"2021-01-29T13:57:01.550240+0000","last_became_active":"2021-01-29T13:52:23.765595+0000","last_became_peered":"2021-01-29T13:52:23.765595+0000","last_unstale":"2021-01-29T13:57:01.550240+0000","last_undegraded":"2021-01-29T13:57:01.550240+0000","last_fullsized":"2021-01-29T13:57:01.550240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:57:01.550087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.550087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"117'710","reported_seq":"880","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847676+0000","last_change":"2021-01-29T13:56:09.328006+0000","last_active":"2021-01-29T13:57:00.847676+0000","last_peered":"2021-01-29T13:57:00.847676+0000","last_clean":"2021-01-29T13:57:00.847676+0000","last_became_active":"2021-01-29T13:53:09.969063+0000","last_became_peered":"2021-01-29T13:53:09.969063+0000","last_unstale":"2021-01-29T13:57:00.847676+0000","last_undegraded":"2021-01-29T13:57:00.847676+0000","last_fullsized":"2021-01-29T13:57:00.847676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'710","last_scrub_stamp":"2021-01-29T13:56:09.327903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:56:09.327903+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2107977089,"num_objects":710,"num_object_clones":0,"num_object_copies":2840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":2058922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"155","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.849258+0000","last_change":"2021-01-29T13:56:59.467725+0000","last_active":"2021-01-29T13:57:00.849258+0000","last_peered":"2021-01-29T13:57:00.849258+0000","last_clean":"2021-01-29T13:57:00.849258+0000","last_became_active":"2021-01-29T13:52:24.188578+0000","last_became_peered":"2021-01-29T13:52:24.188578+0000","last_unstale":"2021-01-29T13:57:00.849258+0000","last_undegraded":"2021-01-29T13:57:00.849258+0000","last_fullsized":"2021-01-29T13:57:00.849258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:59.467654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:59.467654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"142'4","reported_seq":"152","reported_epoch":"142","state":"active+clean","last_fresh":"2021-01-29T13:57:01.982145+0000","last_change":"2021-01-29T13:57:01.982145+0000","last_active":"2021-01-29T13:57:01.982145+0000","last_peered":"2021-01-29T13:57:01.982145+0000","last_clean":"2021-01-29T13:57:01.982145+0000","last_became_active":"2021-01-29T13:52:20.655015+0000","last_became_peered":"2021-01-29T13:52:20.655015+0000","last_unstale":"2021-01-29T13:57:01.982145+0000","last_undegraded":"2021-01-29T13:57:01.982145+0000","last_fullsized":"2021-01-29T13:57:01.982145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'4","last_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_deep_scrub":"142'4","last_deep_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.982073+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"120'761","reported_seq":"2454","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:03.004043+0000","last_change":"2021-01-29T13:56:48.363777+0000","last_active":"2021-01-29T13:57:03.004043+0000","last_peered":"2021-01-29T13:57:03.004043+0000","last_clean":"2021-01-29T13:56:36.386422+0000","last_became_active":"2021-01-29T13:56:48.362095+0000","last_became_peered":"2021-01-29T13:56:48.362095+0000","last_unstale":"2021-01-29T13:57:03.004043+0000","last_undegraded":"2021-01-29T13:57:03.004043+0000","last_fullsized":"2021-01-29T13:57:03.004043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'761","last_scrub_stamp":"2021-01-29T13:55:53.981049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:53.981049+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244508217,"num_objects":761,"num_object_clones":0,"num_object_copies":3044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":637,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":2192275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":747,"num_bytes_recovered":2213000897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,0],"acting":[4,2,7,1],"avail_no_missing":["4(0)","1(3)","2(1)","7(2)"],"object_location_counts":[{"shards":"1(3),2(1),4(0),7(2)","objects":761}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"144","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.849237+0000","last_change":"2021-01-29T13:56:41.371116+0000","last_active":"2021-01-29T13:57:00.849237+0000","last_peered":"2021-01-29T13:57:00.849237+0000","last_clean":"2021-01-29T13:57:00.849237+0000","last_became_active":"2021-01-29T13:52:23.765671+0000","last_became_peered":"2021-01-29T13:52:23.765671+0000","last_unstale":"2021-01-29T13:57:00.849237+0000","last_undegraded":"2021-01-29T13:57:00.849237+0000","last_fullsized":"2021-01-29T13:57:00.849237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:41.371025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:41.371025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"118'720","reported_seq":"886","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.652827+0000","last_change":"2021-01-29T13:55:59.202455+0000","last_active":"2021-01-29T13:57:00.652827+0000","last_peered":"2021-01-29T13:57:00.652827+0000","last_clean":"2021-01-29T13:57:00.652827+0000","last_became_active":"2021-01-29T13:53:09.587252+0000","last_became_peered":"2021-01-29T13:53:09.587252+0000","last_unstale":"2021-01-29T13:57:00.652827+0000","last_undegraded":"2021-01-29T13:57:00.652827+0000","last_fullsized":"2021-01-29T13:57:00.652827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'720","last_scrub_stamp":"2021-01-29T13:55:59.202349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:59.202349+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2156154079,"num_objects":720,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":2105989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"120'5986","reported_seq":"10252","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:05.668638+0000","last_change":"2021-01-29T13:56:47.680268+0000","last_active":"2021-01-29T13:57:05.668638+0000","last_peered":"2021-01-29T13:57:05.668638+0000","last_clean":"2021-01-29T13:56:36.386614+0000","last_became_active":"2021-01-29T13:56:47.673885+0000","last_became_peered":"2021-01-29T13:56:47.673885+0000","last_unstale":"2021-01-29T13:57:05.668638+0000","last_undegraded":"2021-01-29T13:57:05.668638+0000","last_fullsized":"2021-01-29T13:57:05.668638+0000","mapping_epoch":127,"log_start":"71'2904","ondisk_log_start":"71'2904","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'5955","last_scrub_stamp":"2021-01-29T13:55:51.275882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:51.275882+0000","log_size":3082,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2947693900,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":849,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2316,"num_read_kb":1158,"num_write":5435,"num_write_kb":1544566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1129,"num_bytes_recovered":1542062053,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2771,"num_flush":671,"num_flush_kb":1991482,"num_evict":178,"num_evict_kb":526959,"num_promote":1172,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[{"shards":"2,6","objects":985}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"157","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:01.451085+0000","last_change":"2021-01-29T13:57:01.451085+0000","last_active":"2021-01-29T13:57:01.451085+0000","last_peered":"2021-01-29T13:57:01.451085+0000","last_clean":"2021-01-29T13:57:01.451085+0000","last_became_active":"2021-01-29T13:53:09.377717+0000","last_became_peered":"2021-01-29T13:53:09.377717+0000","last_unstale":"2021-01-29T13:57:01.451085+0000","last_undegraded":"2021-01-29T13:57:01.451085+0000","last_fullsized":"2021-01-29T13:57:01.451085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:33.131622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:33.131622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"140","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847720+0000","last_change":"2021-01-29T13:56:53.807344+0000","last_active":"2021-01-29T13:57:00.847720+0000","last_peered":"2021-01-29T13:57:00.847720+0000","last_clean":"2021-01-29T13:57:00.847720+0000","last_became_active":"2021-01-29T13:52:40.828334+0000","last_became_peered":"2021-01-29T13:52:40.828334+0000","last_unstale":"2021-01-29T13:57:00.847720+0000","last_undegraded":"2021-01-29T13:57:00.847720+0000","last_fullsized":"2021-01-29T13:57:00.847720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:53.807251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:53.807251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"117'6273","reported_seq":"8319","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.552349+0000","last_change":"2021-01-29T13:55:55.445357+0000","last_active":"2021-01-29T13:57:00.552349+0000","last_peered":"2021-01-29T13:57:00.552349+0000","last_clean":"2021-01-29T13:57:00.552349+0000","last_became_active":"2021-01-29T13:53:09.369472+0000","last_became_peered":"2021-01-29T13:53:09.369472+0000","last_unstale":"2021-01-29T13:57:00.552349+0000","last_undegraded":"2021-01-29T13:57:00.552349+0000","last_fullsized":"2021-01-29T13:57:00.552349+0000","mapping_epoch":42,"log_start":"71'3203","ondisk_log_start":"71'3203","created":26,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6273","last_scrub_stamp":"2021-01-29T13:55:55.445229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.445229+0000","log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2935339657,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":2414,"num_read_kb":1208,"num_write":5647,"num_write_kb":1593121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3044,"num_flush":710,"num_flush_kb":2058922,"num_evict":219,"num_evict_kb":640347,"num_promote":1206,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"24","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.611252+0000","last_change":"2021-01-29T13:56:46.442031+0000","last_active":"2021-01-29T13:57:00.611252+0000","last_peered":"2021-01-29T13:57:00.611252+0000","last_clean":"2021-01-29T13:57:00.611252+0000","last_became_active":"2021-01-29T13:56:46.441589+0000","last_became_peered":"2021-01-29T13:56:46.441589+0000","last_unstale":"2021-01-29T13:57:00.611252+0000","last_undegraded":"2021-01-29T13:57:00.611252+0000","last_fullsized":"2021-01-29T13:57:00.611252+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:55.134762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.134762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"118'6270","reported_seq":"8351","reported_epoch":"142","state":"active+clean","last_fresh":"2021-01-29T13:57:04.235378+0000","last_change":"2021-01-29T13:57:04.235378+0000","last_active":"2021-01-29T13:57:04.235378+0000","last_peered":"2021-01-29T13:57:04.235378+0000","last_clean":"2021-01-29T13:57:04.235378+0000","last_became_active":"2021-01-29T13:52:39.823642+0000","last_became_peered":"2021-01-29T13:52:39.823642+0000","last_unstale":"2021-01-29T13:57:04.235378+0000","last_undegraded":"2021-01-29T13:57:04.235378+0000","last_fullsized":"2021-01-29T13:57:04.235378+0000","mapping_epoch":26,"log_start":"71'3205","ondisk_log_start":"71'3205","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'6270","last_scrub_stamp":"2021-01-29T13:57:04.235268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:57:04.235268+0000","log_size":3065,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2946120877,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2420,"num_read_kb":1212,"num_write":5684,"num_write_kb":1601214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3066,"num_flush":720,"num_flush_kb":2105989,"num_evict":218,"num_evict_kb":643724,"num_promote":1208,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":11757536726,"num_objects":3958,"num_object_clones":0,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":849,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":22645,"num_write_kb":6378542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1129,"num_bytes_recovered":1542062053,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11918577664,"data_stored":11828415316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12263,"ondisk_log_size":12263,"up":8,"acting":8,"num_store_stats":6},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":8547584878,"num_objects":2862,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1227,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":8348668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1348,"num_bytes_recovered":4060437133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13299490816,"data_stored":18228555776,"data_compressed":505072361,"data_compressed_allocated":4929064960,"data_compressed_original":9858129920,"omap_allocated":0,"internal_metadata":0},"log_size":2862,"ondisk_log_size":2862,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":124,"seq":532575944712,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942776,"kb_used_data":1921328,"kb_used_omap":0,"kb_used_meta":21439,"kb_avail":92429064,"statfs":{"total":96636764160,"available":94647361536,"internally_reserved":0,"allocated":1967439872,"data_stored":2257930354,"data_compressed":30754208,"data_compressed_allocated":299577344,"data_compressed_original":599154688,"omap_allocated":972,"internal_metadata":21953588},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2311348,"kb_used_data":2281004,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":92060492,"statfs":{"total":96636764160,"available":94269943808,"internally_reserved":0,"allocated":2335748096,"data_stored":3200465622,"data_compressed":88587048,"data_compressed_allocated":865042432,"data_compressed_original":1730084864,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:26 2021","interfaces":[{"interface":"back","average":{"1min":51.597999999999999,"5min":29.779,"15min":26.143000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":906.00800000000004,"5min":906.00800000000004,"15min":906.00800000000004},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":0.95499999999999996,"15min":0.93000000000000005},"min":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":1.3089999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.3340000000000001,"15min":1.49},"min":{"1min":0.65800000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4410000000000001,"5min":11.195,"15min":11.195},"last":1.272},{"interface":"front","average":{"1min":1.006,"5min":23.977,"15min":32.523000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3759999999999999,"5min":777.02499999999998,"15min":777.02499999999998},"last":1.581}]},{"osd":2,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":46.633000000000003,"5min":10.444000000000001,"15min":4.5460000000000003},"min":{"1min":0.62,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":512.423,"5min":512.423,"15min":512.423},"last":0.999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":2.1200000000000001,"15min":1.774},"min":{"1min":0.79300000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.472,"5min":60.529000000000003,"15min":60.529000000000003},"last":1.3759999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":10.481,"5min":3.0230000000000001,"15min":1.746},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":211.47900000000001,"5min":211.47900000000001,"15min":211.47900000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.46,"15min":1.607},"min":{"1min":0.92300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4930000000000001,"5min":11.146000000000001,"15min":11.146000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:56:16 2021","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.264,"15min":1.3380000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4299999999999999,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":1.343},{"interface":"front","average":{"1min":1.0229999999999999,"5min":14.401999999999999,"15min":20.280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4399999999999999,"5min":391.66699999999997,"15min":391.66699999999997},"last":1.54}]},{"osd":5,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":3.4470000000000001,"15min":2.2829999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.601,"5min":175.83199999999999,"15min":175.83199999999999},"last":1.625},{"interface":"front","average":{"1min":1.105,"5min":1.2549999999999999,"15min":1.2},"min":{"1min":0.77600000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.526,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":1.6020000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.5649999999999999,"15min":1.536},"min":{"1min":0.84199999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.5269999999999999,"5min":10.063000000000001,"15min":10.063000000000001},"last":1.647},{"interface":"front","average":{"1min":1.123,"5min":14.808,"15min":27.946000000000002},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4690000000000001,"5min":623.01999999999998,"15min":623.01999999999998},"last":1.754}]}]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5736668,"kb_used_data":5682580,"kb_used_omap":0,"kb_used_meta":54080,"kb_avail":88635172,"statfs":{"total":96636764160,"available":90762416128,"internally_reserved":0,"allocated":5818961920,"data_stored":6956451332,"data_compressed":118712623,"data_compressed_allocated":1158184960,"data_compressed_original":2316369920,"omap_allocated":0,"internal_metadata":55377920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":29.140000000000001,"15min":33.799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.012,"5min":565.52099999999996,"15min":565.52099999999996},"last":0.997},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.0209999999999999,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":40.582999999999998,"5min":17.475000000000001,"15min":6.4610000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":676.39099999999996,"5min":721.11000000000001,"15min":721.11000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":21.452999999999999,"15min":7.8179999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1479999999999999,"5min":1000.376,"15min":1000.376},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":51.539000000000001,"5min":11.381,"15min":4.3440000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":501.61200000000002,"5min":501.61200000000002,"15min":501.61200000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.0640000000000001},"min":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6839999999999999,"5min":6.1870000000000003,"15min":6.1870000000000003},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jan 29 13:56:15 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.478,"15min":1.53},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6719999999999999,"5min":3.694,"15min":3.694},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.407,"15min":1.3859999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.7509999999999999,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.6479999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":21.327999999999999,"5min":5.8109999999999999,"15min":2.7749999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":183.761,"5min":183.761,"15min":183.761},"last":0.86199999999999999},{"interface":"front","average":{"1min":41.545999999999999,"5min":9.516,"15min":4.0499999999999998},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":521.02499999999998,"5min":521.02499999999998,"15min":521.02499999999998},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.3720000000000001,"15min":1.3009999999999999},"min":{"1min":0.89900000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.474,"5min":3.46,"15min":3.46},"last":1.544},{"interface":"front","average":{"1min":1.111,"5min":1.4450000000000001,"15min":1.2809999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":8.5039999999999996,"15min":3.754},"min":{"1min":0.99099999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.7050000000000001,"5min":591.18899999999996,"15min":591.18899999999996},"last":1.5820000000000001},{"interface":"front","average":{"1min":52.493000000000002,"5min":11.779999999999999,"15min":4.8220000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":923.40099999999995,"5min":923.40099999999995,"15min":923.40099999999995},"last":0.95499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2154844,"kb_used_data":2115092,"kb_used_omap":0,"kb_used_meta":39744,"kb_avail":92216996,"statfs":{"total":96636764160,"available":94430203904,"internally_reserved":0,"allocated":2165854208,"data_stored":2457969146,"data_compressed":31021897,"data_compressed_allocated":302632960,"data_compressed_original":605265920,"omap_allocated":0,"internal_metadata":40697856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:25 2021","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.0349999999999999,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":5.0629999999999997},"last":0.92400000000000004},{"interface":"front","average":{"1min":39.090000000000003,"5min":8.5060000000000002,"15min":3.4079999999999999},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":752.73400000000004,"5min":752.73400000000004,"15min":752.73400000000004},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":22.648,"15min":29.776},"min":{"1min":0.55100000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.2629999999999999,"5min":832.21600000000001,"15min":832.21600000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":5.2699999999999996,"5min":11.266,"15min":4.4199999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":84.277000000000001,"5min":899.43399999999997,"15min":899.43399999999997},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.306,"15min":1.099},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1499999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":5.548,"15min":9.8919999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5489999999999999,"5min":244.60900000000001,"15min":244.60900000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Jan 29 13:56:15 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.4610000000000001,"15min":1.633},"min":{"1min":0.63800000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5960000000000001,"5min":5.242,"15min":5.242},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.9259999999999999,"15min":2.1680000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.5760000000000001,"5min":6.2590000000000003,"15min":6.2590000000000003},"last":1.024}]},{"osd":5,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":14.667999999999999,"15min":5.694},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0350000000000001,"5min":701.73400000000004,"15min":701.73400000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.3400000000000001,"15min":1.26},"min":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.917,"5min":5.758,"15min":5.758},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.4419999999999999,"15min":1.3440000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9139999999999999,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.258,"5min":4.0110000000000001,"15min":6.2149999999999999},"min":{"1min":0.72299999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.6230000000000002,"5min":132.35300000000001,"15min":132.35300000000001},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":37.829999999999998,"5min":8.8330000000000002,"15min":3.823},"min":{"1min":0.81299999999999994,"5min":0.752,"15min":0.752},"max":{"1min":696.96400000000006,"5min":696.96400000000006,"15min":696.96400000000006},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.4990000000000001,"15min":1.413},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.0369999999999999,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.85199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3443244,"kb_used_data":3391652,"kb_used_omap":0,"kb_used_meta":51584,"kb_avail":90928596,"statfs":{"total":96636764160,"available":93110882304,"internally_reserved":0,"allocated":3473051648,"data_stored":3742620723,"data_compressed":29735076,"data_compressed_allocated":290086912,"data_compressed_original":580173824,"omap_allocated":0,"internal_metadata":52822016},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:26 2021","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.93999999999999995,"15min":0.90400000000000003},"min":{"1min":0.67500000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.135,"5min":3.3719999999999999,"15min":3.7450000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.9620000000000002,"5min":60.329000000000001,"15min":60.329000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.97599999999999998,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":10.324,"15min":4.0970000000000004},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0629999999999999,"5min":977.78200000000004,"15min":977.78200000000004},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.22,"5min":5.7539999999999996,"15min":5.7539999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.383,"15min":1.4339999999999999},"min":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4870000000000001,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Jan 29 13:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":11.106,"15min":4.5620000000000003},"min":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3979999999999999,"5min":916.09500000000003,"15min":916.09500000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1479999999999999,"5min":11.696999999999999,"15min":4.8819999999999997},"min":{"1min":0.82099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.593,"5min":977.91499999999996,"15min":977.91499999999996},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":6.9089999999999998,"15min":3.1429999999999998},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8160000000000001,"5min":503.93000000000001,"15min":503.93000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.077,"5min":6.79,"15min":3.0230000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.3799999999999999,"5min":503.74299999999999,"15min":503.74299999999999},"last":1.141}]},{"osd":6,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.4490000000000001,"15min":1.351},"min":{"1min":0.874,"5min":0.751,"15min":0.751},"max":{"1min":3.2930000000000001,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.339,"5min":19.396999999999998,"15min":37.238999999999997},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":3.3690000000000002,"5min":851.89099999999996,"15min":851.89099999999996},"last":1.173}]},{"osd":7,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5609999999999999,"15min":1.5069999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.613,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.8300000000000001,"15min":1.966},"min":{"1min":1.0629999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.635,"5min":15.597,"15min":15.597},"last":1.038}]}]},{"osd":4,"up_from":42,"seq":180388626482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4411588,"kb_used_data":4363992,"kb_used_omap":0,"kb_used_meta":47423,"kb_avail":89960252,"statfs":{"total":96636764160,"available":92119298048,"internally_reserved":0,"allocated":4468727808,"data_stored":5613881037,"data_compressed":118370768,"data_compressed_allocated":1155686400,"data_compressed_original":2311372800,"omap_allocated":972,"internal_metadata":48561204},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:12 2021","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.2450000000000001,"5min":4.2450000000000001,"15min":4.2450000000000001},"last":0.746},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":4.1589999999999998,"5min":4.1589999999999998,"15min":4.1589999999999998},"last":1.141}]},{"osd":1,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":43.862000000000002,"15min":62.893000000000001},"min":{"1min":0.76800000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.6850000000000001,"5min":924.63300000000004,"15min":924.63300000000004},"last":1.008},{"interface":"front","average":{"1min":74.046000000000006,"5min":15.648,"15min":5.9059999999999997},"min":{"1min":0.84299999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":898.86900000000003,"5min":898.86900000000003,"15min":898.86900000000003},"last":1.2090000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":11.952,"15min":4.7160000000000002},"min":{"1min":0.745,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3149999999999999,"5min":857.78899999999999,"15min":857.78899999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":44.206000000000003,"5min":9.843,"15min":4.0510000000000002},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":779.38400000000001,"5min":779.38400000000001,"15min":779.38400000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":12.48,"15min":14.343},"min":{"1min":0.754,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.738,"5min":311.68299999999999,"15min":311.68299999999999},"last":1.079},{"interface":"front","average":{"1min":1.028,"5min":1.236,"15min":1.264},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.4359999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":3.7309999999999999,"15min":1.964},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5109999999999999,"5min":239.99199999999999,"15min":239.99199999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.171,"15min":1.1599999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.03}]},{"osd":6,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.238,"15min":1.206},"min":{"1min":0.72499999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.7789999999999999,"5min":5.5890000000000004,"15min":5.5890000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.252,"15min":1.296},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.657,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3,"15min":1.286},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.988,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":0.96099999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.635,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.357}]}]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765812,"kb_used_data":751852,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":93606028,"statfs":{"total":96636764160,"available":95852572672,"internally_reserved":0,"allocated":769896448,"data_stored":1055801421,"data_compressed":29380114,"data_compressed_allocated":286253056,"data_compressed_original":572506112,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.83999999999999997,"15min":0.81299999999999994},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.079},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.101,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":4.8410000000000002,"5min":4.8410000000000002,"15min":4.8410000000000002},"last":1.306}]},{"osd":1,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.93600000000000005,"15min":0.85999999999999999},"min":{"1min":0.68500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":2.3690000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":51.244999999999997,"5min":11.042999999999999,"15min":4.2709999999999999},"min":{"1min":0.82999999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":732.80700000000002,"5min":732.80700000000002,"15min":732.80700000000002},"last":1.365}]},{"osd":2,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":8.1699999999999999,"15min":3.548},"min":{"1min":0.73599999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.161,"5min":649.82899999999995,"15min":649.82899999999995},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.1180000000000001,"15min":1.054},"min":{"1min":0.70699999999999996,"5min":0.623,"15min":0.623},"max":{"1min":2.4169999999999998,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.145}]},{"osd":3,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.137,"15min":1.133},"min":{"1min":0.626,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2829999999999999,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.274,"15min":1.23},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.1200000000000001,"5min":4.827,"15min":4.827},"last":1.7350000000000001}]},{"osd":4,"last update":"Fri Jan 29 13:56:17 2021","interfaces":[{"interface":"back","average":{"1min":28.036000000000001,"5min":16.495999999999999,"15min":17.274999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":514.74199999999996,"5min":514.74199999999996,"15min":514.74199999999996},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2430000000000001,"15min":1.204},"min":{"1min":0.86699999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.266,"5min":4.4359999999999999,"15min":4.4359999999999999},"last":1.7689999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":9.5289999999999999,"15min":4.0229999999999997},"min":{"1min":0.81499999999999995,"5min":0.622,"15min":0.622},"max":{"1min":2.3039999999999998,"5min":520.71799999999996,"15min":520.71799999999996},"last":1.804},{"interface":"front","average":{"1min":1.345,"5min":1.421,"15min":1.256},"min":{"1min":0.84399999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3929999999999998,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":1.8320000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.92700000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3420000000000001,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.7270000000000001,"15min":1.7849999999999999},"min":{"1min":1.0049999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3319999999999999,"5min":9.593,"15min":9.593},"last":1.96}]}]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4180688,"kb_used_data":4117640,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":90191152,"statfs":{"total":96636764160,"available":92355739648,"internally_reserved":0,"allocated":4216463360,"data_stored":4766148518,"data_compressed":58393750,"data_compressed_allocated":570441728,"data_compressed_original":1140883456,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:20 2021","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.379,"15min":1.381},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.0899999999999999,"5min":5.8380000000000001,"15min":5.8380000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.012,"15min":0.96599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.3810000000000002,"5min":7.3810000000000002,"15min":7.3810000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":15.146000000000001,"15min":29.238},"min":{"1min":0.65400000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.353,"5min":684.42700000000002,"15min":684.42700000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.2849999999999999,"15min":1.1699999999999999},"min":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.306,"5min":6.1360000000000001,"15min":6.1360000000000001},"last":0.755}]},{"osd":2,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1919999999999999,"15min":1.242},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.492,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":1.133},{"interface":"front","average":{"1min":36.773000000000003,"5min":8.3480000000000008,"15min":3.6339999999999999},"min":{"1min":0.68799999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":607.71000000000004,"5min":607.71000000000004,"15min":607.71000000000004},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.345,"15min":1.2470000000000001},"min":{"1min":0.66800000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1779999999999999,"5min":6.048,"15min":6.048},"last":200.50399999999999},{"interface":"front","average":{"1min":29.335999999999999,"5min":6.8609999999999998,"15min":3.0449999999999999},"min":{"1min":0.83699999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":480.87299999999999,"5min":480.87299999999999,"15min":480.87299999999999},"last":1.21}]},{"osd":4,"last update":"Fri Jan 29 13:56:12 2021","interfaces":[{"interface":"back","average":{"1min":17.359999999999999,"5min":4.6619999999999999,"15min":2.456},"min":{"1min":0.629,"5min":0.62,"15min":0.62},"max":{"1min":263.584,"5min":263.584,"15min":263.584},"last":1.173},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.3069999999999999,"15min":1.417},"min":{"1min":0.78900000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.474,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2969999999999999,"15min":1.349},"min":{"1min":0.86499999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.496,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":1.034},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.6100000000000001,"15min":1.506},"min":{"1min":0.96499999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3759999999999999,"5min":7.3140000000000001,"15min":7.3140000000000001},"last":1.052}]},{"osd":7,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.4159999999999999,"15min":1.3380000000000001},"min":{"1min":0.90100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.655,"5min":10.795,"15min":10.795},"last":1.375},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.85899999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.609,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":0.99299999999999999}]}]}]}} , 2021-01-29T13:57:11.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T13:57:11.716 INFO:teuthology.orchestra.run.smithi183.stdout: Ignoring malparsed backtrace: 2021-01-29T13:57:44.175 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2021-01-29T13:57:42.675417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20305121604,"num_objects":6822,"num_object_clones":0,"num_object_copies":19368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":632,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":25509,"num_write_kb":14727220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3207,"num_bytes_recovered":7385874976,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15129,"ondisk_log_size":15129,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":25551644,"kb_used_data":25207644,"kb_used_omap":1,"kb_used_meta":343934,"kb_avail":729423076,"statfs":{"total":773094113280,"available":746929229824,"internally_reserved":0,"allocated":25812627456,"data_stored":30826570098,"data_compressed":523387886,"data_compressed_allocated":5107855360,"data_compressed_original":10215710720,"omap_allocated":1944,"internal_metadata":352188520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-252,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":339084355,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.225468"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"156","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458800+0000","last_change":"2021-01-29T13:57:34.166076+0000","last_active":"2021-01-29T13:57:37.458800+0000","last_peered":"2021-01-29T13:57:37.458800+0000","last_clean":"2021-01-29T13:57:37.458800+0000","last_became_active":"2021-01-29T13:52:24.188931+0000","last_became_peered":"2021-01-29T13:52:24.188931+0000","last_unstale":"2021-01-29T13:57:37.458800+0000","last_undegraded":"2021-01-29T13:57:37.458800+0000","last_fullsized":"2021-01-29T13:57:37.458800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:57.162808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:57.162808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"120'6449","reported_seq":"8600","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.461338+0000","last_change":"2021-01-29T13:55:45.625490+0000","last_active":"2021-01-29T13:57:37.461338+0000","last_peered":"2021-01-29T13:57:37.461338+0000","last_clean":"2021-01-29T13:57:37.461338+0000","last_became_active":"2021-01-29T13:52:39.830011+0000","last_became_peered":"2021-01-29T13:52:39.830011+0000","last_unstale":"2021-01-29T13:57:37.461338+0000","last_undegraded":"2021-01-29T13:57:37.461338+0000","last_fullsized":"2021-01-29T13:57:37.461338+0000","mapping_epoch":26,"log_start":"72'3403","ondisk_log_start":"72'3403","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6250","last_scrub_stamp":"2021-01-29T13:55:45.625379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:45.625379+0000","log_size":3046,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2928382292,"num_objects":986,"num_object_clones":0,"num_object_copies":1972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2501,"num_read_kb":1252,"num_write":5879,"num_write_kb":1639641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3315,"num_flush":761,"num_flush_kb":2192275,"num_evict":269,"num_evict_kb":760560,"num_promote":1249,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"117","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.497927+0000","last_change":"2021-01-29T13:55:42.661441+0000","last_active":"2021-01-29T13:57:37.497927+0000","last_peered":"2021-01-29T13:57:37.497927+0000","last_clean":"2021-01-29T13:57:37.497927+0000","last_became_active":"2021-01-29T13:53:29.493255+0000","last_became_peered":"2021-01-29T13:53:29.493255+0000","last_unstale":"2021-01-29T13:57:37.497927+0000","last_undegraded":"2021-01-29T13:57:37.497927+0000","last_fullsized":"2021-01-29T13:57:37.497927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:42.661371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:42.661371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"120'671","reported_seq":"1393","reported_epoch":"147","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:40.662249+0000","last_change":"2021-01-29T13:56:47.680232+0000","last_active":"2021-01-29T13:57:40.662249+0000","last_peered":"2021-01-29T13:57:40.662249+0000","last_clean":"2021-01-29T13:56:36.386610+0000","last_became_active":"2021-01-29T13:56:47.674484+0000","last_became_peered":"2021-01-29T13:56:47.674484+0000","last_unstale":"2021-01-29T13:57:40.662249+0000","last_undegraded":"2021-01-29T13:57:40.662249+0000","last_fullsized":"2021-01-29T13:57:40.662249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'570","last_scrub_stamp":"2021-01-29T13:55:44.911108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:44.911108+0000","log_size":671,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2038945493,"num_objects":671,"num_object_clones":0,"num_object_copies":2684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":404,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":1991482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":787,"num_bytes_recovered":2413500764,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[6,2,4,7],"avail_no_missing":["6(0)","2(1)","4(2)","7(3)"],"object_location_counts":[{"shards":"2(1),4(2),6(0),7(3)","objects":671}],"blocked_by":[],"up_primary":0,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"147","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.457918+0000","last_change":"2021-01-29T13:57:01.550191+0000","last_active":"2021-01-29T13:57:37.457918+0000","last_peered":"2021-01-29T13:57:37.457918+0000","last_clean":"2021-01-29T13:57:37.457918+0000","last_became_active":"2021-01-29T13:52:23.765595+0000","last_became_peered":"2021-01-29T13:52:23.765595+0000","last_unstale":"2021-01-29T13:57:37.457918+0000","last_undegraded":"2021-01-29T13:57:37.457918+0000","last_fullsized":"2021-01-29T13:57:37.457918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:57:01.550087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.550087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"117'710","reported_seq":"887","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458693+0000","last_change":"2021-01-29T13:57:37.153012+0000","last_active":"2021-01-29T13:57:37.458693+0000","last_peered":"2021-01-29T13:57:37.458693+0000","last_clean":"2021-01-29T13:57:37.458693+0000","last_became_active":"2021-01-29T13:53:09.969063+0000","last_became_peered":"2021-01-29T13:53:09.969063+0000","last_unstale":"2021-01-29T13:57:37.458693+0000","last_undegraded":"2021-01-29T13:57:37.458693+0000","last_fullsized":"2021-01-29T13:57:37.458693+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'710","last_scrub_stamp":"2021-01-29T13:56:09.327903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:56:09.327903+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2107977089,"num_objects":710,"num_object_clones":0,"num_object_copies":2840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":2058922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"159","reported_epoch":"145","state":"active+clean","last_fresh":"2021-01-29T13:57:36.794315+0000","last_change":"2021-01-29T13:56:59.467725+0000","last_active":"2021-01-29T13:57:36.794315+0000","last_peered":"2021-01-29T13:57:36.794315+0000","last_clean":"2021-01-29T13:57:36.794315+0000","last_became_active":"2021-01-29T13:52:24.188578+0000","last_became_peered":"2021-01-29T13:52:24.188578+0000","last_unstale":"2021-01-29T13:57:36.794315+0000","last_undegraded":"2021-01-29T13:57:36.794315+0000","last_fullsized":"2021-01-29T13:57:36.794315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:59.467654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:59.467654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"142'4","reported_seq":"157","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458197+0000","last_change":"2021-01-29T13:57:01.982145+0000","last_active":"2021-01-29T13:57:37.458197+0000","last_peered":"2021-01-29T13:57:37.458197+0000","last_clean":"2021-01-29T13:57:37.458197+0000","last_became_active":"2021-01-29T13:52:20.655015+0000","last_became_peered":"2021-01-29T13:52:20.655015+0000","last_unstale":"2021-01-29T13:57:37.458197+0000","last_undegraded":"2021-01-29T13:57:37.458197+0000","last_fullsized":"2021-01-29T13:57:37.458197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'4","last_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_deep_scrub":"142'4","last_deep_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.982073+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"120'761","reported_seq":"3071","reported_epoch":"147","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:41.858978+0000","last_change":"2021-01-29T13:56:48.363777+0000","last_active":"2021-01-29T13:57:41.858978+0000","last_peered":"2021-01-29T13:57:41.858978+0000","last_clean":"2021-01-29T13:56:36.386422+0000","last_became_active":"2021-01-29T13:56:48.362095+0000","last_became_peered":"2021-01-29T13:56:48.362095+0000","last_unstale":"2021-01-29T13:57:41.858978+0000","last_undegraded":"2021-01-29T13:57:41.858978+0000","last_fullsized":"2021-01-29T13:57:41.858978+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'761","last_scrub_stamp":"2021-01-29T13:55:53.981049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:53.981049+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244508217,"num_objects":761,"num_object_clones":0,"num_object_copies":3044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":228,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":2192275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1053,"num_bytes_recovered":3106526858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,0],"acting":[4,2,7,1],"avail_no_missing":["4(0)","1(3)","2(1)","7(2)"],"object_location_counts":[{"shards":"1(3),2(1),4(0),7(2)","objects":761}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"148","reported_epoch":"145","state":"active+clean","last_fresh":"2021-01-29T13:57:36.794261+0000","last_change":"2021-01-29T13:56:41.371116+0000","last_active":"2021-01-29T13:57:36.794261+0000","last_peered":"2021-01-29T13:57:36.794261+0000","last_clean":"2021-01-29T13:57:36.794261+0000","last_became_active":"2021-01-29T13:52:23.765671+0000","last_became_peered":"2021-01-29T13:52:23.765671+0000","last_unstale":"2021-01-29T13:57:36.794261+0000","last_undegraded":"2021-01-29T13:57:36.794261+0000","last_fullsized":"2021-01-29T13:57:36.794261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:41.371025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:41.371025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"118'720","reported_seq":"891","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.461342+0000","last_change":"2021-01-29T13:55:59.202455+0000","last_active":"2021-01-29T13:57:37.461342+0000","last_peered":"2021-01-29T13:57:37.461342+0000","last_clean":"2021-01-29T13:57:37.461342+0000","last_became_active":"2021-01-29T13:53:09.587252+0000","last_became_peered":"2021-01-29T13:53:09.587252+0000","last_unstale":"2021-01-29T13:57:37.461342+0000","last_undegraded":"2021-01-29T13:57:37.461342+0000","last_fullsized":"2021-01-29T13:57:37.461342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'720","last_scrub_stamp":"2021-01-29T13:55:59.202349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:59.202349+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2156154079,"num_objects":720,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":2105989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"120'5986","reported_seq":"10744","reported_epoch":"147","state":"active+clean","last_fresh":"2021-01-29T13:57:38.478514+0000","last_change":"2021-01-29T13:57:38.478514+0000","last_active":"2021-01-29T13:57:38.478514+0000","last_peered":"2021-01-29T13:57:38.478514+0000","last_clean":"2021-01-29T13:57:38.478514+0000","last_became_active":"2021-01-29T13:57:38.475245+0000","last_became_peered":"2021-01-29T13:57:38.475245+0000","last_unstale":"2021-01-29T13:57:38.478514+0000","last_undegraded":"2021-01-29T13:57:38.478514+0000","last_fullsized":"2021-01-29T13:57:38.478514+0000","mapping_epoch":146,"log_start":"71'2904","ondisk_log_start":"71'2904","created":26,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'5955","last_scrub_stamp":"2021-01-29T13:55:51.275882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:51.275882+0000","log_size":3082,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2947693900,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2316,"num_read_kb":1158,"num_write":5435,"num_write_kb":1544566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1367,"num_bytes_recovered":1865847354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2771,"num_flush":671,"num_flush_kb":1991482,"num_evict":178,"num_evict_kb":526959,"num_promote":1172,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"171","reported_epoch":"147","state":"active+clean","last_fresh":"2021-01-29T13:57:39.387290+0000","last_change":"2021-01-29T13:57:39.387896+0000","last_active":"2021-01-29T13:57:39.387290+0000","last_peered":"2021-01-29T13:57:39.387290+0000","last_clean":"2021-01-29T13:57:39.387290+0000","last_became_active":"2021-01-29T13:53:09.377717+0000","last_became_peered":"2021-01-29T13:53:09.377717+0000","last_unstale":"2021-01-29T13:57:39.387290+0000","last_undegraded":"2021-01-29T13:57:39.387290+0000","last_fullsized":"2021-01-29T13:57:39.387290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:33.131622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:33.131622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"145","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458896+0000","last_change":"2021-01-29T13:56:53.807344+0000","last_active":"2021-01-29T13:57:37.458896+0000","last_peered":"2021-01-29T13:57:37.458896+0000","last_clean":"2021-01-29T13:57:37.458896+0000","last_became_active":"2021-01-29T13:52:40.828334+0000","last_became_peered":"2021-01-29T13:52:40.828334+0000","last_unstale":"2021-01-29T13:57:37.458896+0000","last_undegraded":"2021-01-29T13:57:37.458896+0000","last_fullsized":"2021-01-29T13:57:37.458896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:53.807251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:53.807251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"117'6273","reported_seq":"8324","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.497913+0000","last_change":"2021-01-29T13:55:55.445357+0000","last_active":"2021-01-29T13:57:37.497913+0000","last_peered":"2021-01-29T13:57:37.497913+0000","last_clean":"2021-01-29T13:57:37.497913+0000","last_became_active":"2021-01-29T13:53:09.369472+0000","last_became_peered":"2021-01-29T13:53:09.369472+0000","last_unstale":"2021-01-29T13:57:37.497913+0000","last_undegraded":"2021-01-29T13:57:37.497913+0000","last_fullsized":"2021-01-29T13:57:37.497913+0000","mapping_epoch":42,"log_start":"71'3203","ondisk_log_start":"71'3203","created":26,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6273","last_scrub_stamp":"2021-01-29T13:55:55.445229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.445229+0000","log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2935339657,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":2414,"num_read_kb":1208,"num_write":5647,"num_write_kb":1593121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3044,"num_flush":710,"num_flush_kb":2058922,"num_evict":219,"num_evict_kb":640347,"num_promote":1206,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"29","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.463934+0000","last_change":"2021-01-29T13:56:46.442031+0000","last_active":"2021-01-29T13:57:37.463934+0000","last_peered":"2021-01-29T13:57:37.463934+0000","last_clean":"2021-01-29T13:57:37.463934+0000","last_became_active":"2021-01-29T13:56:46.441589+0000","last_became_peered":"2021-01-29T13:56:46.441589+0000","last_unstale":"2021-01-29T13:57:37.463934+0000","last_undegraded":"2021-01-29T13:57:37.463934+0000","last_fullsized":"2021-01-29T13:57:37.463934+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:55.134762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.134762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"118'6270","reported_seq":"8356","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.464735+0000","last_change":"2021-01-29T13:57:04.235378+0000","last_active":"2021-01-29T13:57:37.464735+0000","last_peered":"2021-01-29T13:57:37.464735+0000","last_clean":"2021-01-29T13:57:37.464735+0000","last_became_active":"2021-01-29T13:52:39.823642+0000","last_became_peered":"2021-01-29T13:52:39.823642+0000","last_unstale":"2021-01-29T13:57:37.464735+0000","last_undegraded":"2021-01-29T13:57:37.464735+0000","last_fullsized":"2021-01-29T13:57:37.464735+0000","mapping_epoch":26,"log_start":"71'3205","ondisk_log_start":"71'3205","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'6270","last_scrub_stamp":"2021-01-29T13:57:04.235268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:57:04.235268+0000","log_size":3065,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2946120877,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2420,"num_read_kb":1212,"num_write":5684,"num_write_kb":1601214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3066,"num_flush":720,"num_flush_kb":2105989,"num_evict":218,"num_evict_kb":643724,"num_promote":1208,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":11757536726,"num_objects":3958,"num_object_clones":0,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":22645,"num_write_kb":6378542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1367,"num_bytes_recovered":1865847354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11983056896,"data_stored":11892361364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12263,"ondisk_log_size":12263,"up":8,"acting":8,"num_store_stats":6},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":8547584878,"num_objects":2862,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":632,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":8348668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1840,"num_bytes_recovered":5520027622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13793206272,"data_stored":18905419776,"data_compressed":523841489,"data_compressed_allocated":5112213504,"data_compressed_original":10224427008,"omap_allocated":0,"internal_metadata":0},"log_size":2862,"ondisk_log_size":2862,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":124,"seq":532575944719,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2622556,"kb_used_data":2579220,"kb_used_omap":0,"kb_used_meta":43327,"kb_avail":91749284,"statfs":{"total":96636764160,"available":93951266816,"internally_reserved":0,"allocated":2641121280,"data_stored":3110022318,"data_compressed":49186610,"data_compressed_allocated":479526912,"data_compressed_original":959053824,"omap_allocated":972,"internal_metadata":44366900},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0149999999999999}]},{"osd":2,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":7.8730000000000002,"5min":7.8730000000000002,"15min":7.8730000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":170.62200000000001,"5min":170.62200000000001,"15min":170.62200000000001},"last":170.62200000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.258}]},{"osd":4,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.056},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":6.9889999999999999,"5min":6.9889999999999999,"15min":6.9889999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":136.00800000000001,"5min":136.00800000000001,"15min":136.00800000000001},"last":1.294},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Jan 29 13:57:37 2021","interfaces":[{"interface":"back","average":{"1min":22.164000000000001,"5min":22.164000000000001,"15min":22.164000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":484.286,"5min":484.286,"15min":484.286},"last":1.1140000000000001},{"interface":"front","average":{"1min":24.145,"5min":24.145,"15min":24.145},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":529.46000000000004,"5min":529.46000000000004,"15min":529.46000000000004},"last":529.46000000000004}]},{"osd":7,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.349}]}]},{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2311472,"kb_used_data":2281064,"kb_used_omap":0,"kb_used_meta":30400,"kb_avail":92060368,"statfs":{"total":96636764160,"available":94269816832,"internally_reserved":0,"allocated":2335809536,"data_stored":3200494326,"data_compressed":88587048,"data_compressed_allocated":865042432,"data_compressed_original":1730084864,"omap_allocated":0,"internal_metadata":31129600},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.004}]},{"osd":1,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.242,"15min":1.46},"min":{"1min":0.64900000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.671,"5min":11.195,"15min":11.195},"last":0.91200000000000003},{"interface":"front","average":{"1min":50.901000000000003,"5min":26.797999999999998,"15min":33.463000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":951.06700000000001,"5min":951.06700000000001,"15min":951.06700000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":10.314,"15min":4.5030000000000001},"min":{"1min":0.72099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.147,"5min":512.423,"15min":512.423},"last":0.73799999999999999},{"interface":"front","average":{"1min":27.712,"5min":7.3419999999999996,"15min":3.5150000000000001},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":505.935,"5min":505.935,"15min":505.935},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":52.369999999999997,"5min":13.276,"15min":5.1639999999999997},"min":{"1min":0.749,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":977.31200000000001,"5min":977.31200000000001,"15min":977.31200000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.381,"15min":1.581},"min":{"1min":1.006,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7789999999999999,"5min":11.146000000000001,"15min":11.146000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:17 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.254,"15min":1.3340000000000001},"min":{"1min":0.79900000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7450000000000001,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":16.503,"5min":13.058,"15min":19.832000000000001},"min":{"1min":0.79700000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":309.072,"5min":391.66699999999997,"15min":391.66699999999997},"last":0.98199999999999998}]},{"osd":5,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":3.3260000000000001,"15min":2.242},"min":{"1min":0.76700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.625,"5min":175.83199999999999,"15min":175.83199999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.294,"15min":1.2130000000000001},"min":{"1min":0.97099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8120000000000001,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":1.3260000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.552,"15min":1.532},"min":{"1min":1.119,"5min":0.754,"15min":0.754},"max":{"1min":1.881,"5min":10.063000000000001,"15min":10.063000000000001},"last":1.345},{"interface":"front","average":{"1min":8.1750000000000007,"5min":9.5399999999999991,"15min":26.190000000000001},"min":{"1min":0.95299999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":132.83500000000001,"5min":623.01999999999998,"15min":623.01999999999998},"last":1.278}]}]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5660992,"kb_used_data":5606840,"kb_used_omap":0,"kb_used_meta":54144,"kb_avail":88710848,"statfs":{"total":96636764160,"available":90839908352,"internally_reserved":0,"allocated":5741404160,"data_stored":6879489840,"data_compressed":118712623,"data_compressed_allocated":1158184960,"data_compressed_original":2316369920,"omap_allocated":0,"internal_metadata":55443456},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.94299999999999995}]},{"osd":1,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":17.460000000000001,"15min":6.4560000000000004},"min":{"1min":0.63200000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.3999999999999999,"5min":721.11000000000001,"15min":721.11000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":21.443999999999999,"15min":7.8150000000000004},"min":{"1min":0.71899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3460000000000001,"5min":1000.376,"15min":1000.376},"last":0.96999999999999997}]},{"osd":3,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":11.378,"15min":4.343},"min":{"1min":0.60299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":501.61200000000002,"15min":501.61200000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.1819999999999999,"15min":1.0620000000000001},"min":{"1min":0.65900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":6.1870000000000003,"15min":6.1870000000000003},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.4099999999999999,"15min":1.5069999999999999},"min":{"1min":0.72699999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6160000000000001,"5min":3.694,"15min":3.694},"last":1.1850000000000001},{"interface":"front","average":{"1min":77.519000000000005,"5min":16.635999999999999,"15min":6.4619999999999997},"min":{"1min":0.96199999999999997,"5min":0.871,"15min":0.871},"max":{"1min":874.88400000000001,"5min":874.88400000000001,"15min":874.88400000000001},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":5.7699999999999996,"15min":2.762},"min":{"1min":0.79800000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.349,"5min":183.761,"15min":183.761},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":9.484,"15min":4.0389999999999997},"min":{"1min":0.88400000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.5469999999999999,"5min":521.02499999999998,"15min":521.02499999999998},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.359,"15min":1.2969999999999999},"min":{"1min":0.93500000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.544,"5min":3.46,"15min":3.46},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.4319999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4590000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":22.652000000000001,"5min":12.759,"15min":5.1719999999999997},"min":{"1min":0.98399999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":427.892,"5min":591.18899999999996,"15min":591.18899999999996},"last":1.226},{"interface":"front","average":{"1min":1.26,"5min":11.763999999999999,"15min":4.8159999999999998},"min":{"1min":0.95499999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.738,"5min":923.40099999999995,"15min":923.40099999999995},"last":1.103}]}]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2154968,"kb_used_data":2115152,"kb_used_omap":0,"kb_used_meta":39808,"kb_avail":92216872,"statfs":{"total":96636764160,"available":94430076928,"internally_reserved":0,"allocated":2165915648,"data_stored":2457997850,"data_compressed":31021897,"data_compressed_allocated":302632960,"data_compressed_original":605265920,"omap_allocated":0,"internal_metadata":40763392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:25 2021","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.0349999999999999,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":5.0629999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":39.090000000000003,"5min":8.5060000000000002,"15min":3.4079999999999999},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":752.73400000000004,"5min":752.73400000000004,"15min":752.73400000000004},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":16.138999999999999,"15min":27.606000000000002},"min":{"1min":0.57199999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":832.21600000000001,"15min":832.21600000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":11.237,"15min":4.4100000000000001},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1870000000000001,"5min":899.43399999999997,"15min":899.43399999999997},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.296,"15min":1.0960000000000001},"min":{"1min":0.63300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3169999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.876},{"interface":"front","average":{"1min":0.84299999999999997,"5min":3.3029999999999999,"15min":9.1440000000000001},"min":{"1min":0.55100000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1220000000000001,"5min":244.60900000000001,"15min":244.60900000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.325,"15min":1.5880000000000001},"min":{"1min":0.71399999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.254,"5min":5.242,"15min":5.242},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.6839999999999999,"15min":2.0870000000000002},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2310000000000001,"5min":6.2590000000000003,"15min":6.2590000000000003},"last":1.165}]},{"osd":5,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":14.631,"15min":5.681},"min":{"1min":0.68300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3440000000000001,"5min":701.73400000000004,"15min":701.73400000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.302,"15min":1.248},"min":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.359,"5min":5.758,"15min":5.758},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":48.951999999999998,"5min":10.974,"15min":4.5209999999999999},"min":{"1min":0.89800000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":862.01999999999998,"5min":862.01999999999998,"15min":862.01999999999998},"last":1.046},{"interface":"front","average":{"1min":1.1659999999999999,"5min":2.7810000000000001,"15min":5.8049999999999997},"min":{"1min":0.83799999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4790000000000001,"5min":132.35300000000001,"15min":132.35300000000001},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":45.155999999999999,"5min":17.600000000000001,"15min":6.7450000000000001},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":749.81700000000001,"5min":749.81700000000001,"15min":749.81700000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.4530000000000001,"15min":1.3979999999999999},"min":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4790000000000001,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":1.216}]}]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3443368,"kb_used_data":3391712,"kb_used_omap":0,"kb_used_meta":51648,"kb_avail":90928472,"statfs":{"total":96636764160,"available":93110755328,"internally_reserved":0,"allocated":3473113088,"data_stored":3742649427,"data_compressed":29735076,"data_compressed_allocated":290086912,"data_compressed_original":580173824,"omap_allocated":0,"internal_metadata":52887552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":29.826000000000001,"5min":29.826000000000001,"15min":29.826000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":301.69099999999997,"5min":301.69099999999997,"15min":301.69099999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96599999999999997,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1339999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":10.300000000000001,"15min":4.0890000000000004},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":977.78200000000004,"15min":977.78200000000004},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.181,"15min":1.079},"min":{"1min":0.65700000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3919999999999999,"5min":5.7539999999999996,"15min":5.7539999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3009999999999999,"15min":1.407},"min":{"1min":0.82999999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2190000000000001,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":11.065,"15min":4.5490000000000004},"min":{"1min":0.71099999999999997,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4890000000000001,"5min":916.09500000000003,"15min":916.09500000000003},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.131,"5min":11.628,"15min":4.859},"min":{"1min":0.81899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.46,"5min":977.91499999999996,"15min":977.91499999999996},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":6.8769999999999998,"15min":3.1320000000000001},"min":{"1min":0.88500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3460000000000001,"5min":503.93000000000001,"15min":503.93000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":6.7670000000000003,"15min":3.0150000000000001},"min":{"1min":0.83999999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.2569999999999999,"5min":503.74299999999999,"15min":503.74299999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.4279999999999999,"15min":1.3440000000000001},"min":{"1min":1.0249999999999999,"5min":0.751,"15min":0.751},"max":{"1min":1.4710000000000001,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.141,"5min":10.393000000000001,"15min":34.238},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.3899999999999999,"5min":851.89099999999996,"15min":851.89099999999996},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.514,"15min":1.4910000000000001},"min":{"1min":1.0109999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.629,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.6830000000000001,"15min":1.917},"min":{"1min":1.038,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6639999999999999,"5min":15.597,"15min":15.597},"last":1.246}]}]},{"osd":4,"up_from":42,"seq":180388626490,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4411548,"kb_used_data":4364052,"kb_used_omap":0,"kb_used_meta":47487,"kb_avail":89960292,"statfs":{"total":96636764160,"available":92119339008,"internally_reserved":0,"allocated":4468789248,"data_stored":5613909741,"data_compressed":118370768,"data_compressed_allocated":1155686400,"data_compressed_original":2311372800,"omap_allocated":972,"internal_metadata":48626740},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.095}]},{"osd":1,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":9.0939999999999994,"5min":31.199000000000002,"15min":58.671999999999997},"min":{"1min":0.747,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":177.846,"5min":924.63300000000004,"15min":924.63300000000004},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.151,"5min":15.670999999999999,"15min":5.9130000000000003},"min":{"1min":0.79300000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.637,"5min":898.86900000000003,"15min":898.86900000000003},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":11.949,"15min":4.7149999999999999},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6020000000000001,"5min":857.78899999999999,"15min":857.78899999999999},"last":1.395},{"interface":"front","average":{"1min":0.95099999999999996,"5min":9.8019999999999996,"15min":4.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.198,"5min":779.38400000000001,"15min":779.38400000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":9.625,"15min":13.391},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.423,"5min":311.68299999999999,"15min":311.68299999999999},"last":1.032},{"interface":"front","average":{"1min":35.929000000000002,"5min":8.1660000000000004,"15min":3.5739999999999998},"min":{"1min":0.83999999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":765.98299999999995,"5min":765.98299999999995,"15min":765.98299999999995},"last":1.4319999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":3.7069999999999999,"15min":1.956},"min":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":239.99199999999999,"15min":239.99199999999999},"last":1.012},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1639999999999999,"15min":1.1579999999999999},"min":{"1min":0.84499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.464,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.141}]},{"osd":6,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2370000000000001,"15min":1.2050000000000001},"min":{"1min":0.73599999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.657,"5min":5.5890000000000004,"15min":5.5890000000000004},"last":1.492},{"interface":"front","average":{"1min":1.113,"5min":1.2110000000000001,"15min":1.282},"min":{"1min":0.86599999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2869999999999999,"15min":1.2809999999999999},"min":{"1min":0.98299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5620000000000001,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":1.236},{"interface":"front","average":{"1min":33.942,"5min":7.8579999999999997,"15min":3.5139999999999998},"min":{"1min":1.0109999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":719.03700000000003,"5min":719.03700000000003,"15min":719.03700000000003},"last":1.5209999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765928,"kb_used_data":751904,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":93605912,"statfs":{"total":96636764160,"available":95852453888,"internally_reserved":0,"allocated":769949696,"data_stored":1055829374,"data_compressed":29380114,"data_compressed_allocated":286253056,"data_compressed_original":572506112,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:39 2021","interfaces":[{"interface":"back","average":{"1min":24.538,"5min":24.538,"15min":24.538},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":474.77499999999998,"5min":474.77499999999998,"15min":474.77499999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96799999999999997,"15min":0.87},"min":{"1min":0.58299999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.2350000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":11.096,"15min":4.2889999999999997},"min":{"1min":0.84999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.518,"5min":732.80700000000002,"15min":732.80700000000002},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":12.396000000000001,"5min":10.401999999999999,"15min":4.2919999999999998},"min":{"1min":0.81599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":225.11799999999999,"5min":649.82899999999995,"15min":649.82899999999995},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.125,"15min":1.056},"min":{"1min":0.81799999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.256,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.2010000000000001}]},{"osd":3,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.1160000000000001,"15min":1.1259999999999999},"min":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4730000000000001,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.27,"15min":1.228},"min":{"1min":0.92300000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7350000000000001,"5min":4.827,"15min":4.827},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":13.199,"15min":16.175999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6000000000000001,"5min":514.74199999999996,"15min":514.74199999999996},"last":1.228},{"interface":"front","average":{"1min":39.335999999999999,"5min":8.8729999999999993,"15min":3.7469999999999999},"min":{"1min":0.83599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":762.10699999999997,"5min":762.10699999999997,"15min":762.10699999999997},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":37.015999999999998,"5min":16.678000000000001,"15min":6.4059999999999997},"min":{"1min":1.0900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":714.803,"5min":714.803,"15min":714.803},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4630000000000001,"15min":1.27},"min":{"1min":1.119,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.8320000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.423,"15min":1.5049999999999999},"min":{"1min":1.0409999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.851,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.282},{"interface":"front","average":{"1min":1.419,"5min":1.6479999999999999,"15min":1.758},"min":{"1min":1.1319999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.96,"5min":9.593,"15min":9.593},"last":1.3340000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509507,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4180812,"kb_used_data":4117700,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":90191028,"statfs":{"total":96636764160,"available":92355612672,"internally_reserved":0,"allocated":4216524800,"data_stored":4766177222,"data_compressed":58393750,"data_compressed_allocated":570441728,"data_compressed_original":1140883456,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:35 2021","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":31.253,"5min":31.253,"15min":31.253},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":729.27700000000004,"5min":729.27700000000004,"15min":729.27700000000004},"last":0.96599999999999997}]},{"osd":1,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":8.0850000000000009,"15min":26.884},"min":{"1min":0.626,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5029999999999999,"5min":684.42700000000002,"15min":684.42700000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.26,"15min":1.1619999999999999},"min":{"1min":0.69699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.319,"5min":6.1360000000000001,"15min":6.1360000000000001},"last":1.157}]},{"osd":2,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.167,"15min":1.234},"min":{"1min":0.91800000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.383,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":8.3000000000000007,"15min":3.6179999999999999},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":607.71000000000004,"15min":607.71000000000004},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":29.053999999999998,"5min":6.9160000000000004,"15min":3.1040000000000001},"min":{"1min":0.77700000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":501.613,"5min":501.613,"15min":501.613},"last":1.325},{"interface":"front","average":{"1min":1.1919999999999999,"5min":6.8719999999999999,"15min":3.0489999999999999},"min":{"1min":0.88500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4199999999999999,"5min":480.87299999999999,"15min":480.87299999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:13 2021","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":4.6059999999999999,"15min":2.4380000000000002},"min":{"1min":0.71799999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.6439999999999999,"5min":263.584,"15min":263.584},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.238,"15min":1.3939999999999999},"min":{"1min":0.82699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6200000000000001,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":1.423}]},{"osd":5,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.27,"15min":1.3400000000000001},"min":{"1min":1.0049999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6020000000000001,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":1.27},{"interface":"front","average":{"1min":1.25,"5min":1.569,"15min":1.492},"min":{"1min":1.012,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.5409999999999999,"5min":7.3140000000000001,"15min":7.3140000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4159999999999999,"15min":1.3380000000000001},"min":{"1min":0.91100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.581,"5min":10.795,"15min":10.795},"last":1.655},{"interface":"front","average":{"1min":1.278,"5min":1.365,"15min":1.3839999999999999},"min":{"1min":0.99299999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.722,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.383}]}]}]}} , 2021-01-29T13:57:47.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T13:57:47.465 INFO:teuthology.orchestra.run.smithi183.stdout: Ignoring malparsed backtrace: 2021-01-29T13:58:10.671 INFO:teuthology.orchestra.run.smithi183.stdout:} , 2021-01-29T13:58:10.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 179, in _raise_for_status , raise CommandCrashedError(command=self.command) , teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 10000 --objects 6600 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 1200 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' Ignoring malparsed backtrace: 2021-01-29T13:59:00.217 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2021-01-29T14:01:20.328 INFO:tasks.ceph:Archiving logs... , 2021-01-29T14:01:20.329 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/kchai-2021-01-29_12:57:23-rados-wip-kefu-testing-2021-01-29-1713-distro-basic-smithi/5840036/remote/smithi183/log Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 368, in archive , yield Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f30135d315a] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x666) [0x55fd1cf11fe6] Ignoring malparsed backtrace: 2021-01-29T13:55:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument , 2021-01-29T13:55:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. , 2021-01-29T13:55:49.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops Ignoring malparsed backtrace: 2021-01-29T13:56:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:oload 1000 , 2021-01-29T13:56:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:max_change 3 , 2021-01-29T13:56:38.517 INFO:teuthology.orchestra.run.smithi183.stdout:max_change_osds 4 Ignoring malparsed backtrace: set osd.3 primary-affinity to 1 (8655362) , 2021-01-29T13:56:51.495 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 , 2021-01-29T13:56:52.480+0000 7f8f78ab0700 -1 osd.2 132 handle_osd_map injecting map crc failure Ignoring malparsed backtrace: 2021-01-29T13:57:08.429 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2021-01-29T13:57:06.667864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20305121604,"num_objects":6822,"num_object_clones":0,"num_object_copies":19368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2076,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":25509,"num_write_kb":14727220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2477,"num_bytes_recovered":5602499186,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15129,"ondisk_log_size":15129,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":24946968,"kb_used_data":24625140,"kb_used_omap":1,"kb_used_meta":321598,"kb_avail":730027752,"statfs":{"total":773094113280,"available":747548418048,"internally_reserved":0,"allocated":25216143360,"data_stored":30051268153,"data_compressed":504955484,"data_compressed_allocated":4927905792,"data_compressed_original":9855811584,"omap_allocated":1944,"internal_metadata":329316456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-170,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":394035071,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.133172"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"145","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847683+0000","last_change":"2021-01-29T13:55:57.162929+0000","last_active":"2021-01-29T13:57:00.847683+0000","last_peered":"2021-01-29T13:57:00.847683+0000","last_clean":"2021-01-29T13:57:00.847683+0000","last_became_active":"2021-01-29T13:52:24.188931+0000","last_became_peered":"2021-01-29T13:52:24.188931+0000","last_unstale":"2021-01-29T13:57:00.847683+0000","last_undegraded":"2021-01-29T13:57:00.847683+0000","last_fullsized":"2021-01-29T13:57:00.847683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:57.162808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:57.162808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"120'6449","reported_seq":"8595","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.652824+0000","last_change":"2021-01-29T13:55:45.625490+0000","last_active":"2021-01-29T13:57:00.652824+0000","last_peered":"2021-01-29T13:57:00.652824+0000","last_clean":"2021-01-29T13:57:00.652824+0000","last_became_active":"2021-01-29T13:52:39.830011+0000","last_became_peered":"2021-01-29T13:52:39.830011+0000","last_unstale":"2021-01-29T13:57:00.652824+0000","last_undegraded":"2021-01-29T13:57:00.652824+0000","last_fullsized":"2021-01-29T13:57:00.652824+0000","mapping_epoch":26,"log_start":"72'3403","ondisk_log_start":"72'3403","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6250","last_scrub_stamp":"2021-01-29T13:55:45.625379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:45.625379+0000","log_size":3046,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2928382292,"num_objects":986,"num_object_clones":0,"num_object_copies":1972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2501,"num_read_kb":1252,"num_write":5879,"num_write_kb":1639641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3315,"num_flush":761,"num_flush_kb":2192275,"num_evict":269,"num_evict_kb":760560,"num_promote":1249,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"112","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.552366+0000","last_change":"2021-01-29T13:55:42.661441+0000","last_active":"2021-01-29T13:57:00.552366+0000","last_peered":"2021-01-29T13:57:00.552366+0000","last_clean":"2021-01-29T13:57:00.552366+0000","last_became_active":"2021-01-29T13:53:29.493255+0000","last_became_peered":"2021-01-29T13:53:29.493255+0000","last_unstale":"2021-01-29T13:57:00.552366+0000","last_undegraded":"2021-01-29T13:57:00.552366+0000","last_fullsized":"2021-01-29T13:57:00.552366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:42.661371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:42.661371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"120'671","reported_seq":"1016","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:05.597246+0000","last_change":"2021-01-29T13:56:47.680232+0000","last_active":"2021-01-29T13:57:05.597246+0000","last_peered":"2021-01-29T13:57:05.597246+0000","last_clean":"2021-01-29T13:56:36.386610+0000","last_became_active":"2021-01-29T13:56:47.674484+0000","last_became_peered":"2021-01-29T13:56:47.674484+0000","last_unstale":"2021-01-29T13:57:05.597246+0000","last_undegraded":"2021-01-29T13:57:05.597246+0000","last_fullsized":"2021-01-29T13:57:05.597246+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'570","last_scrub_stamp":"2021-01-29T13:55:44.911108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:44.911108+0000","log_size":671,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2038945493,"num_objects":671,"num_object_clones":0,"num_object_copies":2684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":590,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":1991482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":601,"num_bytes_recovered":1847436236,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[6,2,4,7],"avail_no_missing":["6(0)","2(1)","4(2)","7(3)"],"object_location_counts":[{"shards":"2(1),4(2),6(0),7(3)","objects":671}],"blocked_by":[],"up_primary":0,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"142","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:01.550240+0000","last_change":"2021-01-29T13:57:01.550191+0000","last_active":"2021-01-29T13:57:01.550240+0000","last_peered":"2021-01-29T13:57:01.550240+0000","last_clean":"2021-01-29T13:57:01.550240+0000","last_became_active":"2021-01-29T13:52:23.765595+0000","last_became_peered":"2021-01-29T13:52:23.765595+0000","last_unstale":"2021-01-29T13:57:01.550240+0000","last_undegraded":"2021-01-29T13:57:01.550240+0000","last_fullsized":"2021-01-29T13:57:01.550240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:57:01.550087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.550087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"117'710","reported_seq":"880","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847676+0000","last_change":"2021-01-29T13:56:09.328006+0000","last_active":"2021-01-29T13:57:00.847676+0000","last_peered":"2021-01-29T13:57:00.847676+0000","last_clean":"2021-01-29T13:57:00.847676+0000","last_became_active":"2021-01-29T13:53:09.969063+0000","last_became_peered":"2021-01-29T13:53:09.969063+0000","last_unstale":"2021-01-29T13:57:00.847676+0000","last_undegraded":"2021-01-29T13:57:00.847676+0000","last_fullsized":"2021-01-29T13:57:00.847676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'710","last_scrub_stamp":"2021-01-29T13:56:09.327903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:56:09.327903+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2107977089,"num_objects":710,"num_object_clones":0,"num_object_copies":2840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":2058922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"155","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.849258+0000","last_change":"2021-01-29T13:56:59.467725+0000","last_active":"2021-01-29T13:57:00.849258+0000","last_peered":"2021-01-29T13:57:00.849258+0000","last_clean":"2021-01-29T13:57:00.849258+0000","last_became_active":"2021-01-29T13:52:24.188578+0000","last_became_peered":"2021-01-29T13:52:24.188578+0000","last_unstale":"2021-01-29T13:57:00.849258+0000","last_undegraded":"2021-01-29T13:57:00.849258+0000","last_fullsized":"2021-01-29T13:57:00.849258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:59.467654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:59.467654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"142'4","reported_seq":"152","reported_epoch":"142","state":"active+clean","last_fresh":"2021-01-29T13:57:01.982145+0000","last_change":"2021-01-29T13:57:01.982145+0000","last_active":"2021-01-29T13:57:01.982145+0000","last_peered":"2021-01-29T13:57:01.982145+0000","last_clean":"2021-01-29T13:57:01.982145+0000","last_became_active":"2021-01-29T13:52:20.655015+0000","last_became_peered":"2021-01-29T13:52:20.655015+0000","last_unstale":"2021-01-29T13:57:01.982145+0000","last_undegraded":"2021-01-29T13:57:01.982145+0000","last_fullsized":"2021-01-29T13:57:01.982145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'4","last_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_deep_scrub":"142'4","last_deep_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.982073+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"120'761","reported_seq":"2454","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:03.004043+0000","last_change":"2021-01-29T13:56:48.363777+0000","last_active":"2021-01-29T13:57:03.004043+0000","last_peered":"2021-01-29T13:57:03.004043+0000","last_clean":"2021-01-29T13:56:36.386422+0000","last_became_active":"2021-01-29T13:56:48.362095+0000","last_became_peered":"2021-01-29T13:56:48.362095+0000","last_unstale":"2021-01-29T13:57:03.004043+0000","last_undegraded":"2021-01-29T13:57:03.004043+0000","last_fullsized":"2021-01-29T13:57:03.004043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'761","last_scrub_stamp":"2021-01-29T13:55:53.981049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:53.981049+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244508217,"num_objects":761,"num_object_clones":0,"num_object_copies":3044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":637,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":2192275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":747,"num_bytes_recovered":2213000897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,0],"acting":[4,2,7,1],"avail_no_missing":["4(0)","1(3)","2(1)","7(2)"],"object_location_counts":[{"shards":"1(3),2(1),4(0),7(2)","objects":761}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"144","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.849237+0000","last_change":"2021-01-29T13:56:41.371116+0000","last_active":"2021-01-29T13:57:00.849237+0000","last_peered":"2021-01-29T13:57:00.849237+0000","last_clean":"2021-01-29T13:57:00.849237+0000","last_became_active":"2021-01-29T13:52:23.765671+0000","last_became_peered":"2021-01-29T13:52:23.765671+0000","last_unstale":"2021-01-29T13:57:00.849237+0000","last_undegraded":"2021-01-29T13:57:00.849237+0000","last_fullsized":"2021-01-29T13:57:00.849237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:41.371025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:41.371025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"118'720","reported_seq":"886","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.652827+0000","last_change":"2021-01-29T13:55:59.202455+0000","last_active":"2021-01-29T13:57:00.652827+0000","last_peered":"2021-01-29T13:57:00.652827+0000","last_clean":"2021-01-29T13:57:00.652827+0000","last_became_active":"2021-01-29T13:53:09.587252+0000","last_became_peered":"2021-01-29T13:53:09.587252+0000","last_unstale":"2021-01-29T13:57:00.652827+0000","last_undegraded":"2021-01-29T13:57:00.652827+0000","last_fullsized":"2021-01-29T13:57:00.652827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'720","last_scrub_stamp":"2021-01-29T13:55:59.202349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:59.202349+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2156154079,"num_objects":720,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":2105989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"120'5986","reported_seq":"10252","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:05.668638+0000","last_change":"2021-01-29T13:56:47.680268+0000","last_active":"2021-01-29T13:57:05.668638+0000","last_peered":"2021-01-29T13:57:05.668638+0000","last_clean":"2021-01-29T13:56:36.386614+0000","last_became_active":"2021-01-29T13:56:47.673885+0000","last_became_peered":"2021-01-29T13:56:47.673885+0000","last_unstale":"2021-01-29T13:57:05.668638+0000","last_undegraded":"2021-01-29T13:57:05.668638+0000","last_fullsized":"2021-01-29T13:57:05.668638+0000","mapping_epoch":127,"log_start":"71'2904","ondisk_log_start":"71'2904","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'5955","last_scrub_stamp":"2021-01-29T13:55:51.275882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:51.275882+0000","log_size":3082,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2947693900,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":849,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2316,"num_read_kb":1158,"num_write":5435,"num_write_kb":1544566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1129,"num_bytes_recovered":1542062053,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2771,"num_flush":671,"num_flush_kb":1991482,"num_evict":178,"num_evict_kb":526959,"num_promote":1172,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[{"shards":"2,6","objects":985}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"157","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:01.451085+0000","last_change":"2021-01-29T13:57:01.451085+0000","last_active":"2021-01-29T13:57:01.451085+0000","last_peered":"2021-01-29T13:57:01.451085+0000","last_clean":"2021-01-29T13:57:01.451085+0000","last_became_active":"2021-01-29T13:53:09.377717+0000","last_became_peered":"2021-01-29T13:53:09.377717+0000","last_unstale":"2021-01-29T13:57:01.451085+0000","last_undegraded":"2021-01-29T13:57:01.451085+0000","last_fullsized":"2021-01-29T13:57:01.451085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:33.131622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:33.131622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"140","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847720+0000","last_change":"2021-01-29T13:56:53.807344+0000","last_active":"2021-01-29T13:57:00.847720+0000","last_peered":"2021-01-29T13:57:00.847720+0000","last_clean":"2021-01-29T13:57:00.847720+0000","last_became_active":"2021-01-29T13:52:40.828334+0000","last_became_peered":"2021-01-29T13:52:40.828334+0000","last_unstale":"2021-01-29T13:57:00.847720+0000","last_undegraded":"2021-01-29T13:57:00.847720+0000","last_fullsized":"2021-01-29T13:57:00.847720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:53.807251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:53.807251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"117'6273","reported_seq":"8319","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.552349+0000","last_change":"2021-01-29T13:55:55.445357+0000","last_active":"2021-01-29T13:57:00.552349+0000","last_peered":"2021-01-29T13:57:00.552349+0000","last_clean":"2021-01-29T13:57:00.552349+0000","last_became_active":"2021-01-29T13:53:09.369472+0000","last_became_peered":"2021-01-29T13:53:09.369472+0000","last_unstale":"2021-01-29T13:57:00.552349+0000","last_undegraded":"2021-01-29T13:57:00.552349+0000","last_fullsized":"2021-01-29T13:57:00.552349+0000","mapping_epoch":42,"log_start":"71'3203","ondisk_log_start":"71'3203","created":26,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6273","last_scrub_stamp":"2021-01-29T13:55:55.445229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.445229+0000","log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2935339657,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":2414,"num_read_kb":1208,"num_write":5647,"num_write_kb":1593121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3044,"num_flush":710,"num_flush_kb":2058922,"num_evict":219,"num_evict_kb":640347,"num_promote":1206,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"24","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.611252+0000","last_change":"2021-01-29T13:56:46.442031+0000","last_active":"2021-01-29T13:57:00.611252+0000","last_peered":"2021-01-29T13:57:00.611252+0000","last_clean":"2021-01-29T13:57:00.611252+0000","last_became_active":"2021-01-29T13:56:46.441589+0000","last_became_peered":"2021-01-29T13:56:46.441589+0000","last_unstale":"2021-01-29T13:57:00.611252+0000","last_undegraded":"2021-01-29T13:57:00.611252+0000","last_fullsized":"2021-01-29T13:57:00.611252+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:55.134762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.134762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"118'6270","reported_seq":"8351","reported_epoch":"142","state":"active+clean","last_fresh":"2021-01-29T13:57:04.235378+0000","last_change":"2021-01-29T13:57:04.235378+0000","last_active":"2021-01-29T13:57:04.235378+0000","last_peered":"2021-01-29T13:57:04.235378+0000","last_clean":"2021-01-29T13:57:04.235378+0000","last_became_active":"2021-01-29T13:52:39.823642+0000","last_became_peered":"2021-01-29T13:52:39.823642+0000","last_unstale":"2021-01-29T13:57:04.235378+0000","last_undegraded":"2021-01-29T13:57:04.235378+0000","last_fullsized":"2021-01-29T13:57:04.235378+0000","mapping_epoch":26,"log_start":"71'3205","ondisk_log_start":"71'3205","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'6270","last_scrub_stamp":"2021-01-29T13:57:04.235268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:57:04.235268+0000","log_size":3065,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2946120877,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2420,"num_read_kb":1212,"num_write":5684,"num_write_kb":1601214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3066,"num_flush":720,"num_flush_kb":2105989,"num_evict":218,"num_evict_kb":643724,"num_promote":1208,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":11757536726,"num_objects":3958,"num_object_clones":0,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":849,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":22645,"num_write_kb":6378542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1129,"num_bytes_recovered":1542062053,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11918577664,"data_stored":11828415316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12263,"ondisk_log_size":12263,"up":8,"acting":8,"num_store_stats":6},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":8547584878,"num_objects":2862,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1227,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":8348668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1348,"num_bytes_recovered":4060437133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13299490816,"data_stored":18228555776,"data_compressed":505072361,"data_compressed_allocated":4929064960,"data_compressed_original":9858129920,"omap_allocated":0,"internal_metadata":0},"log_size":2862,"ondisk_log_size":2862,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":124,"seq":532575944712,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942776,"kb_used_data":1921328,"kb_used_omap":0,"kb_used_meta":21439,"kb_avail":92429064,"statfs":{"total":96636764160,"available":94647361536,"internally_reserved":0,"allocated":1967439872,"data_stored":2257930354,"data_compressed":30754208,"data_compressed_allocated":299577344,"data_compressed_original":599154688,"omap_allocated":972,"internal_metadata":21953588},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2311348,"kb_used_data":2281004,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":92060492,"statfs":{"total":96636764160,"available":94269943808,"internally_reserved":0,"allocated":2335748096,"data_stored":3200465622,"data_compressed":88587048,"data_compressed_allocated":865042432,"data_compressed_original":1730084864,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:26 2021","interfaces":[{"interface":"back","average":{"1min":51.597999999999999,"5min":29.779,"15min":26.143000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":906.00800000000004,"5min":906.00800000000004,"15min":906.00800000000004},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":0.95499999999999996,"15min":0.93000000000000005},"min":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":1.3089999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.3340000000000001,"15min":1.49},"min":{"1min":0.65800000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4410000000000001,"5min":11.195,"15min":11.195},"last":1.272},{"interface":"front","average":{"1min":1.006,"5min":23.977,"15min":32.523000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3759999999999999,"5min":777.02499999999998,"15min":777.02499999999998},"last":1.581}]},{"osd":2,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":46.633000000000003,"5min":10.444000000000001,"15min":4.5460000000000003},"min":{"1min":0.62,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":512.423,"5min":512.423,"15min":512.423},"last":0.999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":2.1200000000000001,"15min":1.774},"min":{"1min":0.79300000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.472,"5min":60.529000000000003,"15min":60.529000000000003},"last":1.3759999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":10.481,"5min":3.0230000000000001,"15min":1.746},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":211.47900000000001,"5min":211.47900000000001,"15min":211.47900000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.46,"15min":1.607},"min":{"1min":0.92300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4930000000000001,"5min":11.146000000000001,"15min":11.146000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:56:16 2021","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.264,"15min":1.3380000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4299999999999999,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":1.343},{"interface":"front","average":{"1min":1.0229999999999999,"5min":14.401999999999999,"15min":20.280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4399999999999999,"5min":391.66699999999997,"15min":391.66699999999997},"last":1.54}]},{"osd":5,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":3.4470000000000001,"15min":2.2829999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.601,"5min":175.83199999999999,"15min":175.83199999999999},"last":1.625},{"interface":"front","average":{"1min":1.105,"5min":1.2549999999999999,"15min":1.2},"min":{"1min":0.77600000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.526,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":1.6020000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.5649999999999999,"15min":1.536},"min":{"1min":0.84199999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.5269999999999999,"5min":10.063000000000001,"15min":10.063000000000001},"last":1.647},{"interface":"front","average":{"1min":1.123,"5min":14.808,"15min":27.946000000000002},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4690000000000001,"5min":623.01999999999998,"15min":623.01999999999998},"last":1.754}]}]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5736668,"kb_used_data":5682580,"kb_used_omap":0,"kb_used_meta":54080,"kb_avail":88635172,"statfs":{"total":96636764160,"available":90762416128,"internally_reserved":0,"allocated":5818961920,"data_stored":6956451332,"data_compressed":118712623,"data_compressed_allocated":1158184960,"data_compressed_original":2316369920,"omap_allocated":0,"internal_metadata":55377920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":29.140000000000001,"15min":33.799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.012,"5min":565.52099999999996,"15min":565.52099999999996},"last":0.997},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.0209999999999999,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":40.582999999999998,"5min":17.475000000000001,"15min":6.4610000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":676.39099999999996,"5min":721.11000000000001,"15min":721.11000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":21.452999999999999,"15min":7.8179999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1479999999999999,"5min":1000.376,"15min":1000.376},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":51.539000000000001,"5min":11.381,"15min":4.3440000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":501.61200000000002,"5min":501.61200000000002,"15min":501.61200000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.0640000000000001},"min":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6839999999999999,"5min":6.1870000000000003,"15min":6.1870000000000003},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jan 29 13:56:15 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.478,"15min":1.53},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6719999999999999,"5min":3.694,"15min":3.694},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.407,"15min":1.3859999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.7509999999999999,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.6479999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":21.327999999999999,"5min":5.8109999999999999,"15min":2.7749999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":183.761,"5min":183.761,"15min":183.761},"last":0.86199999999999999},{"interface":"front","average":{"1min":41.545999999999999,"5min":9.516,"15min":4.0499999999999998},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":521.02499999999998,"5min":521.02499999999998,"15min":521.02499999999998},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.3720000000000001,"15min":1.3009999999999999},"min":{"1min":0.89900000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.474,"5min":3.46,"15min":3.46},"last":1.544},{"interface":"front","average":{"1min":1.111,"5min":1.4450000000000001,"15min":1.2809999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":8.5039999999999996,"15min":3.754},"min":{"1min":0.99099999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.7050000000000001,"5min":591.18899999999996,"15min":591.18899999999996},"last":1.5820000000000001},{"interface":"front","average":{"1min":52.493000000000002,"5min":11.779999999999999,"15min":4.8220000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":923.40099999999995,"5min":923.40099999999995,"15min":923.40099999999995},"last":0.95499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2154844,"kb_used_data":2115092,"kb_used_omap":0,"kb_used_meta":39744,"kb_avail":92216996,"statfs":{"total":96636764160,"available":94430203904,"internally_reserved":0,"allocated":2165854208,"data_stored":2457969146,"data_compressed":31021897,"data_compressed_allocated":302632960,"data_compressed_original":605265920,"omap_allocated":0,"internal_metadata":40697856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:25 2021","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.0349999999999999,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":5.0629999999999997},"last":0.92400000000000004},{"interface":"front","average":{"1min":39.090000000000003,"5min":8.5060000000000002,"15min":3.4079999999999999},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":752.73400000000004,"5min":752.73400000000004,"15min":752.73400000000004},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":22.648,"15min":29.776},"min":{"1min":0.55100000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.2629999999999999,"5min":832.21600000000001,"15min":832.21600000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":5.2699999999999996,"5min":11.266,"15min":4.4199999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":84.277000000000001,"5min":899.43399999999997,"15min":899.43399999999997},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.306,"15min":1.099},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1499999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":5.548,"15min":9.8919999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5489999999999999,"5min":244.60900000000001,"15min":244.60900000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Jan 29 13:56:15 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.4610000000000001,"15min":1.633},"min":{"1min":0.63800000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5960000000000001,"5min":5.242,"15min":5.242},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.9259999999999999,"15min":2.1680000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.5760000000000001,"5min":6.2590000000000003,"15min":6.2590000000000003},"last":1.024}]},{"osd":5,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":14.667999999999999,"15min":5.694},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0350000000000001,"5min":701.73400000000004,"15min":701.73400000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.3400000000000001,"15min":1.26},"min":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.917,"5min":5.758,"15min":5.758},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.4419999999999999,"15min":1.3440000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9139999999999999,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.258,"5min":4.0110000000000001,"15min":6.2149999999999999},"min":{"1min":0.72299999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.6230000000000002,"5min":132.35300000000001,"15min":132.35300000000001},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":37.829999999999998,"5min":8.8330000000000002,"15min":3.823},"min":{"1min":0.81299999999999994,"5min":0.752,"15min":0.752},"max":{"1min":696.96400000000006,"5min":696.96400000000006,"15min":696.96400000000006},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.4990000000000001,"15min":1.413},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.0369999999999999,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.85199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3443244,"kb_used_data":3391652,"kb_used_omap":0,"kb_used_meta":51584,"kb_avail":90928596,"statfs":{"total":96636764160,"available":93110882304,"internally_reserved":0,"allocated":3473051648,"data_stored":3742620723,"data_compressed":29735076,"data_compressed_allocated":290086912,"data_compressed_original":580173824,"omap_allocated":0,"internal_metadata":52822016},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:26 2021","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.93999999999999995,"15min":0.90400000000000003},"min":{"1min":0.67500000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.135,"5min":3.3719999999999999,"15min":3.7450000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.9620000000000002,"5min":60.329000000000001,"15min":60.329000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.97599999999999998,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":10.324,"15min":4.0970000000000004},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0629999999999999,"5min":977.78200000000004,"15min":977.78200000000004},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.22,"5min":5.7539999999999996,"15min":5.7539999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.383,"15min":1.4339999999999999},"min":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4870000000000001,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Jan 29 13:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":11.106,"15min":4.5620000000000003},"min":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3979999999999999,"5min":916.09500000000003,"15min":916.09500000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1479999999999999,"5min":11.696999999999999,"15min":4.8819999999999997},"min":{"1min":0.82099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.593,"5min":977.91499999999996,"15min":977.91499999999996},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":6.9089999999999998,"15min":3.1429999999999998},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8160000000000001,"5min":503.93000000000001,"15min":503.93000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.077,"5min":6.79,"15min":3.0230000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.3799999999999999,"5min":503.74299999999999,"15min":503.74299999999999},"last":1.141}]},{"osd":6,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.4490000000000001,"15min":1.351},"min":{"1min":0.874,"5min":0.751,"15min":0.751},"max":{"1min":3.2930000000000001,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.339,"5min":19.396999999999998,"15min":37.238999999999997},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":3.3690000000000002,"5min":851.89099999999996,"15min":851.89099999999996},"last":1.173}]},{"osd":7,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5609999999999999,"15min":1.5069999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.613,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.8300000000000001,"15min":1.966},"min":{"1min":1.0629999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.635,"5min":15.597,"15min":15.597},"last":1.038}]}]},{"osd":4,"up_from":42,"seq":180388626482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4411588,"kb_used_data":4363992,"kb_used_omap":0,"kb_used_meta":47423,"kb_avail":89960252,"statfs":{"total":96636764160,"available":92119298048,"internally_reserved":0,"allocated":4468727808,"data_stored":5613881037,"data_compressed":118370768,"data_compressed_allocated":1155686400,"data_compressed_original":2311372800,"omap_allocated":972,"internal_metadata":48561204},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:12 2021","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.2450000000000001,"5min":4.2450000000000001,"15min":4.2450000000000001},"last":0.746},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":4.1589999999999998,"5min":4.1589999999999998,"15min":4.1589999999999998},"last":1.141}]},{"osd":1,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":43.862000000000002,"15min":62.893000000000001},"min":{"1min":0.76800000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.6850000000000001,"5min":924.63300000000004,"15min":924.63300000000004},"last":1.008},{"interface":"front","average":{"1min":74.046000000000006,"5min":15.648,"15min":5.9059999999999997},"min":{"1min":0.84299999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":898.86900000000003,"5min":898.86900000000003,"15min":898.86900000000003},"last":1.2090000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":11.952,"15min":4.7160000000000002},"min":{"1min":0.745,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3149999999999999,"5min":857.78899999999999,"15min":857.78899999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":44.206000000000003,"5min":9.843,"15min":4.0510000000000002},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":779.38400000000001,"5min":779.38400000000001,"15min":779.38400000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":12.48,"15min":14.343},"min":{"1min":0.754,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.738,"5min":311.68299999999999,"15min":311.68299999999999},"last":1.079},{"interface":"front","average":{"1min":1.028,"5min":1.236,"15min":1.264},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.4359999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":3.7309999999999999,"15min":1.964},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5109999999999999,"5min":239.99199999999999,"15min":239.99199999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.171,"15min":1.1599999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.03}]},{"osd":6,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.238,"15min":1.206},"min":{"1min":0.72499999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.7789999999999999,"5min":5.5890000000000004,"15min":5.5890000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.252,"15min":1.296},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.657,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3,"15min":1.286},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.988,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":0.96099999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.635,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.357}]}]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765812,"kb_used_data":751852,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":93606028,"statfs":{"total":96636764160,"available":95852572672,"internally_reserved":0,"allocated":769896448,"data_stored":1055801421,"data_compressed":29380114,"data_compressed_allocated":286253056,"data_compressed_original":572506112,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.83999999999999997,"15min":0.81299999999999994},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.079},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.101,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":4.8410000000000002,"5min":4.8410000000000002,"15min":4.8410000000000002},"last":1.306}]},{"osd":1,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.93600000000000005,"15min":0.85999999999999999},"min":{"1min":0.68500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":2.3690000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":51.244999999999997,"5min":11.042999999999999,"15min":4.2709999999999999},"min":{"1min":0.82999999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":732.80700000000002,"5min":732.80700000000002,"15min":732.80700000000002},"last":1.365}]},{"osd":2,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":8.1699999999999999,"15min":3.548},"min":{"1min":0.73599999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.161,"5min":649.82899999999995,"15min":649.82899999999995},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.1180000000000001,"15min":1.054},"min":{"1min":0.70699999999999996,"5min":0.623,"15min":0.623},"max":{"1min":2.4169999999999998,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.145}]},{"osd":3,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.137,"15min":1.133},"min":{"1min":0.626,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2829999999999999,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.274,"15min":1.23},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.1200000000000001,"5min":4.827,"15min":4.827},"last":1.7350000000000001}]},{"osd":4,"last update":"Fri Jan 29 13:56:17 2021","interfaces":[{"interface":"back","average":{"1min":28.036000000000001,"5min":16.495999999999999,"15min":17.274999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":514.74199999999996,"5min":514.74199999999996,"15min":514.74199999999996},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2430000000000001,"15min":1.204},"min":{"1min":0.86699999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.266,"5min":4.4359999999999999,"15min":4.4359999999999999},"last":1.7689999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":9.5289999999999999,"15min":4.0229999999999997},"min":{"1min":0.81499999999999995,"5min":0.622,"15min":0.622},"max":{"1min":2.3039999999999998,"5min":520.71799999999996,"15min":520.71799999999996},"last":1.804},{"interface":"front","average":{"1min":1.345,"5min":1.421,"15min":1.256},"min":{"1min":0.84399999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3929999999999998,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":1.8320000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.92700000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3420000000000001,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.7270000000000001,"15min":1.7849999999999999},"min":{"1min":1.0049999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3319999999999999,"5min":9.593,"15min":9.593},"last":1.96}]}]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4180688,"kb_used_data":4117640,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":90191152,"statfs":{"total":96636764160,"available":92355739648,"internally_reserved":0,"allocated":4216463360,"data_stored":4766148518,"data_compressed":58393750,"data_compressed_allocated":570441728,"data_compressed_original":1140883456,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:20 2021","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.379,"15min":1.381},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.0899999999999999,"5min":5.8380000000000001,"15min":5.8380000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.012,"15min":0.96599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.3810000000000002,"5min":7.3810000000000002,"15min":7.3810000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":15.146000000000001,"15min":29.238},"min":{"1min":0.65400000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.353,"5min":684.42700000000002,"15min":684.42700000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.2849999999999999,"15min":1.1699999999999999},"min":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.306,"5min":6.1360000000000001,"15min":6.1360000000000001},"last":0.755}]},{"osd":2,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1919999999999999,"15min":1.242},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.492,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":1.133},{"interface":"front","average":{"1min":36.773000000000003,"5min":8.3480000000000008,"15min":3.6339999999999999},"min":{"1min":0.68799999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":607.71000000000004,"5min":607.71000000000004,"15min":607.71000000000004},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.345,"15min":1.2470000000000001},"min":{"1min":0.66800000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1779999999999999,"5min":6.048,"15min":6.048},"last":200.50399999999999},{"interface":"front","average":{"1min":29.335999999999999,"5min":6.8609999999999998,"15min":3.0449999999999999},"min":{"1min":0.83699999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":480.87299999999999,"5min":480.87299999999999,"15min":480.87299999999999},"last":1.21}]},{"osd":4,"last update":"Fri Jan 29 13:56:12 2021","interfaces":[{"interface":"back","average":{"1min":17.359999999999999,"5min":4.6619999999999999,"15min":2.456},"min":{"1min":0.629,"5min":0.62,"15min":0.62},"max":{"1min":263.584,"5min":263.584,"15min":263.584},"last":1.173},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.3069999999999999,"15min":1.417},"min":{"1min":0.78900000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.474,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2969999999999999,"15min":1.349},"min":{"1min":0.86499999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.496,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":1.034},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.6100000000000001,"15min":1.506},"min":{"1min":0.96499999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3759999999999999,"5min":7.3140000000000001,"15min":7.3140000000000001},"last":1.052}]},{"osd":7,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.4159999999999999,"15min":1.3380000000000001},"min":{"1min":0.90100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.655,"5min":10.795,"15min":10.795},"last":1.375},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.85899999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.609,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":0.99299999999999999}]}]}]}} , 2021-01-29T13:57:11.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T13:57:11.716 INFO:teuthology.orchestra.run.smithi183.stdout: Ignoring malparsed backtrace: 2021-01-29T13:57:44.175 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2021-01-29T13:57:42.675417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20305121604,"num_objects":6822,"num_object_clones":0,"num_object_copies":19368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":632,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":25509,"num_write_kb":14727220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3207,"num_bytes_recovered":7385874976,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15129,"ondisk_log_size":15129,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":25551644,"kb_used_data":25207644,"kb_used_omap":1,"kb_used_meta":343934,"kb_avail":729423076,"statfs":{"total":773094113280,"available":746929229824,"internally_reserved":0,"allocated":25812627456,"data_stored":30826570098,"data_compressed":523387886,"data_compressed_allocated":5107855360,"data_compressed_original":10215710720,"omap_allocated":1944,"internal_metadata":352188520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-252,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":339084355,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.225468"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"156","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458800+0000","last_change":"2021-01-29T13:57:34.166076+0000","last_active":"2021-01-29T13:57:37.458800+0000","last_peered":"2021-01-29T13:57:37.458800+0000","last_clean":"2021-01-29T13:57:37.458800+0000","last_became_active":"2021-01-29T13:52:24.188931+0000","last_became_peered":"2021-01-29T13:52:24.188931+0000","last_unstale":"2021-01-29T13:57:37.458800+0000","last_undegraded":"2021-01-29T13:57:37.458800+0000","last_fullsized":"2021-01-29T13:57:37.458800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:57.162808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:57.162808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"120'6449","reported_seq":"8600","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.461338+0000","last_change":"2021-01-29T13:55:45.625490+0000","last_active":"2021-01-29T13:57:37.461338+0000","last_peered":"2021-01-29T13:57:37.461338+0000","last_clean":"2021-01-29T13:57:37.461338+0000","last_became_active":"2021-01-29T13:52:39.830011+0000","last_became_peered":"2021-01-29T13:52:39.830011+0000","last_unstale":"2021-01-29T13:57:37.461338+0000","last_undegraded":"2021-01-29T13:57:37.461338+0000","last_fullsized":"2021-01-29T13:57:37.461338+0000","mapping_epoch":26,"log_start":"72'3403","ondisk_log_start":"72'3403","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6250","last_scrub_stamp":"2021-01-29T13:55:45.625379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:45.625379+0000","log_size":3046,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2928382292,"num_objects":986,"num_object_clones":0,"num_object_copies":1972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2501,"num_read_kb":1252,"num_write":5879,"num_write_kb":1639641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3315,"num_flush":761,"num_flush_kb":2192275,"num_evict":269,"num_evict_kb":760560,"num_promote":1249,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"117","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.497927+0000","last_change":"2021-01-29T13:55:42.661441+0000","last_active":"2021-01-29T13:57:37.497927+0000","last_peered":"2021-01-29T13:57:37.497927+0000","last_clean":"2021-01-29T13:57:37.497927+0000","last_became_active":"2021-01-29T13:53:29.493255+0000","last_became_peered":"2021-01-29T13:53:29.493255+0000","last_unstale":"2021-01-29T13:57:37.497927+0000","last_undegraded":"2021-01-29T13:57:37.497927+0000","last_fullsized":"2021-01-29T13:57:37.497927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:42.661371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:42.661371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"120'671","reported_seq":"1393","reported_epoch":"147","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:40.662249+0000","last_change":"2021-01-29T13:56:47.680232+0000","last_active":"2021-01-29T13:57:40.662249+0000","last_peered":"2021-01-29T13:57:40.662249+0000","last_clean":"2021-01-29T13:56:36.386610+0000","last_became_active":"2021-01-29T13:56:47.674484+0000","last_became_peered":"2021-01-29T13:56:47.674484+0000","last_unstale":"2021-01-29T13:57:40.662249+0000","last_undegraded":"2021-01-29T13:57:40.662249+0000","last_fullsized":"2021-01-29T13:57:40.662249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'570","last_scrub_stamp":"2021-01-29T13:55:44.911108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:44.911108+0000","log_size":671,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2038945493,"num_objects":671,"num_object_clones":0,"num_object_copies":2684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":404,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":1991482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":787,"num_bytes_recovered":2413500764,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[6,2,4,7],"avail_no_missing":["6(0)","2(1)","4(2)","7(3)"],"object_location_counts":[{"shards":"2(1),4(2),6(0),7(3)","objects":671}],"blocked_by":[],"up_primary":0,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"147","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.457918+0000","last_change":"2021-01-29T13:57:01.550191+0000","last_active":"2021-01-29T13:57:37.457918+0000","last_peered":"2021-01-29T13:57:37.457918+0000","last_clean":"2021-01-29T13:57:37.457918+0000","last_became_active":"2021-01-29T13:52:23.765595+0000","last_became_peered":"2021-01-29T13:52:23.765595+0000","last_unstale":"2021-01-29T13:57:37.457918+0000","last_undegraded":"2021-01-29T13:57:37.457918+0000","last_fullsized":"2021-01-29T13:57:37.457918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:57:01.550087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.550087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"117'710","reported_seq":"887","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458693+0000","last_change":"2021-01-29T13:57:37.153012+0000","last_active":"2021-01-29T13:57:37.458693+0000","last_peered":"2021-01-29T13:57:37.458693+0000","last_clean":"2021-01-29T13:57:37.458693+0000","last_became_active":"2021-01-29T13:53:09.969063+0000","last_became_peered":"2021-01-29T13:53:09.969063+0000","last_unstale":"2021-01-29T13:57:37.458693+0000","last_undegraded":"2021-01-29T13:57:37.458693+0000","last_fullsized":"2021-01-29T13:57:37.458693+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'710","last_scrub_stamp":"2021-01-29T13:56:09.327903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:56:09.327903+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2107977089,"num_objects":710,"num_object_clones":0,"num_object_copies":2840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":2058922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"159","reported_epoch":"145","state":"active+clean","last_fresh":"2021-01-29T13:57:36.794315+0000","last_change":"2021-01-29T13:56:59.467725+0000","last_active":"2021-01-29T13:57:36.794315+0000","last_peered":"2021-01-29T13:57:36.794315+0000","last_clean":"2021-01-29T13:57:36.794315+0000","last_became_active":"2021-01-29T13:52:24.188578+0000","last_became_peered":"2021-01-29T13:52:24.188578+0000","last_unstale":"2021-01-29T13:57:36.794315+0000","last_undegraded":"2021-01-29T13:57:36.794315+0000","last_fullsized":"2021-01-29T13:57:36.794315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:59.467654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:59.467654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"142'4","reported_seq":"157","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458197+0000","last_change":"2021-01-29T13:57:01.982145+0000","last_active":"2021-01-29T13:57:37.458197+0000","last_peered":"2021-01-29T13:57:37.458197+0000","last_clean":"2021-01-29T13:57:37.458197+0000","last_became_active":"2021-01-29T13:52:20.655015+0000","last_became_peered":"2021-01-29T13:52:20.655015+0000","last_unstale":"2021-01-29T13:57:37.458197+0000","last_undegraded":"2021-01-29T13:57:37.458197+0000","last_fullsized":"2021-01-29T13:57:37.458197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'4","last_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_deep_scrub":"142'4","last_deep_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.982073+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"120'761","reported_seq":"3071","reported_epoch":"147","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:41.858978+0000","last_change":"2021-01-29T13:56:48.363777+0000","last_active":"2021-01-29T13:57:41.858978+0000","last_peered":"2021-01-29T13:57:41.858978+0000","last_clean":"2021-01-29T13:56:36.386422+0000","last_became_active":"2021-01-29T13:56:48.362095+0000","last_became_peered":"2021-01-29T13:56:48.362095+0000","last_unstale":"2021-01-29T13:57:41.858978+0000","last_undegraded":"2021-01-29T13:57:41.858978+0000","last_fullsized":"2021-01-29T13:57:41.858978+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'761","last_scrub_stamp":"2021-01-29T13:55:53.981049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:53.981049+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244508217,"num_objects":761,"num_object_clones":0,"num_object_copies":3044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":228,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":2192275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1053,"num_bytes_recovered":3106526858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,0],"acting":[4,2,7,1],"avail_no_missing":["4(0)","1(3)","2(1)","7(2)"],"object_location_counts":[{"shards":"1(3),2(1),4(0),7(2)","objects":761}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"148","reported_epoch":"145","state":"active+clean","last_fresh":"2021-01-29T13:57:36.794261+0000","last_change":"2021-01-29T13:56:41.371116+0000","last_active":"2021-01-29T13:57:36.794261+0000","last_peered":"2021-01-29T13:57:36.794261+0000","last_clean":"2021-01-29T13:57:36.794261+0000","last_became_active":"2021-01-29T13:52:23.765671+0000","last_became_peered":"2021-01-29T13:52:23.765671+0000","last_unstale":"2021-01-29T13:57:36.794261+0000","last_undegraded":"2021-01-29T13:57:36.794261+0000","last_fullsized":"2021-01-29T13:57:36.794261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:41.371025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:41.371025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"118'720","reported_seq":"891","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.461342+0000","last_change":"2021-01-29T13:55:59.202455+0000","last_active":"2021-01-29T13:57:37.461342+0000","last_peered":"2021-01-29T13:57:37.461342+0000","last_clean":"2021-01-29T13:57:37.461342+0000","last_became_active":"2021-01-29T13:53:09.587252+0000","last_became_peered":"2021-01-29T13:53:09.587252+0000","last_unstale":"2021-01-29T13:57:37.461342+0000","last_undegraded":"2021-01-29T13:57:37.461342+0000","last_fullsized":"2021-01-29T13:57:37.461342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'720","last_scrub_stamp":"2021-01-29T13:55:59.202349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:59.202349+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2156154079,"num_objects":720,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":2105989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"120'5986","reported_seq":"10744","reported_epoch":"147","state":"active+clean","last_fresh":"2021-01-29T13:57:38.478514+0000","last_change":"2021-01-29T13:57:38.478514+0000","last_active":"2021-01-29T13:57:38.478514+0000","last_peered":"2021-01-29T13:57:38.478514+0000","last_clean":"2021-01-29T13:57:38.478514+0000","last_became_active":"2021-01-29T13:57:38.475245+0000","last_became_peered":"2021-01-29T13:57:38.475245+0000","last_unstale":"2021-01-29T13:57:38.478514+0000","last_undegraded":"2021-01-29T13:57:38.478514+0000","last_fullsized":"2021-01-29T13:57:38.478514+0000","mapping_epoch":146,"log_start":"71'2904","ondisk_log_start":"71'2904","created":26,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'5955","last_scrub_stamp":"2021-01-29T13:55:51.275882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:51.275882+0000","log_size":3082,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2947693900,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2316,"num_read_kb":1158,"num_write":5435,"num_write_kb":1544566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1367,"num_bytes_recovered":1865847354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2771,"num_flush":671,"num_flush_kb":1991482,"num_evict":178,"num_evict_kb":526959,"num_promote":1172,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"171","reported_epoch":"147","state":"active+clean","last_fresh":"2021-01-29T13:57:39.387290+0000","last_change":"2021-01-29T13:57:39.387896+0000","last_active":"2021-01-29T13:57:39.387290+0000","last_peered":"2021-01-29T13:57:39.387290+0000","last_clean":"2021-01-29T13:57:39.387290+0000","last_became_active":"2021-01-29T13:53:09.377717+0000","last_became_peered":"2021-01-29T13:53:09.377717+0000","last_unstale":"2021-01-29T13:57:39.387290+0000","last_undegraded":"2021-01-29T13:57:39.387290+0000","last_fullsized":"2021-01-29T13:57:39.387290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:33.131622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:33.131622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"145","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458896+0000","last_change":"2021-01-29T13:56:53.807344+0000","last_active":"2021-01-29T13:57:37.458896+0000","last_peered":"2021-01-29T13:57:37.458896+0000","last_clean":"2021-01-29T13:57:37.458896+0000","last_became_active":"2021-01-29T13:52:40.828334+0000","last_became_peered":"2021-01-29T13:52:40.828334+0000","last_unstale":"2021-01-29T13:57:37.458896+0000","last_undegraded":"2021-01-29T13:57:37.458896+0000","last_fullsized":"2021-01-29T13:57:37.458896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:53.807251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:53.807251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"117'6273","reported_seq":"8324","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.497913+0000","last_change":"2021-01-29T13:55:55.445357+0000","last_active":"2021-01-29T13:57:37.497913+0000","last_peered":"2021-01-29T13:57:37.497913+0000","last_clean":"2021-01-29T13:57:37.497913+0000","last_became_active":"2021-01-29T13:53:09.369472+0000","last_became_peered":"2021-01-29T13:53:09.369472+0000","last_unstale":"2021-01-29T13:57:37.497913+0000","last_undegraded":"2021-01-29T13:57:37.497913+0000","last_fullsized":"2021-01-29T13:57:37.497913+0000","mapping_epoch":42,"log_start":"71'3203","ondisk_log_start":"71'3203","created":26,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6273","last_scrub_stamp":"2021-01-29T13:55:55.445229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.445229+0000","log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2935339657,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":2414,"num_read_kb":1208,"num_write":5647,"num_write_kb":1593121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3044,"num_flush":710,"num_flush_kb":2058922,"num_evict":219,"num_evict_kb":640347,"num_promote":1206,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"29","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.463934+0000","last_change":"2021-01-29T13:56:46.442031+0000","last_active":"2021-01-29T13:57:37.463934+0000","last_peered":"2021-01-29T13:57:37.463934+0000","last_clean":"2021-01-29T13:57:37.463934+0000","last_became_active":"2021-01-29T13:56:46.441589+0000","last_became_peered":"2021-01-29T13:56:46.441589+0000","last_unstale":"2021-01-29T13:57:37.463934+0000","last_undegraded":"2021-01-29T13:57:37.463934+0000","last_fullsized":"2021-01-29T13:57:37.463934+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:55.134762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.134762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"118'6270","reported_seq":"8356","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.464735+0000","last_change":"2021-01-29T13:57:04.235378+0000","last_active":"2021-01-29T13:57:37.464735+0000","last_peered":"2021-01-29T13:57:37.464735+0000","last_clean":"2021-01-29T13:57:37.464735+0000","last_became_active":"2021-01-29T13:52:39.823642+0000","last_became_peered":"2021-01-29T13:52:39.823642+0000","last_unstale":"2021-01-29T13:57:37.464735+0000","last_undegraded":"2021-01-29T13:57:37.464735+0000","last_fullsized":"2021-01-29T13:57:37.464735+0000","mapping_epoch":26,"log_start":"71'3205","ondisk_log_start":"71'3205","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'6270","last_scrub_stamp":"2021-01-29T13:57:04.235268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:57:04.235268+0000","log_size":3065,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2946120877,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2420,"num_read_kb":1212,"num_write":5684,"num_write_kb":1601214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3066,"num_flush":720,"num_flush_kb":2105989,"num_evict":218,"num_evict_kb":643724,"num_promote":1208,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":11757536726,"num_objects":3958,"num_object_clones":0,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":22645,"num_write_kb":6378542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1367,"num_bytes_recovered":1865847354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11983056896,"data_stored":11892361364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12263,"ondisk_log_size":12263,"up":8,"acting":8,"num_store_stats":6},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":8547584878,"num_objects":2862,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":632,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":8348668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1840,"num_bytes_recovered":5520027622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13793206272,"data_stored":18905419776,"data_compressed":523841489,"data_compressed_allocated":5112213504,"data_compressed_original":10224427008,"omap_allocated":0,"internal_metadata":0},"log_size":2862,"ondisk_log_size":2862,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":124,"seq":532575944719,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2622556,"kb_used_data":2579220,"kb_used_omap":0,"kb_used_meta":43327,"kb_avail":91749284,"statfs":{"total":96636764160,"available":93951266816,"internally_reserved":0,"allocated":2641121280,"data_stored":3110022318,"data_compressed":49186610,"data_compressed_allocated":479526912,"data_compressed_original":959053824,"omap_allocated":972,"internal_metadata":44366900},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0149999999999999}]},{"osd":2,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":7.8730000000000002,"5min":7.8730000000000002,"15min":7.8730000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":170.62200000000001,"5min":170.62200000000001,"15min":170.62200000000001},"last":170.62200000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.258}]},{"osd":4,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.056},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":6.9889999999999999,"5min":6.9889999999999999,"15min":6.9889999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":136.00800000000001,"5min":136.00800000000001,"15min":136.00800000000001},"last":1.294},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Jan 29 13:57:37 2021","interfaces":[{"interface":"back","average":{"1min":22.164000000000001,"5min":22.164000000000001,"15min":22.164000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":484.286,"5min":484.286,"15min":484.286},"last":1.1140000000000001},{"interface":"front","average":{"1min":24.145,"5min":24.145,"15min":24.145},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":529.46000000000004,"5min":529.46000000000004,"15min":529.46000000000004},"last":529.46000000000004}]},{"osd":7,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.349}]}]},{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2311472,"kb_used_data":2281064,"kb_used_omap":0,"kb_used_meta":30400,"kb_avail":92060368,"statfs":{"total":96636764160,"available":94269816832,"internally_reserved":0,"allocated":2335809536,"data_stored":3200494326,"data_compressed":88587048,"data_compressed_allocated":865042432,"data_compressed_original":1730084864,"omap_allocated":0,"internal_metadata":31129600},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.004}]},{"osd":1,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.242,"15min":1.46},"min":{"1min":0.64900000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.671,"5min":11.195,"15min":11.195},"last":0.91200000000000003},{"interface":"front","average":{"1min":50.901000000000003,"5min":26.797999999999998,"15min":33.463000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":951.06700000000001,"5min":951.06700000000001,"15min":951.06700000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":10.314,"15min":4.5030000000000001},"min":{"1min":0.72099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.147,"5min":512.423,"15min":512.423},"last":0.73799999999999999},{"interface":"front","average":{"1min":27.712,"5min":7.3419999999999996,"15min":3.5150000000000001},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":505.935,"5min":505.935,"15min":505.935},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":52.369999999999997,"5min":13.276,"15min":5.1639999999999997},"min":{"1min":0.749,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":977.31200000000001,"5min":977.31200000000001,"15min":977.31200000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.381,"15min":1.581},"min":{"1min":1.006,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7789999999999999,"5min":11.146000000000001,"15min":11.146000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:17 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.254,"15min":1.3340000000000001},"min":{"1min":0.79900000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7450000000000001,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":16.503,"5min":13.058,"15min":19.832000000000001},"min":{"1min":0.79700000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":309.072,"5min":391.66699999999997,"15min":391.66699999999997},"last":0.98199999999999998}]},{"osd":5,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":3.3260000000000001,"15min":2.242},"min":{"1min":0.76700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.625,"5min":175.83199999999999,"15min":175.83199999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.294,"15min":1.2130000000000001},"min":{"1min":0.97099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8120000000000001,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":1.3260000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.552,"15min":1.532},"min":{"1min":1.119,"5min":0.754,"15min":0.754},"max":{"1min":1.881,"5min":10.063000000000001,"15min":10.063000000000001},"last":1.345},{"interface":"front","average":{"1min":8.1750000000000007,"5min":9.5399999999999991,"15min":26.190000000000001},"min":{"1min":0.95299999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":132.83500000000001,"5min":623.01999999999998,"15min":623.01999999999998},"last":1.278}]}]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5660992,"kb_used_data":5606840,"kb_used_omap":0,"kb_used_meta":54144,"kb_avail":88710848,"statfs":{"total":96636764160,"available":90839908352,"internally_reserved":0,"allocated":5741404160,"data_stored":6879489840,"data_compressed":118712623,"data_compressed_allocated":1158184960,"data_compressed_original":2316369920,"omap_allocated":0,"internal_metadata":55443456},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.94299999999999995}]},{"osd":1,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":17.460000000000001,"15min":6.4560000000000004},"min":{"1min":0.63200000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.3999999999999999,"5min":721.11000000000001,"15min":721.11000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":21.443999999999999,"15min":7.8150000000000004},"min":{"1min":0.71899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3460000000000001,"5min":1000.376,"15min":1000.376},"last":0.96999999999999997}]},{"osd":3,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":11.378,"15min":4.343},"min":{"1min":0.60299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":501.61200000000002,"15min":501.61200000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.1819999999999999,"15min":1.0620000000000001},"min":{"1min":0.65900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":6.1870000000000003,"15min":6.1870000000000003},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.4099999999999999,"15min":1.5069999999999999},"min":{"1min":0.72699999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6160000000000001,"5min":3.694,"15min":3.694},"last":1.1850000000000001},{"interface":"front","average":{"1min":77.519000000000005,"5min":16.635999999999999,"15min":6.4619999999999997},"min":{"1min":0.96199999999999997,"5min":0.871,"15min":0.871},"max":{"1min":874.88400000000001,"5min":874.88400000000001,"15min":874.88400000000001},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":5.7699999999999996,"15min":2.762},"min":{"1min":0.79800000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.349,"5min":183.761,"15min":183.761},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":9.484,"15min":4.0389999999999997},"min":{"1min":0.88400000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.5469999999999999,"5min":521.02499999999998,"15min":521.02499999999998},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.359,"15min":1.2969999999999999},"min":{"1min":0.93500000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.544,"5min":3.46,"15min":3.46},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.4319999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4590000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":22.652000000000001,"5min":12.759,"15min":5.1719999999999997},"min":{"1min":0.98399999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":427.892,"5min":591.18899999999996,"15min":591.18899999999996},"last":1.226},{"interface":"front","average":{"1min":1.26,"5min":11.763999999999999,"15min":4.8159999999999998},"min":{"1min":0.95499999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.738,"5min":923.40099999999995,"15min":923.40099999999995},"last":1.103}]}]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2154968,"kb_used_data":2115152,"kb_used_omap":0,"kb_used_meta":39808,"kb_avail":92216872,"statfs":{"total":96636764160,"available":94430076928,"internally_reserved":0,"allocated":2165915648,"data_stored":2457997850,"data_compressed":31021897,"data_compressed_allocated":302632960,"data_compressed_original":605265920,"omap_allocated":0,"internal_metadata":40763392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:25 2021","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.0349999999999999,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":5.0629999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":39.090000000000003,"5min":8.5060000000000002,"15min":3.4079999999999999},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":752.73400000000004,"5min":752.73400000000004,"15min":752.73400000000004},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":16.138999999999999,"15min":27.606000000000002},"min":{"1min":0.57199999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":832.21600000000001,"15min":832.21600000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":11.237,"15min":4.4100000000000001},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1870000000000001,"5min":899.43399999999997,"15min":899.43399999999997},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.296,"15min":1.0960000000000001},"min":{"1min":0.63300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3169999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.876},{"interface":"front","average":{"1min":0.84299999999999997,"5min":3.3029999999999999,"15min":9.1440000000000001},"min":{"1min":0.55100000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1220000000000001,"5min":244.60900000000001,"15min":244.60900000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.325,"15min":1.5880000000000001},"min":{"1min":0.71399999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.254,"5min":5.242,"15min":5.242},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.6839999999999999,"15min":2.0870000000000002},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2310000000000001,"5min":6.2590000000000003,"15min":6.2590000000000003},"last":1.165}]},{"osd":5,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":14.631,"15min":5.681},"min":{"1min":0.68300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3440000000000001,"5min":701.73400000000004,"15min":701.73400000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.302,"15min":1.248},"min":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.359,"5min":5.758,"15min":5.758},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":48.951999999999998,"5min":10.974,"15min":4.5209999999999999},"min":{"1min":0.89800000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":862.01999999999998,"5min":862.01999999999998,"15min":862.01999999999998},"last":1.046},{"interface":"front","average":{"1min":1.1659999999999999,"5min":2.7810000000000001,"15min":5.8049999999999997},"min":{"1min":0.83799999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4790000000000001,"5min":132.35300000000001,"15min":132.35300000000001},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":45.155999999999999,"5min":17.600000000000001,"15min":6.7450000000000001},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":749.81700000000001,"5min":749.81700000000001,"15min":749.81700000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.4530000000000001,"15min":1.3979999999999999},"min":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4790000000000001,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":1.216}]}]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3443368,"kb_used_data":3391712,"kb_used_omap":0,"kb_used_meta":51648,"kb_avail":90928472,"statfs":{"total":96636764160,"available":93110755328,"internally_reserved":0,"allocated":3473113088,"data_stored":3742649427,"data_compressed":29735076,"data_compressed_allocated":290086912,"data_compressed_original":580173824,"omap_allocated":0,"internal_metadata":52887552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":29.826000000000001,"5min":29.826000000000001,"15min":29.826000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":301.69099999999997,"5min":301.69099999999997,"15min":301.69099999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96599999999999997,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1339999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":10.300000000000001,"15min":4.0890000000000004},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":977.78200000000004,"15min":977.78200000000004},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.181,"15min":1.079},"min":{"1min":0.65700000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3919999999999999,"5min":5.7539999999999996,"15min":5.7539999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3009999999999999,"15min":1.407},"min":{"1min":0.82999999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2190000000000001,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":11.065,"15min":4.5490000000000004},"min":{"1min":0.71099999999999997,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4890000000000001,"5min":916.09500000000003,"15min":916.09500000000003},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.131,"5min":11.628,"15min":4.859},"min":{"1min":0.81899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.46,"5min":977.91499999999996,"15min":977.91499999999996},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":6.8769999999999998,"15min":3.1320000000000001},"min":{"1min":0.88500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3460000000000001,"5min":503.93000000000001,"15min":503.93000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":6.7670000000000003,"15min":3.0150000000000001},"min":{"1min":0.83999999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.2569999999999999,"5min":503.74299999999999,"15min":503.74299999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.4279999999999999,"15min":1.3440000000000001},"min":{"1min":1.0249999999999999,"5min":0.751,"15min":0.751},"max":{"1min":1.4710000000000001,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.141,"5min":10.393000000000001,"15min":34.238},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.3899999999999999,"5min":851.89099999999996,"15min":851.89099999999996},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.514,"15min":1.4910000000000001},"min":{"1min":1.0109999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.629,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.6830000000000001,"15min":1.917},"min":{"1min":1.038,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6639999999999999,"5min":15.597,"15min":15.597},"last":1.246}]}]},{"osd":4,"up_from":42,"seq":180388626490,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4411548,"kb_used_data":4364052,"kb_used_omap":0,"kb_used_meta":47487,"kb_avail":89960292,"statfs":{"total":96636764160,"available":92119339008,"internally_reserved":0,"allocated":4468789248,"data_stored":5613909741,"data_compressed":118370768,"data_compressed_allocated":1155686400,"data_compressed_original":2311372800,"omap_allocated":972,"internal_metadata":48626740},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.095}]},{"osd":1,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":9.0939999999999994,"5min":31.199000000000002,"15min":58.671999999999997},"min":{"1min":0.747,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":177.846,"5min":924.63300000000004,"15min":924.63300000000004},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.151,"5min":15.670999999999999,"15min":5.9130000000000003},"min":{"1min":0.79300000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.637,"5min":898.86900000000003,"15min":898.86900000000003},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":11.949,"15min":4.7149999999999999},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6020000000000001,"5min":857.78899999999999,"15min":857.78899999999999},"last":1.395},{"interface":"front","average":{"1min":0.95099999999999996,"5min":9.8019999999999996,"15min":4.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.198,"5min":779.38400000000001,"15min":779.38400000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":9.625,"15min":13.391},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.423,"5min":311.68299999999999,"15min":311.68299999999999},"last":1.032},{"interface":"front","average":{"1min":35.929000000000002,"5min":8.1660000000000004,"15min":3.5739999999999998},"min":{"1min":0.83999999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":765.98299999999995,"5min":765.98299999999995,"15min":765.98299999999995},"last":1.4319999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":3.7069999999999999,"15min":1.956},"min":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":239.99199999999999,"15min":239.99199999999999},"last":1.012},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1639999999999999,"15min":1.1579999999999999},"min":{"1min":0.84499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.464,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.141}]},{"osd":6,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2370000000000001,"15min":1.2050000000000001},"min":{"1min":0.73599999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.657,"5min":5.5890000000000004,"15min":5.5890000000000004},"last":1.492},{"interface":"front","average":{"1min":1.113,"5min":1.2110000000000001,"15min":1.282},"min":{"1min":0.86599999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2869999999999999,"15min":1.2809999999999999},"min":{"1min":0.98299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5620000000000001,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":1.236},{"interface":"front","average":{"1min":33.942,"5min":7.8579999999999997,"15min":3.5139999999999998},"min":{"1min":1.0109999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":719.03700000000003,"5min":719.03700000000003,"15min":719.03700000000003},"last":1.5209999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765928,"kb_used_data":751904,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":93605912,"statfs":{"total":96636764160,"available":95852453888,"internally_reserved":0,"allocated":769949696,"data_stored":1055829374,"data_compressed":29380114,"data_compressed_allocated":286253056,"data_compressed_original":572506112,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:39 2021","interfaces":[{"interface":"back","average":{"1min":24.538,"5min":24.538,"15min":24.538},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":474.77499999999998,"5min":474.77499999999998,"15min":474.77499999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96799999999999997,"15min":0.87},"min":{"1min":0.58299999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.2350000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":11.096,"15min":4.2889999999999997},"min":{"1min":0.84999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.518,"5min":732.80700000000002,"15min":732.80700000000002},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":12.396000000000001,"5min":10.401999999999999,"15min":4.2919999999999998},"min":{"1min":0.81599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":225.11799999999999,"5min":649.82899999999995,"15min":649.82899999999995},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.125,"15min":1.056},"min":{"1min":0.81799999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.256,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.2010000000000001}]},{"osd":3,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.1160000000000001,"15min":1.1259999999999999},"min":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4730000000000001,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.27,"15min":1.228},"min":{"1min":0.92300000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7350000000000001,"5min":4.827,"15min":4.827},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":13.199,"15min":16.175999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6000000000000001,"5min":514.74199999999996,"15min":514.74199999999996},"last":1.228},{"interface":"front","average":{"1min":39.335999999999999,"5min":8.8729999999999993,"15min":3.7469999999999999},"min":{"1min":0.83599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":762.10699999999997,"5min":762.10699999999997,"15min":762.10699999999997},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":37.015999999999998,"5min":16.678000000000001,"15min":6.4059999999999997},"min":{"1min":1.0900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":714.803,"5min":714.803,"15min":714.803},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4630000000000001,"15min":1.27},"min":{"1min":1.119,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.8320000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.423,"15min":1.5049999999999999},"min":{"1min":1.0409999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.851,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.282},{"interface":"front","average":{"1min":1.419,"5min":1.6479999999999999,"15min":1.758},"min":{"1min":1.1319999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.96,"5min":9.593,"15min":9.593},"last":1.3340000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509507,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4180812,"kb_used_data":4117700,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":90191028,"statfs":{"total":96636764160,"available":92355612672,"internally_reserved":0,"allocated":4216524800,"data_stored":4766177222,"data_compressed":58393750,"data_compressed_allocated":570441728,"data_compressed_original":1140883456,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:35 2021","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":31.253,"5min":31.253,"15min":31.253},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":729.27700000000004,"5min":729.27700000000004,"15min":729.27700000000004},"last":0.96599999999999997}]},{"osd":1,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":8.0850000000000009,"15min":26.884},"min":{"1min":0.626,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5029999999999999,"5min":684.42700000000002,"15min":684.42700000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.26,"15min":1.1619999999999999},"min":{"1min":0.69699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.319,"5min":6.1360000000000001,"15min":6.1360000000000001},"last":1.157}]},{"osd":2,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.167,"15min":1.234},"min":{"1min":0.91800000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.383,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":8.3000000000000007,"15min":3.6179999999999999},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":607.71000000000004,"15min":607.71000000000004},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":29.053999999999998,"5min":6.9160000000000004,"15min":3.1040000000000001},"min":{"1min":0.77700000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":501.613,"5min":501.613,"15min":501.613},"last":1.325},{"interface":"front","average":{"1min":1.1919999999999999,"5min":6.8719999999999999,"15min":3.0489999999999999},"min":{"1min":0.88500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4199999999999999,"5min":480.87299999999999,"15min":480.87299999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:13 2021","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":4.6059999999999999,"15min":2.4380000000000002},"min":{"1min":0.71799999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.6439999999999999,"5min":263.584,"15min":263.584},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.238,"15min":1.3939999999999999},"min":{"1min":0.82699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6200000000000001,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":1.423}]},{"osd":5,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.27,"15min":1.3400000000000001},"min":{"1min":1.0049999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6020000000000001,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":1.27},{"interface":"front","average":{"1min":1.25,"5min":1.569,"15min":1.492},"min":{"1min":1.012,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.5409999999999999,"5min":7.3140000000000001,"15min":7.3140000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4159999999999999,"15min":1.3380000000000001},"min":{"1min":0.91100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.581,"5min":10.795,"15min":10.795},"last":1.655},{"interface":"front","average":{"1min":1.278,"5min":1.365,"15min":1.3839999999999999},"min":{"1min":0.99299999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.722,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.383}]}]}]}} , 2021-01-29T13:57:47.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T13:57:47.465 INFO:teuthology.orchestra.run.smithi183.stdout: Ignoring malparsed backtrace: 2021-01-29T13:58:10.671 INFO:teuthology.orchestra.run.smithi183.stdout:} , 2021-01-29T13:58:10.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 179, in _raise_for_status , raise CommandCrashedError(command=self.command) , teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 10000 --objects 6600 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 1200 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' Ignoring malparsed backtrace: 2021-01-29T13:59:00.217 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2021-01-29T14:01:20.328 INFO:tasks.ceph:Archiving logs... , 2021-01-29T14:01:20.329 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/kchai-2021-01-29_12:57:23-rados-wip-kefu-testing-2021-01-29-1713-distro-basic-smithi/5840036/remote/smithi183/log Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 368, in archive , yield Ignoring malparsed backtrace: ceph version 17.0.0-297-g27dc1eb3 (27dc1eb32728beb0c69aa65131bc609ef680c0aa) quincy (dev) , 1: (ceph::__ceph_abort(char const*, int, char const*, std::__cxx11::basic_string, std::allocator > const&)+0xe5) [0x7f30135d315a] , 2: (WriteOp::_finish(TestOp::CallbackInfo*)+0x666) [0x55fd1cf11fe6] Ignoring malparsed backtrace: 2021-01-29T13:55:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:ERROR: (22) Invalid argument , 2021-01-29T13:55:49.136 INFO:teuthology.orchestra.run.smithi142.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. , 2021-01-29T13:55:49.151 DEBUG:teuthology.orchestra.run.smithi142:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops Ignoring malparsed backtrace: 2021-01-29T13:56:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:oload 1000 , 2021-01-29T13:56:38.516 INFO:teuthology.orchestra.run.smithi183.stdout:max_change 3 , 2021-01-29T13:56:38.517 INFO:teuthology.orchestra.run.smithi183.stdout:max_change_osds 4 Ignoring malparsed backtrace: set osd.3 primary-affinity to 1 (8655362) , 2021-01-29T13:56:51.495 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 , 2021-01-29T13:56:52.480+0000 7f8f78ab0700 -1 osd.2 132 handle_osd_map injecting map crc failure Ignoring malparsed backtrace: 2021-01-29T13:57:08.429 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2021-01-29T13:57:06.667864+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20305121604,"num_objects":6822,"num_object_clones":0,"num_object_copies":19368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":2076,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":25509,"num_write_kb":14727220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2477,"num_bytes_recovered":5602499186,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15129,"ondisk_log_size":15129,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":24946968,"kb_used_data":24625140,"kb_used_omap":1,"kb_used_meta":321598,"kb_avail":730027752,"statfs":{"total":773094113280,"available":747548418048,"internally_reserved":0,"allocated":25216143360,"data_stored":30051268153,"data_compressed":504955484,"data_compressed_allocated":4927905792,"data_compressed_original":9855811584,"omap_allocated":1944,"internal_metadata":329316456},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-170,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":170,"num_bytes_recovered":394035071,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.133172"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"145","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847683+0000","last_change":"2021-01-29T13:55:57.162929+0000","last_active":"2021-01-29T13:57:00.847683+0000","last_peered":"2021-01-29T13:57:00.847683+0000","last_clean":"2021-01-29T13:57:00.847683+0000","last_became_active":"2021-01-29T13:52:24.188931+0000","last_became_peered":"2021-01-29T13:52:24.188931+0000","last_unstale":"2021-01-29T13:57:00.847683+0000","last_undegraded":"2021-01-29T13:57:00.847683+0000","last_fullsized":"2021-01-29T13:57:00.847683+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:57.162808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:57.162808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"120'6449","reported_seq":"8595","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.652824+0000","last_change":"2021-01-29T13:55:45.625490+0000","last_active":"2021-01-29T13:57:00.652824+0000","last_peered":"2021-01-29T13:57:00.652824+0000","last_clean":"2021-01-29T13:57:00.652824+0000","last_became_active":"2021-01-29T13:52:39.830011+0000","last_became_peered":"2021-01-29T13:52:39.830011+0000","last_unstale":"2021-01-29T13:57:00.652824+0000","last_undegraded":"2021-01-29T13:57:00.652824+0000","last_fullsized":"2021-01-29T13:57:00.652824+0000","mapping_epoch":26,"log_start":"72'3403","ondisk_log_start":"72'3403","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6250","last_scrub_stamp":"2021-01-29T13:55:45.625379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:45.625379+0000","log_size":3046,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2928382292,"num_objects":986,"num_object_clones":0,"num_object_copies":1972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2501,"num_read_kb":1252,"num_write":5879,"num_write_kb":1639641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3315,"num_flush":761,"num_flush_kb":2192275,"num_evict":269,"num_evict_kb":760560,"num_promote":1249,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"112","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.552366+0000","last_change":"2021-01-29T13:55:42.661441+0000","last_active":"2021-01-29T13:57:00.552366+0000","last_peered":"2021-01-29T13:57:00.552366+0000","last_clean":"2021-01-29T13:57:00.552366+0000","last_became_active":"2021-01-29T13:53:29.493255+0000","last_became_peered":"2021-01-29T13:53:29.493255+0000","last_unstale":"2021-01-29T13:57:00.552366+0000","last_undegraded":"2021-01-29T13:57:00.552366+0000","last_fullsized":"2021-01-29T13:57:00.552366+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:42.661371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:42.661371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"120'671","reported_seq":"1016","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:05.597246+0000","last_change":"2021-01-29T13:56:47.680232+0000","last_active":"2021-01-29T13:57:05.597246+0000","last_peered":"2021-01-29T13:57:05.597246+0000","last_clean":"2021-01-29T13:56:36.386610+0000","last_became_active":"2021-01-29T13:56:47.674484+0000","last_became_peered":"2021-01-29T13:56:47.674484+0000","last_unstale":"2021-01-29T13:57:05.597246+0000","last_undegraded":"2021-01-29T13:57:05.597246+0000","last_fullsized":"2021-01-29T13:57:05.597246+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'570","last_scrub_stamp":"2021-01-29T13:55:44.911108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:44.911108+0000","log_size":671,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2038945493,"num_objects":671,"num_object_clones":0,"num_object_copies":2684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":590,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":1991482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":601,"num_bytes_recovered":1847436236,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[6,2,4,7],"avail_no_missing":["6(0)","2(1)","4(2)","7(3)"],"object_location_counts":[{"shards":"2(1),4(2),6(0),7(3)","objects":671}],"blocked_by":[],"up_primary":0,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"142","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:01.550240+0000","last_change":"2021-01-29T13:57:01.550191+0000","last_active":"2021-01-29T13:57:01.550240+0000","last_peered":"2021-01-29T13:57:01.550240+0000","last_clean":"2021-01-29T13:57:01.550240+0000","last_became_active":"2021-01-29T13:52:23.765595+0000","last_became_peered":"2021-01-29T13:52:23.765595+0000","last_unstale":"2021-01-29T13:57:01.550240+0000","last_undegraded":"2021-01-29T13:57:01.550240+0000","last_fullsized":"2021-01-29T13:57:01.550240+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:57:01.550087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.550087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"117'710","reported_seq":"880","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847676+0000","last_change":"2021-01-29T13:56:09.328006+0000","last_active":"2021-01-29T13:57:00.847676+0000","last_peered":"2021-01-29T13:57:00.847676+0000","last_clean":"2021-01-29T13:57:00.847676+0000","last_became_active":"2021-01-29T13:53:09.969063+0000","last_became_peered":"2021-01-29T13:53:09.969063+0000","last_unstale":"2021-01-29T13:57:00.847676+0000","last_undegraded":"2021-01-29T13:57:00.847676+0000","last_fullsized":"2021-01-29T13:57:00.847676+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'710","last_scrub_stamp":"2021-01-29T13:56:09.327903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:56:09.327903+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2107977089,"num_objects":710,"num_object_clones":0,"num_object_copies":2840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":2058922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"155","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.849258+0000","last_change":"2021-01-29T13:56:59.467725+0000","last_active":"2021-01-29T13:57:00.849258+0000","last_peered":"2021-01-29T13:57:00.849258+0000","last_clean":"2021-01-29T13:57:00.849258+0000","last_became_active":"2021-01-29T13:52:24.188578+0000","last_became_peered":"2021-01-29T13:52:24.188578+0000","last_unstale":"2021-01-29T13:57:00.849258+0000","last_undegraded":"2021-01-29T13:57:00.849258+0000","last_fullsized":"2021-01-29T13:57:00.849258+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:59.467654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:59.467654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"142'4","reported_seq":"152","reported_epoch":"142","state":"active+clean","last_fresh":"2021-01-29T13:57:01.982145+0000","last_change":"2021-01-29T13:57:01.982145+0000","last_active":"2021-01-29T13:57:01.982145+0000","last_peered":"2021-01-29T13:57:01.982145+0000","last_clean":"2021-01-29T13:57:01.982145+0000","last_became_active":"2021-01-29T13:52:20.655015+0000","last_became_peered":"2021-01-29T13:52:20.655015+0000","last_unstale":"2021-01-29T13:57:01.982145+0000","last_undegraded":"2021-01-29T13:57:01.982145+0000","last_fullsized":"2021-01-29T13:57:01.982145+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'4","last_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_deep_scrub":"142'4","last_deep_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.982073+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"120'761","reported_seq":"2454","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:03.004043+0000","last_change":"2021-01-29T13:56:48.363777+0000","last_active":"2021-01-29T13:57:03.004043+0000","last_peered":"2021-01-29T13:57:03.004043+0000","last_clean":"2021-01-29T13:56:36.386422+0000","last_became_active":"2021-01-29T13:56:48.362095+0000","last_became_peered":"2021-01-29T13:56:48.362095+0000","last_unstale":"2021-01-29T13:57:03.004043+0000","last_undegraded":"2021-01-29T13:57:03.004043+0000","last_fullsized":"2021-01-29T13:57:03.004043+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'761","last_scrub_stamp":"2021-01-29T13:55:53.981049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:53.981049+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244508217,"num_objects":761,"num_object_clones":0,"num_object_copies":3044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":637,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":2192275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":747,"num_bytes_recovered":2213000897,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,0],"acting":[4,2,7,1],"avail_no_missing":["4(0)","1(3)","2(1)","7(2)"],"object_location_counts":[{"shards":"1(3),2(1),4(0),7(2)","objects":761}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"144","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.849237+0000","last_change":"2021-01-29T13:56:41.371116+0000","last_active":"2021-01-29T13:57:00.849237+0000","last_peered":"2021-01-29T13:57:00.849237+0000","last_clean":"2021-01-29T13:57:00.849237+0000","last_became_active":"2021-01-29T13:52:23.765671+0000","last_became_peered":"2021-01-29T13:52:23.765671+0000","last_unstale":"2021-01-29T13:57:00.849237+0000","last_undegraded":"2021-01-29T13:57:00.849237+0000","last_fullsized":"2021-01-29T13:57:00.849237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:41.371025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:41.371025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"118'720","reported_seq":"886","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.652827+0000","last_change":"2021-01-29T13:55:59.202455+0000","last_active":"2021-01-29T13:57:00.652827+0000","last_peered":"2021-01-29T13:57:00.652827+0000","last_clean":"2021-01-29T13:57:00.652827+0000","last_became_active":"2021-01-29T13:53:09.587252+0000","last_became_peered":"2021-01-29T13:53:09.587252+0000","last_unstale":"2021-01-29T13:57:00.652827+0000","last_undegraded":"2021-01-29T13:57:00.652827+0000","last_fullsized":"2021-01-29T13:57:00.652827+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'720","last_scrub_stamp":"2021-01-29T13:55:59.202349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:59.202349+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2156154079,"num_objects":720,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":2105989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"120'5986","reported_seq":"10252","reported_epoch":"142","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:05.668638+0000","last_change":"2021-01-29T13:56:47.680268+0000","last_active":"2021-01-29T13:57:05.668638+0000","last_peered":"2021-01-29T13:57:05.668638+0000","last_clean":"2021-01-29T13:56:36.386614+0000","last_became_active":"2021-01-29T13:56:47.673885+0000","last_became_peered":"2021-01-29T13:56:47.673885+0000","last_unstale":"2021-01-29T13:57:05.668638+0000","last_undegraded":"2021-01-29T13:57:05.668638+0000","last_fullsized":"2021-01-29T13:57:05.668638+0000","mapping_epoch":127,"log_start":"71'2904","ondisk_log_start":"71'2904","created":26,"last_epoch_clean":116,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'5955","last_scrub_stamp":"2021-01-29T13:55:51.275882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:51.275882+0000","log_size":3082,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2947693900,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":849,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2316,"num_read_kb":1158,"num_write":5435,"num_write_kb":1544566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1129,"num_bytes_recovered":1542062053,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2771,"num_flush":671,"num_flush_kb":1991482,"num_evict":178,"num_evict_kb":526959,"num_promote":1172,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,2],"avail_no_missing":["6","2"],"object_location_counts":[{"shards":"2,6","objects":985}],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"157","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:01.451085+0000","last_change":"2021-01-29T13:57:01.451085+0000","last_active":"2021-01-29T13:57:01.451085+0000","last_peered":"2021-01-29T13:57:01.451085+0000","last_clean":"2021-01-29T13:57:01.451085+0000","last_became_active":"2021-01-29T13:53:09.377717+0000","last_became_peered":"2021-01-29T13:53:09.377717+0000","last_unstale":"2021-01-29T13:57:01.451085+0000","last_undegraded":"2021-01-29T13:57:01.451085+0000","last_fullsized":"2021-01-29T13:57:01.451085+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:33.131622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:33.131622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"140","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.847720+0000","last_change":"2021-01-29T13:56:53.807344+0000","last_active":"2021-01-29T13:57:00.847720+0000","last_peered":"2021-01-29T13:57:00.847720+0000","last_clean":"2021-01-29T13:57:00.847720+0000","last_became_active":"2021-01-29T13:52:40.828334+0000","last_became_peered":"2021-01-29T13:52:40.828334+0000","last_unstale":"2021-01-29T13:57:00.847720+0000","last_undegraded":"2021-01-29T13:57:00.847720+0000","last_fullsized":"2021-01-29T13:57:00.847720+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:53.807251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:53.807251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"117'6273","reported_seq":"8319","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.552349+0000","last_change":"2021-01-29T13:55:55.445357+0000","last_active":"2021-01-29T13:57:00.552349+0000","last_peered":"2021-01-29T13:57:00.552349+0000","last_clean":"2021-01-29T13:57:00.552349+0000","last_became_active":"2021-01-29T13:53:09.369472+0000","last_became_peered":"2021-01-29T13:53:09.369472+0000","last_unstale":"2021-01-29T13:57:00.552349+0000","last_undegraded":"2021-01-29T13:57:00.552349+0000","last_fullsized":"2021-01-29T13:57:00.552349+0000","mapping_epoch":42,"log_start":"71'3203","ondisk_log_start":"71'3203","created":26,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6273","last_scrub_stamp":"2021-01-29T13:55:55.445229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.445229+0000","log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2935339657,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":2414,"num_read_kb":1208,"num_write":5647,"num_write_kb":1593121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3044,"num_flush":710,"num_flush_kb":2058922,"num_evict":219,"num_evict_kb":640347,"num_promote":1206,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"24","reported_epoch":"141","state":"active+clean","last_fresh":"2021-01-29T13:57:00.611252+0000","last_change":"2021-01-29T13:56:46.442031+0000","last_active":"2021-01-29T13:57:00.611252+0000","last_peered":"2021-01-29T13:57:00.611252+0000","last_clean":"2021-01-29T13:57:00.611252+0000","last_became_active":"2021-01-29T13:56:46.441589+0000","last_became_peered":"2021-01-29T13:56:46.441589+0000","last_unstale":"2021-01-29T13:57:00.611252+0000","last_undegraded":"2021-01-29T13:57:00.611252+0000","last_fullsized":"2021-01-29T13:57:00.611252+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:55.134762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.134762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"118'6270","reported_seq":"8351","reported_epoch":"142","state":"active+clean","last_fresh":"2021-01-29T13:57:04.235378+0000","last_change":"2021-01-29T13:57:04.235378+0000","last_active":"2021-01-29T13:57:04.235378+0000","last_peered":"2021-01-29T13:57:04.235378+0000","last_clean":"2021-01-29T13:57:04.235378+0000","last_became_active":"2021-01-29T13:52:39.823642+0000","last_became_peered":"2021-01-29T13:52:39.823642+0000","last_unstale":"2021-01-29T13:57:04.235378+0000","last_undegraded":"2021-01-29T13:57:04.235378+0000","last_fullsized":"2021-01-29T13:57:04.235378+0000","mapping_epoch":26,"log_start":"71'3205","ondisk_log_start":"71'3205","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'6270","last_scrub_stamp":"2021-01-29T13:57:04.235268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:57:04.235268+0000","log_size":3065,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2946120877,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2420,"num_read_kb":1212,"num_write":5684,"num_write_kb":1601214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3066,"num_flush":720,"num_flush_kb":2105989,"num_evict":218,"num_evict_kb":643724,"num_promote":1208,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":11757536726,"num_objects":3958,"num_object_clones":0,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":849,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":22645,"num_write_kb":6378542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1129,"num_bytes_recovered":1542062053,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11918577664,"data_stored":11828415316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12263,"ondisk_log_size":12263,"up":8,"acting":8,"num_store_stats":6},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":8547584878,"num_objects":2862,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":1227,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":8348668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1348,"num_bytes_recovered":4060437133,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13299490816,"data_stored":18228555776,"data_compressed":505072361,"data_compressed_allocated":4929064960,"data_compressed_original":9858129920,"omap_allocated":0,"internal_metadata":0},"log_size":2862,"ondisk_log_size":2862,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":124,"seq":532575944712,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1942776,"kb_used_data":1921328,"kb_used_omap":0,"kb_used_meta":21439,"kb_avail":92429064,"statfs":{"total":96636764160,"available":94647361536,"internally_reserved":0,"allocated":1967439872,"data_stored":2257930354,"data_compressed":30754208,"data_compressed_allocated":299577344,"data_compressed_original":599154688,"omap_allocated":972,"internal_metadata":21953588},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.80600000000000005}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.90500000000000003}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.84199999999999997}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.86499999999999999}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.1870000000000001}]},{"osd":6,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":1.23}]},{"osd":7,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.98799999999999999}]}]},{"osd":7,"up_from":15,"seq":64424509501,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2311348,"kb_used_data":2281004,"kb_used_omap":0,"kb_used_meta":30336,"kb_avail":92060492,"statfs":{"total":96636764160,"available":94269943808,"internally_reserved":0,"allocated":2335748096,"data_stored":3200465622,"data_compressed":88587048,"data_compressed_allocated":865042432,"data_compressed_original":1730084864,"omap_allocated":0,"internal_metadata":31064064},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:26 2021","interfaces":[{"interface":"back","average":{"1min":51.597999999999999,"5min":29.779,"15min":26.143000000000001},"min":{"1min":0.47499999999999998,"5min":0.47499999999999998,"15min":0.47499999999999998},"max":{"1min":906.00800000000004,"5min":906.00800000000004,"15min":906.00800000000004},"last":1.0289999999999999},{"interface":"front","average":{"1min":1.1040000000000001,"5min":0.95499999999999996,"15min":0.93000000000000005},"min":{"1min":0.61499999999999999,"5min":0.60699999999999998,"15min":0.60699999999999998},"max":{"1min":4.0259999999999998,"5min":4.0259999999999998,"15min":4.0259999999999998},"last":1.3089999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.095,"5min":1.3340000000000001,"15min":1.49},"min":{"1min":0.65800000000000003,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.4410000000000001,"5min":11.195,"15min":11.195},"last":1.272},{"interface":"front","average":{"1min":1.006,"5min":23.977,"15min":32.523000000000003},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.3759999999999999,"5min":777.02499999999998,"15min":777.02499999999998},"last":1.581}]},{"osd":2,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":46.633000000000003,"5min":10.444000000000001,"15min":4.5460000000000003},"min":{"1min":0.62,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":512.423,"5min":512.423,"15min":512.423},"last":0.999},{"interface":"front","average":{"1min":1.1559999999999999,"5min":2.1200000000000001,"15min":1.774},"min":{"1min":0.79300000000000004,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.472,"5min":60.529000000000003,"15min":60.529000000000003},"last":1.3759999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":10.481,"5min":3.0230000000000001,"15min":1.746},"min":{"1min":0.65400000000000003,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":211.47900000000001,"5min":211.47900000000001,"15min":211.47900000000001},"last":1.0549999999999999},{"interface":"front","average":{"1min":1.1930000000000001,"5min":1.46,"15min":1.607},"min":{"1min":0.92300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.4930000000000001,"5min":11.146000000000001,"15min":11.146000000000001},"last":1.4079999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:56:16 2021","interfaces":[{"interface":"back","average":{"1min":1.0129999999999999,"5min":1.264,"15min":1.3380000000000001},"min":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.4299999999999999,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":1.343},{"interface":"front","average":{"1min":1.0229999999999999,"5min":14.401999999999999,"15min":20.280000000000001},"min":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":1.4399999999999999,"5min":391.66699999999997,"15min":391.66699999999997},"last":1.54}]},{"osd":5,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.155,"5min":3.4470000000000001,"15min":2.2829999999999999},"min":{"1min":0.74199999999999999,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.601,"5min":175.83199999999999,"15min":175.83199999999999},"last":1.625},{"interface":"front","average":{"1min":1.105,"5min":1.2549999999999999,"15min":1.2},"min":{"1min":0.77600000000000002,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.526,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":1.6020000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.2609999999999999,"5min":1.5649999999999999,"15min":1.536},"min":{"1min":0.84199999999999997,"5min":0.754,"15min":0.754},"max":{"1min":1.5269999999999999,"5min":10.063000000000001,"15min":10.063000000000001},"last":1.647},{"interface":"front","average":{"1min":1.123,"5min":14.808,"15min":27.946000000000002},"min":{"1min":0.79500000000000004,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":1.4690000000000001,"5min":623.01999999999998,"15min":623.01999999999998},"last":1.754}]}]},{"osd":2,"up_from":15,"seq":64424509500,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5736668,"kb_used_data":5682580,"kb_used_omap":0,"kb_used_meta":54080,"kb_avail":88635172,"statfs":{"total":96636764160,"available":90762416128,"internally_reserved":0,"allocated":5818961920,"data_stored":6956451332,"data_compressed":118712623,"data_compressed_allocated":1158184960,"data_compressed_original":2316369920,"omap_allocated":0,"internal_metadata":55377920},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":29.140000000000001,"15min":33.799999999999997},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":2.012,"5min":565.52099999999996,"15min":565.52099999999996},"last":0.997},{"interface":"front","average":{"1min":1.4910000000000001,"5min":1.0209999999999999,"15min":0.94299999999999995},"min":{"1min":0.72499999999999998,"5min":0.64500000000000002,"15min":0.64500000000000002},"max":{"1min":3.6030000000000002,"5min":3.6030000000000002,"15min":3.6030000000000002},"last":0.77000000000000002}]},{"osd":1,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":40.582999999999998,"5min":17.475000000000001,"15min":6.4610000000000003},"min":{"1min":0.499,"5min":0.499,"15min":0.499},"max":{"1min":676.39099999999996,"5min":721.11000000000001,"15min":721.11000000000001},"last":1.0489999999999999},{"interface":"front","average":{"1min":0.89700000000000002,"5min":21.452999999999999,"15min":7.8179999999999996},"min":{"1min":0.65000000000000002,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.1479999999999999,"5min":1000.376,"15min":1000.376},"last":0.81299999999999994}]},{"osd":3,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":51.539000000000001,"5min":11.381,"15min":4.3440000000000003},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":501.61200000000002,"5min":501.61200000000002,"15min":501.61200000000002},"last":0.70599999999999996},{"interface":"front","average":{"1min":0.85399999999999998,"5min":1.1890000000000001,"15min":1.0640000000000001},"min":{"1min":0.57399999999999995,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.6839999999999999,"5min":6.1870000000000003,"15min":6.1870000000000003},"last":0.78900000000000003}]},{"osd":4,"last update":"Fri Jan 29 13:56:15 2021","interfaces":[{"interface":"back","average":{"1min":1.085,"5min":1.478,"15min":1.53},"min":{"1min":0.72599999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6719999999999999,"5min":3.694,"15min":3.694},"last":1.6160000000000001},{"interface":"front","average":{"1min":1.155,"5min":1.407,"15min":1.3859999999999999},"min":{"1min":0.871,"5min":0.871,"15min":0.871},"max":{"1min":1.7509999999999999,"5min":3.7189999999999999,"15min":3.7189999999999999},"last":1.6479999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":21.327999999999999,"5min":5.8109999999999999,"15min":2.7749999999999999},"min":{"1min":0.73299999999999998,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":183.761,"5min":183.761,"15min":183.761},"last":0.86199999999999999},{"interface":"front","average":{"1min":41.545999999999999,"5min":9.516,"15min":4.0499999999999998},"min":{"1min":0.746,"5min":0.746,"15min":0.746},"max":{"1min":521.02499999999998,"5min":521.02499999999998,"15min":521.02499999999998},"last":1.0289999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.1100000000000001,"5min":1.3720000000000001,"15min":1.3009999999999999},"min":{"1min":0.89900000000000002,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.474,"5min":3.46,"15min":3.46},"last":1.544},{"interface":"front","average":{"1min":1.111,"5min":1.4450000000000001,"15min":1.2809999999999999},"min":{"1min":0.59999999999999998,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4570000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":0.88200000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:56:28 2021","interfaces":[{"interface":"back","average":{"1min":1.3109999999999999,"5min":8.5039999999999996,"15min":3.754},"min":{"1min":0.99099999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":1.7050000000000001,"5min":591.18899999999996,"15min":591.18899999999996},"last":1.5820000000000001},{"interface":"front","average":{"1min":52.493000000000002,"5min":11.779999999999999,"15min":4.8220000000000001},"min":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":923.40099999999995,"5min":923.40099999999995,"15min":923.40099999999995},"last":0.95499999999999996}]}]},{"osd":1,"up_from":15,"seq":64424509501,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2154844,"kb_used_data":2115092,"kb_used_omap":0,"kb_used_meta":39744,"kb_avail":92216996,"statfs":{"total":96636764160,"available":94430203904,"internally_reserved":0,"allocated":2165854208,"data_stored":2457969146,"data_compressed":31021897,"data_compressed_allocated":302632960,"data_compressed_original":605265920,"omap_allocated":0,"internal_metadata":40697856},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:25 2021","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.0349999999999999,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":5.0629999999999997},"last":0.92400000000000004},{"interface":"front","average":{"1min":39.090000000000003,"5min":8.5060000000000002,"15min":3.4079999999999999},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":752.73400000000004,"5min":752.73400000000004,"15min":752.73400000000004},"last":0.54300000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0309999999999999,"5min":22.648,"15min":29.776},"min":{"1min":0.55100000000000005,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":4.2629999999999999,"5min":832.21600000000001,"15min":832.21600000000001},"last":0.83499999999999996},{"interface":"front","average":{"1min":5.2699999999999996,"5min":11.266,"15min":4.4199999999999999},"min":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":84.277000000000001,"5min":899.43399999999997,"15min":899.43399999999997},"last":0.86599999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":0.95699999999999996,"5min":1.306,"15min":1.099},"min":{"1min":0.47299999999999998,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":2.1499999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.90500000000000003},{"interface":"front","average":{"1min":0.77500000000000002,"5min":5.548,"15min":9.8919999999999995},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.5489999999999999,"5min":244.60900000000001,"15min":244.60900000000001},"last":0.68899999999999995}]},{"osd":4,"last update":"Fri Jan 29 13:56:15 2021","interfaces":[{"interface":"back","average":{"1min":1.111,"5min":1.4610000000000001,"15min":1.633},"min":{"1min":0.63800000000000001,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.5960000000000001,"5min":5.242,"15min":5.242},"last":0.71399999999999997},{"interface":"front","average":{"1min":1.202,"5min":1.9259999999999999,"15min":2.1680000000000001},"min":{"1min":0.77500000000000002,"5min":0.77500000000000002,"15min":0.77500000000000002},"max":{"1min":2.5760000000000001,"5min":6.2590000000000003,"15min":6.2590000000000003},"last":1.024}]},{"osd":5,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.0609999999999999,"5min":14.667999999999999,"15min":5.694},"min":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":2.0350000000000001,"5min":701.73400000000004,"15min":701.73400000000004},"last":0.88400000000000001},{"interface":"front","average":{"1min":1.133,"5min":1.3400000000000001,"15min":1.26},"min":{"1min":0.75700000000000001,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.917,"5min":5.758,"15min":5.758},"last":0.76600000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.4419999999999999,"15min":1.3440000000000001},"min":{"1min":0.72299999999999998,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":1.9139999999999999,"5min":5.7199999999999998,"15min":5.7199999999999998},"last":1.0449999999999999},{"interface":"front","average":{"1min":1.258,"5min":4.0110000000000001,"15min":6.2149999999999999},"min":{"1min":0.72299999999999998,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.6230000000000002,"5min":132.35300000000001,"15min":132.35300000000001},"last":1.0589999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:56:29 2021","interfaces":[{"interface":"back","average":{"1min":37.829999999999998,"5min":8.8330000000000002,"15min":3.823},"min":{"1min":0.81299999999999994,"5min":0.752,"15min":0.752},"max":{"1min":696.96400000000006,"5min":696.96400000000006,"15min":696.96400000000006},"last":0.94599999999999995},{"interface":"front","average":{"1min":1.2490000000000001,"5min":1.4990000000000001,"15min":1.413},"min":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":2.0369999999999999,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":0.85199999999999998}]}]},{"osd":3,"up_from":15,"seq":64424509501,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3443244,"kb_used_data":3391652,"kb_used_omap":0,"kb_used_meta":51584,"kb_avail":90928596,"statfs":{"total":96636764160,"available":93110882304,"internally_reserved":0,"allocated":3473051648,"data_stored":3742620723,"data_compressed":29735076,"data_compressed_allocated":290086912,"data_compressed_original":580173824,"omap_allocated":0,"internal_metadata":52822016},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:26 2021","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":0.93999999999999995,"15min":0.90400000000000003},"min":{"1min":0.67500000000000004,"5min":0.61699999999999999,"15min":0.61699999999999999},"max":{"1min":2.617,"5min":2.617,"15min":2.617},"last":0.81699999999999995},{"interface":"front","average":{"1min":1.135,"5min":3.3719999999999999,"15min":3.7450000000000001},"min":{"1min":0.56999999999999995,"5min":0.56999999999999995,"15min":0.56999999999999995},"max":{"1min":3.9620000000000002,"5min":60.329000000000001,"15min":60.329000000000001},"last":1.0529999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":0.77200000000000002,"5min":0.97599999999999998,"15min":0.91300000000000003},"min":{"1min":0.497,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.0109999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.63200000000000001},{"interface":"front","average":{"1min":0.82699999999999996,"5min":10.324,"15min":4.0970000000000004},"min":{"1min":0.63800000000000001,"5min":0.496,"15min":0.496},"max":{"1min":1.0629999999999999,"5min":977.78200000000004,"15min":977.78200000000004},"last":0.66900000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":0.89200000000000002,"5min":1.208,"15min":1.0880000000000001},"min":{"1min":0.61099999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.22,"5min":5.7539999999999996,"15min":5.7539999999999996},"last":0.74199999999999999},{"interface":"front","average":{"1min":1.018,"5min":1.383,"15min":1.4339999999999999},"min":{"1min":0.73199999999999998,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.4870000000000001,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":0.96899999999999997}]},{"osd":4,"last update":"Fri Jan 29 13:56:11 2021","interfaces":[{"interface":"back","average":{"1min":0.95099999999999996,"5min":11.106,"15min":4.5620000000000003},"min":{"1min":0.70799999999999996,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.3979999999999999,"5min":916.09500000000003,"15min":916.09500000000003},"last":0.71099999999999997},{"interface":"front","average":{"1min":1.1479999999999999,"5min":11.696999999999999,"15min":4.8819999999999997},"min":{"1min":0.82099999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.593,"5min":977.91499999999996,"15min":977.91499999999996},"last":0.92900000000000005}]},{"osd":5,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1779999999999999,"5min":6.9089999999999998,"15min":3.1429999999999998},"min":{"1min":0.72799999999999998,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.8160000000000001,"5min":503.93000000000001,"15min":503.93000000000001},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.077,"5min":6.79,"15min":3.0230000000000001},"min":{"1min":0.751,"5min":0.751,"15min":0.751},"max":{"1min":1.3799999999999999,"5min":503.74299999999999,"15min":503.74299999999999},"last":1.141}]},{"osd":6,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.347,"5min":1.4490000000000001,"15min":1.351},"min":{"1min":0.874,"5min":0.751,"15min":0.751},"max":{"1min":3.2930000000000001,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.0249999999999999},{"interface":"front","average":{"1min":1.339,"5min":19.396999999999998,"15min":37.238999999999997},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":3.3690000000000002,"5min":851.89099999999996,"15min":851.89099999999996},"last":1.173}]},{"osd":7,"last update":"Fri Jan 29 13:56:30 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.5609999999999999,"15min":1.5069999999999999},"min":{"1min":0.90800000000000003,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.613,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":1.0109999999999999},{"interface":"front","average":{"1min":1.3859999999999999,"5min":1.8300000000000001,"15min":1.966},"min":{"1min":1.0629999999999999,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.635,"5min":15.597,"15min":15.597},"last":1.038}]}]},{"osd":4,"up_from":42,"seq":180388626482,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4411588,"kb_used_data":4363992,"kb_used_omap":0,"kb_used_meta":47423,"kb_avail":89960252,"statfs":{"total":96636764160,"available":92119298048,"internally_reserved":0,"allocated":4468727808,"data_stored":5613881037,"data_compressed":118370768,"data_compressed_allocated":1155686400,"data_compressed_original":2311372800,"omap_allocated":972,"internal_metadata":48561204},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:12 2021","interfaces":[{"interface":"back","average":{"1min":1.038,"5min":1.038,"15min":1.038},"min":{"1min":0.45900000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":4.2450000000000001,"5min":4.2450000000000001,"15min":4.2450000000000001},"last":0.746},{"interface":"front","average":{"1min":1.0660000000000001,"5min":1.0660000000000001,"15min":1.0660000000000001},"min":{"1min":0.58399999999999996,"5min":0.58399999999999996,"15min":0.58399999999999996},"max":{"1min":4.1589999999999998,"5min":4.1589999999999998,"15min":4.1589999999999998},"last":1.141}]},{"osd":1,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1180000000000001,"5min":43.862000000000002,"15min":62.893000000000001},"min":{"1min":0.76800000000000002,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":2.6850000000000001,"5min":924.63300000000004,"15min":924.63300000000004},"last":1.008},{"interface":"front","average":{"1min":74.046000000000006,"5min":15.648,"15min":5.9059999999999997},"min":{"1min":0.84299999999999997,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":898.86900000000003,"5min":898.86900000000003,"15min":898.86900000000003},"last":1.2090000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":0.95899999999999996,"5min":11.952,"15min":4.7160000000000002},"min":{"1min":0.745,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.3149999999999999,"5min":857.78899999999999,"15min":857.78899999999999},"last":1.1679999999999999},{"interface":"front","average":{"1min":44.206000000000003,"5min":9.843,"15min":4.0510000000000002},"min":{"1min":0.68600000000000005,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":779.38400000000001,"5min":779.38400000000001,"15min":779.38400000000001},"last":0.78100000000000003}]},{"osd":3,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0620000000000001,"5min":12.48,"15min":14.343},"min":{"1min":0.754,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":2.738,"5min":311.68299999999999,"15min":311.68299999999999},"last":1.079},{"interface":"front","average":{"1min":1.028,"5min":1.236,"15min":1.264},"min":{"1min":0.71699999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":1.4359999999999999,"5min":3.6539999999999999,"15min":3.6539999999999999},"last":1.2509999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":0.92100000000000004,"5min":3.7309999999999999,"15min":1.964},"min":{"1min":0.55700000000000005,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.5109999999999999,"5min":239.99199999999999,"15min":239.99199999999999},"last":0.81000000000000005},{"interface":"front","average":{"1min":1.0669999999999999,"5min":1.171,"15min":1.1599999999999999},"min":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":3.1749999999999998,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.03}]},{"osd":6,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.081,"5min":1.238,"15min":1.206},"min":{"1min":0.72499999999999998,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":2.7789999999999999,"5min":5.5890000000000004,"15min":5.5890000000000004},"last":1.2829999999999999},{"interface":"front","average":{"1min":1.0940000000000001,"5min":1.252,"15min":1.296},"min":{"1min":0.67600000000000005,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":2.657,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":0.91600000000000004}]},{"osd":7,"last update":"Fri Jan 29 13:56:18 2021","interfaces":[{"interface":"back","average":{"1min":1.224,"5min":1.3,"15min":1.286},"min":{"1min":0.91200000000000003,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":2.988,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":1.1120000000000001},{"interface":"front","average":{"1min":1.1799999999999999,"5min":1.3380000000000001,"15min":1.3400000000000001},"min":{"1min":0.96099999999999997,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.635,"5min":3.6699999999999999,"15min":3.6699999999999999},"last":1.357}]}]},{"osd":5,"up_from":15,"seq":64424509500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765812,"kb_used_data":751852,"kb_used_omap":0,"kb_used_meta":13952,"kb_avail":93606028,"statfs":{"total":96636764160,"available":95852572672,"internally_reserved":0,"allocated":769896448,"data_stored":1055801421,"data_compressed":29380114,"data_compressed_allocated":286253056,"data_compressed_original":572506112,"omap_allocated":0,"internal_metadata":14286848},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0029999999999999,"5min":0.83999999999999997,"15min":0.81299999999999994},"min":{"1min":0.44600000000000001,"5min":0.44600000000000001,"15min":0.44600000000000001},"max":{"1min":2.3250000000000002,"5min":2.3250000000000002,"15min":2.3250000000000002},"last":1.079},{"interface":"front","average":{"1min":1.4410000000000001,"5min":1.101,"15min":1.044},"min":{"1min":0.65600000000000003,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":4.8410000000000002,"5min":4.8410000000000002,"15min":4.8410000000000002},"last":1.306}]},{"osd":1,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.0860000000000001,"5min":0.93600000000000005,"15min":0.85999999999999999},"min":{"1min":0.68500000000000005,"5min":0.498,"15min":0.498},"max":{"1min":2.3690000000000002,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":1.1140000000000001},{"interface":"front","average":{"1min":51.244999999999997,"5min":11.042999999999999,"15min":4.2709999999999999},"min":{"1min":0.82999999999999996,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":732.80700000000002,"5min":732.80700000000002,"15min":732.80700000000002},"last":1.365}]},{"osd":2,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.1739999999999999,"5min":8.1699999999999999,"15min":3.548},"min":{"1min":0.73599999999999999,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":2.161,"5min":649.82899999999995,"15min":649.82899999999995},"last":1.6950000000000001},{"interface":"front","average":{"1min":1.095,"5min":1.1180000000000001,"15min":1.054},"min":{"1min":0.70699999999999996,"5min":0.623,"15min":0.623},"max":{"1min":2.4169999999999998,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.145}]},{"osd":3,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":0.91700000000000004,"5min":1.137,"15min":1.133},"min":{"1min":0.626,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.2829999999999999,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":1.3360000000000001},{"interface":"front","average":{"1min":1.0409999999999999,"5min":1.274,"15min":1.23},"min":{"1min":0.69199999999999995,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":2.1200000000000001,"5min":4.827,"15min":4.827},"last":1.7350000000000001}]},{"osd":4,"last update":"Fri Jan 29 13:56:17 2021","interfaces":[{"interface":"back","average":{"1min":28.036000000000001,"5min":16.495999999999999,"15min":17.274999999999999},"min":{"1min":0.73199999999999998,"5min":0.73199999999999998,"15min":0.73199999999999998},"max":{"1min":514.74199999999996,"5min":514.74199999999996,"15min":514.74199999999996},"last":1.3879999999999999},{"interface":"front","average":{"1min":1.2330000000000001,"5min":1.2430000000000001,"15min":1.204},"min":{"1min":0.86699999999999999,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":2.266,"5min":4.4359999999999999,"15min":4.4359999999999999},"last":1.7689999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.2490000000000001,"5min":9.5289999999999999,"15min":4.0229999999999997},"min":{"1min":0.81499999999999995,"5min":0.622,"15min":0.622},"max":{"1min":2.3039999999999998,"5min":520.71799999999996,"15min":520.71799999999996},"last":1.804},{"interface":"front","average":{"1min":1.345,"5min":1.421,"15min":1.256},"min":{"1min":0.84399999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":2.3929999999999998,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":1.8320000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:56:20 2021","interfaces":[{"interface":"back","average":{"1min":1.153,"5min":1.4710000000000001,"15min":1.5209999999999999},"min":{"1min":0.92700000000000005,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.3420000000000001,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.4039999999999999},{"interface":"front","average":{"1min":1.383,"5min":1.7270000000000001,"15min":1.7849999999999999},"min":{"1min":1.0049999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":2.3319999999999999,"5min":9.593,"15min":9.593},"last":1.96}]}]},{"osd":6,"up_from":15,"seq":64424509500,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4180688,"kb_used_data":4117640,"kb_used_omap":0,"kb_used_meta":63040,"kb_avail":90191152,"statfs":{"total":96636764160,"available":92355739648,"internally_reserved":0,"allocated":4216463360,"data_stored":4766148518,"data_compressed":58393750,"data_compressed_allocated":570441728,"data_compressed_original":1140883456,"omap_allocated":0,"internal_metadata":64552960},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:20 2021","interfaces":[{"interface":"back","average":{"1min":1.367,"5min":1.379,"15min":1.381},"min":{"1min":0.501,"5min":0.501,"15min":0.501},"max":{"1min":3.0899999999999999,"5min":5.8380000000000001,"15min":5.8380000000000001},"last":0.79000000000000004},{"interface":"front","average":{"1min":1.286,"5min":1.012,"15min":0.96599999999999997},"min":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"max":{"1min":7.3810000000000002,"5min":7.3810000000000002,"15min":7.3810000000000002},"last":0.50800000000000001}]},{"osd":1,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.0449999999999999,"5min":15.146000000000001,"15min":29.238},"min":{"1min":0.65400000000000003,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.353,"5min":684.42700000000002,"15min":684.42700000000002},"last":0.64700000000000002},{"interface":"front","average":{"1min":0.96599999999999997,"5min":1.2849999999999999,"15min":1.1699999999999999},"min":{"1min":0.58899999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.306,"5min":6.1360000000000001,"15min":6.1360000000000001},"last":0.755}]},{"osd":2,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.032,"5min":1.1919999999999999,"15min":1.242},"min":{"1min":0.498,"5min":0.498,"15min":0.498},"max":{"1min":1.492,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":1.133},{"interface":"front","average":{"1min":36.773000000000003,"5min":8.3480000000000008,"15min":3.6339999999999999},"min":{"1min":0.68799999999999994,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":607.71000000000004,"5min":607.71000000000004,"15min":607.71000000000004},"last":0.67700000000000005}]},{"osd":3,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":0.94699999999999995,"5min":1.345,"15min":1.2470000000000001},"min":{"1min":0.66800000000000004,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":1.1779999999999999,"5min":6.048,"15min":6.048},"last":200.50399999999999},{"interface":"front","average":{"1min":29.335999999999999,"5min":6.8609999999999998,"15min":3.0449999999999999},"min":{"1min":0.83699999999999997,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":480.87299999999999,"5min":480.87299999999999,"15min":480.87299999999999},"last":1.21}]},{"osd":4,"last update":"Fri Jan 29 13:56:12 2021","interfaces":[{"interface":"back","average":{"1min":17.359999999999999,"5min":4.6619999999999999,"15min":2.456},"min":{"1min":0.629,"5min":0.62,"15min":0.62},"max":{"1min":263.584,"5min":263.584,"15min":263.584},"last":1.173},{"interface":"front","average":{"1min":1.0960000000000001,"5min":1.3069999999999999,"15min":1.417},"min":{"1min":0.78900000000000003,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.474,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":0.82699999999999996}]},{"osd":5,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1579999999999999,"5min":1.2969999999999999,"15min":1.349},"min":{"1min":0.86499999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.496,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":1.034},{"interface":"front","average":{"1min":1.1240000000000001,"5min":1.6100000000000001,"15min":1.506},"min":{"1min":0.96499999999999997,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.3759999999999999,"5min":7.3140000000000001,"15min":7.3140000000000001},"last":1.052}]},{"osd":7,"last update":"Fri Jan 29 13:56:22 2021","interfaces":[{"interface":"back","average":{"1min":1.1950000000000001,"5min":1.4159999999999999,"15min":1.3380000000000001},"min":{"1min":0.90100000000000002,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.655,"5min":10.795,"15min":10.795},"last":1.375},{"interface":"front","average":{"1min":1.2110000000000001,"5min":1.3879999999999999,"15min":1.3919999999999999},"min":{"1min":0.85899999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.609,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":0.99299999999999999}]}]}]}} , 2021-01-29T13:57:11.433 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T13:57:11.716 INFO:teuthology.orchestra.run.smithi183.stdout: Ignoring malparsed backtrace: 2021-01-29T13:57:44.175 INFO:teuthology.orchestra.run.smithi183.stdout:{"pg_ready":true,"pg_map":{"version":301,"stamp":"2021-01-29T13:57:42.675417+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":20305121604,"num_objects":6822,"num_object_clones":0,"num_object_copies":19368,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":632,"num_objects_unfound":0,"num_objects_dirty":4824,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":25509,"num_write_kb":14727220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3207,"num_bytes_recovered":7385874976,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":15129,"ondisk_log_size":15129,"up":42,"acting":42,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":45,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":25551644,"kb_used_data":25207644,"kb_used_omap":1,"kb_used_meta":343934,"kb_avail":729423076,"statfs":{"total":773094113280,"available":746929229824,"internally_reserved":0,"allocated":25812627456,"data_stored":30826570098,"data_compressed":523387886,"data_compressed_allocated":5107855360,"data_compressed_original":10215710720,"omap_allocated":1944,"internal_metadata":352188520},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":27,"apply_latency_ms":27,"commit_latency_ns":27000000,"apply_latency_ns":27000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":-252,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":118,"num_bytes_recovered":339084355,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.225468"},"pg_stats":[{"pgid":"2.4","version":"0'0","reported_seq":"156","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458800+0000","last_change":"2021-01-29T13:57:34.166076+0000","last_active":"2021-01-29T13:57:37.458800+0000","last_peered":"2021-01-29T13:57:37.458800+0000","last_clean":"2021-01-29T13:57:37.458800+0000","last_became_active":"2021-01-29T13:52:24.188931+0000","last_became_peered":"2021-01-29T13:52:24.188931+0000","last_unstale":"2021-01-29T13:57:37.458800+0000","last_undegraded":"2021-01-29T13:57:37.458800+0000","last_fullsized":"2021-01-29T13:57:37.458800+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:57.162808+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:57.162808+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"120'6449","reported_seq":"8600","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.461338+0000","last_change":"2021-01-29T13:55:45.625490+0000","last_active":"2021-01-29T13:57:37.461338+0000","last_peered":"2021-01-29T13:57:37.461338+0000","last_clean":"2021-01-29T13:57:37.461338+0000","last_became_active":"2021-01-29T13:52:39.830011+0000","last_became_peered":"2021-01-29T13:52:39.830011+0000","last_unstale":"2021-01-29T13:57:37.461338+0000","last_undegraded":"2021-01-29T13:57:37.461338+0000","last_fullsized":"2021-01-29T13:57:37.461338+0000","mapping_epoch":26,"log_start":"72'3403","ondisk_log_start":"72'3403","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6250","last_scrub_stamp":"2021-01-29T13:55:45.625379+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:45.625379+0000","log_size":3046,"ondisk_log_size":3046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2928382292,"num_objects":986,"num_object_clones":0,"num_object_copies":1972,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2501,"num_read_kb":1252,"num_write":5879,"num_write_kb":1639641,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":6,"num_bytes_hit_set_archive":3315,"num_flush":761,"num_flush_kb":2192275,"num_evict":269,"num_evict_kb":760560,"num_promote":1249,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":"117","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.497927+0000","last_change":"2021-01-29T13:55:42.661441+0000","last_active":"2021-01-29T13:57:37.497927+0000","last_peered":"2021-01-29T13:57:37.497927+0000","last_clean":"2021-01-29T13:57:37.497927+0000","last_became_active":"2021-01-29T13:53:29.493255+0000","last_became_peered":"2021-01-29T13:53:29.493255+0000","last_unstale":"2021-01-29T13:57:37.497927+0000","last_undegraded":"2021-01-29T13:57:37.497927+0000","last_fullsized":"2021-01-29T13:57:37.497927+0000","mapping_epoch":52,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":53,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:42.661371+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:42.661371+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3","version":"120'671","reported_seq":"1393","reported_epoch":"147","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:40.662249+0000","last_change":"2021-01-29T13:56:47.680232+0000","last_active":"2021-01-29T13:57:40.662249+0000","last_peered":"2021-01-29T13:57:40.662249+0000","last_clean":"2021-01-29T13:56:36.386610+0000","last_became_active":"2021-01-29T13:56:47.674484+0000","last_became_peered":"2021-01-29T13:56:47.674484+0000","last_unstale":"2021-01-29T13:57:40.662249+0000","last_undegraded":"2021-01-29T13:57:40.662249+0000","last_fullsized":"2021-01-29T13:57:40.662249+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":101,"parent":"0.0","parent_split_bits":0,"last_scrub":"116'570","last_scrub_stamp":"2021-01-29T13:55:44.911108+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:44.911108+0000","log_size":671,"ondisk_log_size":671,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2038945493,"num_objects":671,"num_object_clones":0,"num_object_copies":2684,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":404,"num_objects_unfound":0,"num_objects_dirty":671,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":671,"num_write_kb":1991482,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":787,"num_bytes_recovered":2413500764,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,4,7],"acting":[6,2,4,7],"avail_no_missing":["6(0)","2(1)","4(2)","7(3)"],"object_location_counts":[{"shards":"2(1),4(2),6(0),7(3)","objects":671}],"blocked_by":[],"up_primary":0,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":"147","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.457918+0000","last_change":"2021-01-29T13:57:01.550191+0000","last_active":"2021-01-29T13:57:37.457918+0000","last_peered":"2021-01-29T13:57:37.457918+0000","last_clean":"2021-01-29T13:57:37.457918+0000","last_became_active":"2021-01-29T13:52:23.765595+0000","last_became_peered":"2021-01-29T13:52:23.765595+0000","last_unstale":"2021-01-29T13:57:37.457918+0000","last_undegraded":"2021-01-29T13:57:37.457918+0000","last_fullsized":"2021-01-29T13:57:37.457918+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:57:01.550087+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.550087+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.0","version":"117'710","reported_seq":"887","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458693+0000","last_change":"2021-01-29T13:57:37.153012+0000","last_active":"2021-01-29T13:57:37.458693+0000","last_peered":"2021-01-29T13:57:37.458693+0000","last_clean":"2021-01-29T13:57:37.458693+0000","last_became_active":"2021-01-29T13:53:09.969063+0000","last_became_peered":"2021-01-29T13:53:09.969063+0000","last_unstale":"2021-01-29T13:57:37.458693+0000","last_undegraded":"2021-01-29T13:57:37.458693+0000","last_fullsized":"2021-01-29T13:57:37.458693+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'710","last_scrub_stamp":"2021-01-29T13:56:09.327903+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:56:09.327903+0000","log_size":710,"ondisk_log_size":710,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2107977089,"num_objects":710,"num_object_clones":0,"num_object_copies":2840,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":710,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":710,"num_write_kb":2058922,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,2,4],"acting":[5,7,2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":"159","reported_epoch":"145","state":"active+clean","last_fresh":"2021-01-29T13:57:36.794315+0000","last_change":"2021-01-29T13:56:59.467725+0000","last_active":"2021-01-29T13:57:36.794315+0000","last_peered":"2021-01-29T13:57:36.794315+0000","last_clean":"2021-01-29T13:57:36.794315+0000","last_became_active":"2021-01-29T13:52:24.188578+0000","last_became_peered":"2021-01-29T13:52:24.188578+0000","last_unstale":"2021-01-29T13:57:36.794315+0000","last_undegraded":"2021-01-29T13:57:36.794315+0000","last_fullsized":"2021-01-29T13:57:36.794315+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:59.467654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:59.467654+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"142'4","reported_seq":"157","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458197+0000","last_change":"2021-01-29T13:57:01.982145+0000","last_active":"2021-01-29T13:57:37.458197+0000","last_peered":"2021-01-29T13:57:37.458197+0000","last_clean":"2021-01-29T13:57:37.458197+0000","last_became_active":"2021-01-29T13:52:20.655015+0000","last_became_peered":"2021-01-29T13:52:20.655015+0000","last_unstale":"2021-01-29T13:57:37.458197+0000","last_undegraded":"2021-01-29T13:57:37.458197+0000","last_fullsized":"2021-01-29T13:57:37.458197+0000","mapping_epoch":15,"log_start":"0'0","ondisk_log_start":"0'0","created":11,"last_epoch_clean":16,"parent":"0.0","parent_split_bits":0,"last_scrub":"142'4","last_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_deep_scrub":"142'4","last_deep_scrub_stamp":"2021-01-29T13:57:01.982073+0000","last_clean_scrub_stamp":"2021-01-29T13:57:01.982073+0000","log_size":4,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2","version":"120'761","reported_seq":"3071","reported_epoch":"147","state":"active+remapped+backfilling","last_fresh":"2021-01-29T13:57:41.858978+0000","last_change":"2021-01-29T13:56:48.363777+0000","last_active":"2021-01-29T13:57:41.858978+0000","last_peered":"2021-01-29T13:57:41.858978+0000","last_clean":"2021-01-29T13:56:36.386422+0000","last_became_active":"2021-01-29T13:56:48.362095+0000","last_became_peered":"2021-01-29T13:56:48.362095+0000","last_unstale":"2021-01-29T13:57:41.858978+0000","last_undegraded":"2021-01-29T13:57:41.858978+0000","last_fullsized":"2021-01-29T13:57:41.858978+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":110,"parent":"0.0","parent_split_bits":0,"last_scrub":"120'761","last_scrub_stamp":"2021-01-29T13:55:53.981049+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:53.981049+0000","log_size":761,"ondisk_log_size":761,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2244508217,"num_objects":761,"num_object_clones":0,"num_object_copies":3044,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":228,"num_objects_unfound":0,"num_objects_dirty":761,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":761,"num_write_kb":2192275,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1053,"num_bytes_recovered":3106526858,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2,7,0],"acting":[4,2,7,1],"avail_no_missing":["4(0)","1(3)","2(1)","7(2)"],"object_location_counts":[{"shards":"1(3),2(1),4(0),7(2)","objects":761}],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":"148","reported_epoch":"145","state":"active+clean","last_fresh":"2021-01-29T13:57:36.794261+0000","last_change":"2021-01-29T13:56:41.371116+0000","last_active":"2021-01-29T13:57:36.794261+0000","last_peered":"2021-01-29T13:57:36.794261+0000","last_clean":"2021-01-29T13:57:36.794261+0000","last_became_active":"2021-01-29T13:52:23.765671+0000","last_became_peered":"2021-01-29T13:52:23.765671+0000","last_unstale":"2021-01-29T13:57:36.794261+0000","last_undegraded":"2021-01-29T13:57:36.794261+0000","last_fullsized":"2021-01-29T13:57:36.794261+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:41.371025+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:41.371025+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"118'720","reported_seq":"891","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.461342+0000","last_change":"2021-01-29T13:55:59.202455+0000","last_active":"2021-01-29T13:57:37.461342+0000","last_peered":"2021-01-29T13:57:37.461342+0000","last_clean":"2021-01-29T13:57:37.461342+0000","last_became_active":"2021-01-29T13:53:09.587252+0000","last_became_peered":"2021-01-29T13:53:09.587252+0000","last_unstale":"2021-01-29T13:57:37.461342+0000","last_undegraded":"2021-01-29T13:57:37.461342+0000","last_fullsized":"2021-01-29T13:57:37.461342+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'720","last_scrub_stamp":"2021-01-29T13:55:59.202349+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:35.792587+0000","last_clean_scrub_stamp":"2021-01-29T13:55:59.202349+0000","log_size":720,"ondisk_log_size":720,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2156154079,"num_objects":720,"num_object_clones":0,"num_object_copies":2880,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":720,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":720,"num_write_kb":2105989,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2,4,3],"acting":[6,2,4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.3","version":"120'5986","reported_seq":"10744","reported_epoch":"147","state":"active+clean","last_fresh":"2021-01-29T13:57:38.478514+0000","last_change":"2021-01-29T13:57:38.478514+0000","last_active":"2021-01-29T13:57:38.478514+0000","last_peered":"2021-01-29T13:57:38.478514+0000","last_clean":"2021-01-29T13:57:38.478514+0000","last_became_active":"2021-01-29T13:57:38.475245+0000","last_became_peered":"2021-01-29T13:57:38.475245+0000","last_unstale":"2021-01-29T13:57:38.478514+0000","last_undegraded":"2021-01-29T13:57:38.478514+0000","last_fullsized":"2021-01-29T13:57:38.478514+0000","mapping_epoch":146,"log_start":"71'2904","ondisk_log_start":"71'2904","created":26,"last_epoch_clean":147,"parent":"0.0","parent_split_bits":0,"last_scrub":"119'5955","last_scrub_stamp":"2021-01-29T13:55:51.275882+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:51.275882+0000","log_size":3082,"ondisk_log_size":3082,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2947693900,"num_objects":985,"num_object_clones":0,"num_object_copies":1970,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2316,"num_read_kb":1158,"num_write":5435,"num_write_kb":1544566,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1367,"num_bytes_recovered":1865847354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":2771,"num_flush":671,"num_flush_kb":1991482,"num_evict":178,"num_evict_kb":526959,"num_promote":1172,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":"171","reported_epoch":"147","state":"active+clean","last_fresh":"2021-01-29T13:57:39.387290+0000","last_change":"2021-01-29T13:57:39.387896+0000","last_active":"2021-01-29T13:57:39.387290+0000","last_peered":"2021-01-29T13:57:39.387290+0000","last_clean":"2021-01-29T13:57:39.387290+0000","last_became_active":"2021-01-29T13:53:09.377717+0000","last_became_peered":"2021-01-29T13:53:09.377717+0000","last_unstale":"2021-01-29T13:57:39.387290+0000","last_undegraded":"2021-01-29T13:57:39.387290+0000","last_fullsized":"2021-01-29T13:57:39.387290+0000","mapping_epoch":42,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:33.131622+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:33.131622+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":"145","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.458896+0000","last_change":"2021-01-29T13:56:53.807344+0000","last_active":"2021-01-29T13:57:37.458896+0000","last_peered":"2021-01-29T13:57:37.458896+0000","last_clean":"2021-01-29T13:57:37.458896+0000","last_became_active":"2021-01-29T13:52:40.828334+0000","last_became_peered":"2021-01-29T13:52:40.828334+0000","last_unstale":"2021-01-29T13:57:37.458896+0000","last_undegraded":"2021-01-29T13:57:37.458896+0000","last_fullsized":"2021-01-29T13:57:37.458896+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:56:53.807251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:56:53.807251+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.0","version":"117'6273","reported_seq":"8324","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.497913+0000","last_change":"2021-01-29T13:55:55.445357+0000","last_active":"2021-01-29T13:57:37.497913+0000","last_peered":"2021-01-29T13:57:37.497913+0000","last_clean":"2021-01-29T13:57:37.497913+0000","last_became_active":"2021-01-29T13:53:09.369472+0000","last_became_peered":"2021-01-29T13:53:09.369472+0000","last_unstale":"2021-01-29T13:57:37.497913+0000","last_undegraded":"2021-01-29T13:57:37.497913+0000","last_fullsized":"2021-01-29T13:57:37.497913+0000","mapping_epoch":42,"log_start":"71'3203","ondisk_log_start":"71'3203","created":26,"last_epoch_clean":43,"parent":"0.0","parent_split_bits":0,"last_scrub":"117'6273","last_scrub_stamp":"2021-01-29T13:55:55.445229+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.445229+0000","log_size":3070,"ondisk_log_size":3070,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2935339657,"num_objects":992,"num_object_clones":0,"num_object_copies":1984,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":496,"num_whiteouts":0,"num_read":2414,"num_read_kb":1208,"num_write":5647,"num_write_kb":1593121,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3044,"num_flush":710,"num_flush_kb":2058922,"num_evict":219,"num_evict_kb":640347,"num_promote":1206,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":"29","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.463934+0000","last_change":"2021-01-29T13:56:46.442031+0000","last_active":"2021-01-29T13:57:37.463934+0000","last_peered":"2021-01-29T13:57:37.463934+0000","last_clean":"2021-01-29T13:57:37.463934+0000","last_became_active":"2021-01-29T13:56:46.441589+0000","last_became_peered":"2021-01-29T13:56:46.441589+0000","last_unstale":"2021-01-29T13:57:37.463934+0000","last_undegraded":"2021-01-29T13:57:37.463934+0000","last_fullsized":"2021-01-29T13:57:37.463934+0000","mapping_epoch":126,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2021-01-29T13:55:55.134762+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:22.751660+0000","last_clean_scrub_stamp":"2021-01-29T13:55:55.134762+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"118'6270","reported_seq":"8356","reported_epoch":"146","state":"active+clean","last_fresh":"2021-01-29T13:57:37.464735+0000","last_change":"2021-01-29T13:57:04.235378+0000","last_active":"2021-01-29T13:57:37.464735+0000","last_peered":"2021-01-29T13:57:37.464735+0000","last_clean":"2021-01-29T13:57:37.464735+0000","last_became_active":"2021-01-29T13:52:39.823642+0000","last_became_peered":"2021-01-29T13:52:39.823642+0000","last_unstale":"2021-01-29T13:57:37.464735+0000","last_undegraded":"2021-01-29T13:57:37.464735+0000","last_fullsized":"2021-01-29T13:57:37.464735+0000","mapping_epoch":26,"log_start":"71'3205","ondisk_log_start":"71'3205","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"118'6270","last_scrub_stamp":"2021-01-29T13:57:04.235268+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2021-01-29T13:52:38.811171+0000","last_clean_scrub_stamp":"2021-01-29T13:57:04.235268+0000","log_size":3065,"ondisk_log_size":3065,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":2946120877,"num_objects":995,"num_object_clones":0,"num_object_copies":1990,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":488,"num_whiteouts":0,"num_read":2420,"num_read_kb":1212,"num_write":5684,"num_write_kb":1601214,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":5,"num_bytes_hit_set_archive":3066,"num_flush":720,"num_flush_kb":2105989,"num_evict":218,"num_evict_kb":643724,"num_promote":1208,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":4,"stat_sum":{"num_bytes":11757536726,"num_objects":3958,"num_object_clones":0,"num_object_copies":7916,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1960,"num_whiteouts":0,"num_read":9651,"num_read_kb":4830,"num_write":22645,"num_write_kb":6378542,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1367,"num_bytes_recovered":1865847354,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":21,"num_bytes_hit_set_archive":12196,"num_flush":2862,"num_flush_kb":8348668,"num_evict":884,"num_evict_kb":2571590,"num_promote":4835,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":11983056896,"data_stored":11892361364,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12263,"ondisk_log_size":12263,"up":8,"acting":8,"num_store_stats":6},{"poolid":3,"num_pg":4,"stat_sum":{"num_bytes":8547584878,"num_objects":2862,"num_object_clones":0,"num_object_copies":11448,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":632,"num_objects_unfound":0,"num_objects_dirty":2862,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2862,"num_write_kb":8348668,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1840,"num_bytes_recovered":5520027622,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":13793206272,"data_stored":18905419776,"data_compressed":523841489,"data_compressed_allocated":5112213504,"data_compressed_original":10224427008,"omap_allocated":0,"internal_metadata":0},"log_size":2862,"ondisk_log_size":2862,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":8249,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4,"ondisk_log_size":4,"up":2,"acting":2,"num_store_stats":2},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7}],"osd_stats":[{"osd":0,"up_from":124,"seq":532575944719,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2622556,"kb_used_data":2579220,"kb_used_omap":0,"kb_used_meta":43327,"kb_avail":91749284,"statfs":{"total":96636764160,"available":93951266816,"internally_reserved":0,"allocated":2641121280,"data_stored":3110022318,"data_compressed":49186610,"data_compressed_allocated":479526912,"data_compressed_original":959053824,"omap_allocated":972,"internal_metadata":44366900},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.74099999999999999,"5min":0.74099999999999999,"15min":0.74099999999999999},"min":{"1min":0.52600000000000002,"5min":0.52600000000000002,"15min":0.52600000000000002},"max":{"1min":1.2130000000000001,"5min":1.2130000000000001,"15min":1.2130000000000001},"last":0.69399999999999995},{"interface":"front","average":{"1min":0.89400000000000002,"5min":0.89400000000000002,"15min":0.89400000000000002},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.452,"5min":1.452,"15min":1.452},"last":1.0149999999999999}]},{"osd":2,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.93400000000000005,"5min":0.93400000000000005,"15min":0.93400000000000005},"min":{"1min":0.61099999999999999,"5min":0.61099999999999999,"15min":0.61099999999999999},"max":{"1min":2.3559999999999999,"5min":2.3559999999999999,"15min":2.3559999999999999},"last":0.72999999999999998},{"interface":"front","average":{"1min":0.82199999999999995,"5min":0.82199999999999995,"15min":0.82199999999999995},"min":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"max":{"1min":1.147,"5min":1.147,"15min":1.147},"last":0.93300000000000005}]},{"osd":3,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":7.8730000000000002,"5min":7.8730000000000002,"15min":7.8730000000000002},"min":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"max":{"1min":170.62200000000001,"5min":170.62200000000001,"15min":170.62200000000001},"last":170.62200000000001},{"interface":"front","average":{"1min":1.0600000000000001,"5min":1.0600000000000001,"15min":1.0600000000000001},"min":{"1min":0.73499999999999999,"5min":0.73499999999999999,"15min":0.73499999999999999},"max":{"1min":2.3149999999999999,"5min":2.3149999999999999,"15min":2.3149999999999999},"last":1.258}]},{"osd":4,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":1.117,"5min":1.117,"15min":1.117},"min":{"1min":0.85999999999999999,"5min":0.85999999999999999,"15min":0.85999999999999999},"max":{"1min":1.897,"5min":1.897,"15min":1.897},"last":1.056},{"interface":"front","average":{"1min":1.141,"5min":1.141,"15min":1.141},"min":{"1min":0.80300000000000005,"5min":0.80300000000000005,"15min":0.80300000000000005},"max":{"1min":2.1059999999999999,"5min":2.1059999999999999,"15min":2.1059999999999999},"last":1.2370000000000001}]},{"osd":5,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":6.9889999999999999,"5min":6.9889999999999999,"15min":6.9889999999999999},"min":{"1min":0.80400000000000005,"5min":0.80400000000000005,"15min":0.80400000000000005},"max":{"1min":136.00800000000001,"5min":136.00800000000001,"15min":136.00800000000001},"last":1.294},{"interface":"front","average":{"1min":1.0840000000000001,"5min":1.0840000000000001,"15min":1.0840000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":1.837,"5min":1.837,"15min":1.837},"last":0.96299999999999997}]},{"osd":6,"last update":"Fri Jan 29 13:57:37 2021","interfaces":[{"interface":"back","average":{"1min":22.164000000000001,"5min":22.164000000000001,"15min":22.164000000000001},"min":{"1min":0.83899999999999997,"5min":0.83899999999999997,"15min":0.83899999999999997},"max":{"1min":484.286,"5min":484.286,"15min":484.286},"last":1.1140000000000001},{"interface":"front","average":{"1min":24.145,"5min":24.145,"15min":24.145},"min":{"1min":0.93500000000000005,"5min":0.93500000000000005,"15min":0.93500000000000005},"max":{"1min":529.46000000000004,"5min":529.46000000000004,"15min":529.46000000000004},"last":529.46000000000004}]},{"osd":7,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":1.274,"5min":1.274,"15min":1.274},"min":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"max":{"1min":2.3879999999999999,"5min":2.3879999999999999,"15min":2.3879999999999999},"last":1.3180000000000001},{"interface":"front","average":{"1min":1.264,"5min":1.264,"15min":1.264},"min":{"1min":0.91700000000000004,"5min":0.91700000000000004,"15min":0.91700000000000004},"max":{"1min":2.0409999999999999,"5min":2.0409999999999999,"15min":2.0409999999999999},"last":1.349}]}]},{"osd":7,"up_from":15,"seq":64424509508,"num_pgs":5,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2311472,"kb_used_data":2281064,"kb_used_omap":0,"kb_used_meta":30400,"kb_avail":92060368,"statfs":{"total":96636764160,"available":94269816832,"internally_reserved":0,"allocated":2335809536,"data_stored":3200494326,"data_compressed":88587048,"data_compressed_allocated":865042432,"data_compressed_original":1730084864,"omap_allocated":0,"internal_metadata":31129600},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.83099999999999996,"5min":0.83099999999999996,"15min":0.83099999999999996},"min":{"1min":0.52500000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"max":{"1min":1.1100000000000001,"5min":1.1100000000000001,"15min":1.1100000000000001},"last":0.70299999999999996},{"interface":"front","average":{"1min":1.1180000000000001,"5min":1.1180000000000001,"15min":1.1180000000000001},"min":{"1min":0.81000000000000005,"5min":0.81000000000000005,"15min":0.81000000000000005},"max":{"1min":1.5369999999999999,"5min":1.5369999999999999,"15min":1.5369999999999999},"last":1.004}]},{"osd":1,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.1080000000000001,"5min":1.242,"15min":1.46},"min":{"1min":0.64900000000000002,"5min":0.48599999999999999,"15min":0.48599999999999999},"max":{"1min":1.671,"5min":11.195,"15min":11.195},"last":0.91200000000000003},{"interface":"front","average":{"1min":50.901000000000003,"5min":26.797999999999998,"15min":33.463000000000001},"min":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"max":{"1min":951.06700000000001,"5min":951.06700000000001,"15min":951.06700000000001},"last":0.79000000000000004}]},{"osd":2,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":0.94599999999999995,"5min":10.314,"15min":4.5030000000000001},"min":{"1min":0.72099999999999997,"5min":0.56899999999999995,"15min":0.56899999999999995},"max":{"1min":1.147,"5min":512.423,"15min":512.423},"last":0.73799999999999999},{"interface":"front","average":{"1min":27.712,"5min":7.3419999999999996,"15min":3.5150000000000001},"min":{"1min":0.68600000000000005,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":505.935,"5min":505.935,"15min":505.935},"last":0.95299999999999996}]},{"osd":3,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":52.369999999999997,"5min":13.276,"15min":5.1639999999999997},"min":{"1min":0.749,"5min":0.65400000000000003,"15min":0.65400000000000003},"max":{"1min":977.31200000000001,"5min":977.31200000000001,"15min":977.31200000000001},"last":0.84999999999999998},{"interface":"front","average":{"1min":1.2889999999999999,"5min":1.381,"15min":1.581},"min":{"1min":1.006,"5min":0.67300000000000004,"15min":0.67300000000000004},"max":{"1min":1.7789999999999999,"5min":11.146000000000001,"15min":11.146000000000001},"last":1.3049999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:17 2021","interfaces":[{"interface":"back","average":{"1min":1.3260000000000001,"5min":1.254,"15min":1.3340000000000001},"min":{"1min":0.79900000000000004,"5min":0.68600000000000005,"15min":0.68600000000000005},"max":{"1min":1.7450000000000001,"5min":5.8449999999999998,"15min":5.8449999999999998},"last":1.0469999999999999},{"interface":"front","average":{"1min":16.503,"5min":13.058,"15min":19.832000000000001},"min":{"1min":0.79700000000000004,"5min":0.72399999999999998,"15min":0.72399999999999998},"max":{"1min":309.072,"5min":391.66699999999997,"15min":391.66699999999997},"last":0.98199999999999998}]},{"osd":5,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.0980000000000001,"5min":3.3260000000000001,"15min":2.242},"min":{"1min":0.76700000000000002,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.625,"5min":175.83199999999999,"15min":175.83199999999999},"last":1.2450000000000001},{"interface":"front","average":{"1min":1.3700000000000001,"5min":1.294,"15min":1.2130000000000001},"min":{"1min":0.97099999999999997,"5min":0.65700000000000003,"15min":0.65700000000000003},"max":{"1min":1.8120000000000001,"5min":4.4020000000000001,"15min":4.4020000000000001},"last":1.3260000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":1.4570000000000001,"5min":1.552,"15min":1.532},"min":{"1min":1.119,"5min":0.754,"15min":0.754},"max":{"1min":1.881,"5min":10.063000000000001,"15min":10.063000000000001},"last":1.345},{"interface":"front","average":{"1min":8.1750000000000007,"5min":9.5399999999999991,"15min":26.190000000000001},"min":{"1min":0.95299999999999996,"5min":0.79500000000000004,"15min":0.79500000000000004},"max":{"1min":132.83500000000001,"5min":623.01999999999998,"15min":623.01999999999998},"last":1.278}]}]},{"osd":2,"up_from":15,"seq":64424509507,"num_pgs":7,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":5660992,"kb_used_data":5606840,"kb_used_omap":0,"kb_used_meta":54144,"kb_avail":88710848,"statfs":{"total":96636764160,"available":90839908352,"internally_reserved":0,"allocated":5741404160,"data_stored":6879489840,"data_compressed":118712623,"data_compressed_allocated":1158184960,"data_compressed_original":2316369920,"omap_allocated":0,"internal_metadata":55443456},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":20,"apply_latency_ms":20,"commit_latency_ns":20000000,"apply_latency_ns":20000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.76300000000000001,"5min":0.76300000000000001,"15min":0.76300000000000001},"min":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"max":{"1min":1.0369999999999999,"5min":1.0369999999999999,"15min":1.0369999999999999},"last":0.80000000000000004},{"interface":"front","average":{"1min":0.873,"5min":0.873,"15min":0.873},"min":{"1min":0.54500000000000004,"5min":0.54500000000000004,"15min":0.54500000000000004},"max":{"1min":1.2629999999999999,"5min":1.2629999999999999,"15min":1.2629999999999999},"last":0.94299999999999995}]},{"osd":1,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.879,"5min":17.460000000000001,"15min":6.4560000000000004},"min":{"1min":0.63200000000000001,"5min":0.499,"15min":0.499},"max":{"1min":1.3999999999999999,"5min":721.11000000000001,"15min":721.11000000000001},"last":0.81899999999999995},{"interface":"front","average":{"1min":0.95499999999999996,"5min":21.443999999999999,"15min":7.8150000000000004},"min":{"1min":0.71899999999999997,"5min":0.65000000000000002,"15min":0.65000000000000002},"max":{"1min":1.3460000000000001,"5min":1000.376,"15min":1000.376},"last":0.96999999999999997}]},{"osd":3,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.81200000000000006,"5min":11.378,"15min":4.343},"min":{"1min":0.60299999999999998,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":1.1160000000000001,"5min":501.61200000000002,"15min":501.61200000000002},"last":0.67200000000000004},{"interface":"front","average":{"1min":0.96799999999999997,"5min":1.1819999999999999,"15min":1.0620000000000001},"min":{"1min":0.65900000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"max":{"1min":1.3500000000000001,"5min":6.1870000000000003,"15min":6.1870000000000003},"last":0.90100000000000002}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.2190000000000001,"5min":1.4099999999999999,"15min":1.5069999999999999},"min":{"1min":0.72699999999999998,"5min":0.72599999999999998,"15min":0.72599999999999998},"max":{"1min":1.6160000000000001,"5min":3.694,"15min":3.694},"last":1.1850000000000001},{"interface":"front","average":{"1min":77.519000000000005,"5min":16.635999999999999,"15min":6.4619999999999997},"min":{"1min":0.96199999999999997,"5min":0.871,"15min":0.871},"max":{"1min":874.88400000000001,"5min":874.88400000000001,"15min":874.88400000000001},"last":1.2050000000000001}]},{"osd":5,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.054,"5min":5.7699999999999996,"15min":2.762},"min":{"1min":0.79800000000000004,"5min":0.73299999999999998,"15min":0.73299999999999998},"max":{"1min":1.349,"5min":183.761,"15min":183.761},"last":0.85899999999999999},{"interface":"front","average":{"1min":1.1579999999999999,"5min":9.484,"15min":4.0389999999999997},"min":{"1min":0.88400000000000001,"5min":0.746,"15min":0.746},"max":{"1min":1.5469999999999999,"5min":521.02499999999998,"15min":521.02499999999998},"last":0.99099999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.2010000000000001,"5min":1.359,"15min":1.2969999999999999},"min":{"1min":0.93500000000000005,"5min":0.83499999999999996,"15min":0.83499999999999996},"max":{"1min":1.544,"5min":3.46,"15min":3.46},"last":1.0089999999999999},{"interface":"front","average":{"1min":1.135,"5min":1.4319999999999999,"15min":1.276},"min":{"1min":0.87,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.4590000000000001,"5min":7.0209999999999999,"15min":7.0209999999999999},"last":0.88500000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":22.652000000000001,"5min":12.759,"15min":5.1719999999999997},"min":{"1min":0.98399999999999999,"5min":0.94999999999999996,"15min":0.94999999999999996},"max":{"1min":427.892,"5min":591.18899999999996,"15min":591.18899999999996},"last":1.226},{"interface":"front","average":{"1min":1.26,"5min":11.763999999999999,"15min":4.8159999999999998},"min":{"1min":0.95499999999999996,"5min":0.76200000000000001,"15min":0.76200000000000001},"max":{"1min":1.738,"5min":923.40099999999995,"15min":923.40099999999995},"last":1.103}]}]},{"osd":1,"up_from":15,"seq":64424509508,"num_pgs":3,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2154968,"kb_used_data":2115152,"kb_used_omap":0,"kb_used_meta":39808,"kb_avail":92216872,"statfs":{"total":96636764160,"available":94430076928,"internally_reserved":0,"allocated":2165915648,"data_stored":2457997850,"data_compressed":31021897,"data_compressed_allocated":302632960,"data_compressed_original":605265920,"omap_allocated":0,"internal_metadata":40763392},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:54:25 2021","interfaces":[{"interface":"back","average":{"1min":1.7629999999999999,"5min":1.0349999999999999,"15min":0.91300000000000003},"min":{"1min":0.63300000000000001,"5min":0.60399999999999998,"15min":0.60399999999999998},"max":{"1min":5.0629999999999997,"5min":5.0629999999999997,"15min":5.0629999999999997},"last":0.70799999999999996},{"interface":"front","average":{"1min":39.090000000000003,"5min":8.5060000000000002,"15min":3.4079999999999999},"min":{"1min":0.58699999999999997,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":752.73400000000004,"5min":752.73400000000004,"15min":752.73400000000004},"last":0.65200000000000002}]},{"osd":2,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.79300000000000004,"5min":16.138999999999999,"15min":27.606000000000002},"min":{"1min":0.57199999999999995,"5min":0.46800000000000003,"15min":0.46800000000000003},"max":{"1min":1.153,"5min":832.21600000000001,"15min":832.21600000000001},"last":0.80800000000000005},{"interface":"front","average":{"1min":0.85299999999999998,"5min":11.237,"15min":4.4100000000000001},"min":{"1min":0.59099999999999997,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.1870000000000001,"5min":899.43399999999997,"15min":899.43399999999997},"last":0.84199999999999997}]},{"osd":3,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":0.94499999999999995,"5min":1.296,"15min":1.0960000000000001},"min":{"1min":0.63300000000000001,"5min":0.47299999999999998,"15min":0.47299999999999998},"max":{"1min":1.3169999999999999,"5min":6.0579999999999998,"15min":6.0579999999999998},"last":0.876},{"interface":"front","average":{"1min":0.84299999999999997,"5min":3.3029999999999999,"15min":9.1440000000000001},"min":{"1min":0.55100000000000005,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":1.1220000000000001,"5min":244.60900000000001,"15min":244.60900000000001},"last":0.82499999999999996}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.0369999999999999,"5min":1.325,"15min":1.5880000000000001},"min":{"1min":0.71399999999999997,"5min":0.54800000000000004,"15min":0.54800000000000004},"max":{"1min":1.254,"5min":5.242,"15min":5.242},"last":0.95099999999999996},{"interface":"front","average":{"1min":1.079,"5min":1.6839999999999999,"15min":2.0870000000000002},"min":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"max":{"1min":1.2310000000000001,"5min":6.2590000000000003,"15min":6.2590000000000003},"last":1.165}]},{"osd":5,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":1.022,"5min":14.631,"15min":5.681},"min":{"1min":0.68300000000000005,"5min":0.58799999999999997,"15min":0.58799999999999997},"max":{"1min":1.3440000000000001,"5min":701.73400000000004,"15min":701.73400000000004},"last":0.96799999999999997},{"interface":"front","average":{"1min":1.0289999999999999,"5min":1.302,"15min":1.248},"min":{"1min":0.72899999999999998,"5min":0.70399999999999996,"15min":0.70399999999999996},"max":{"1min":1.359,"5min":5.758,"15min":5.758},"last":1.0940000000000001}]},{"osd":6,"last update":"Fri Jan 29 13:57:30 2021","interfaces":[{"interface":"back","average":{"1min":48.951999999999998,"5min":10.974,"15min":4.5209999999999999},"min":{"1min":0.89800000000000002,"5min":0.72299999999999998,"15min":0.72299999999999998},"max":{"1min":862.01999999999998,"5min":862.01999999999998,"15min":862.01999999999998},"last":1.046},{"interface":"front","average":{"1min":1.1659999999999999,"5min":2.7810000000000001,"15min":5.8049999999999997},"min":{"1min":0.83799999999999997,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.4790000000000001,"5min":132.35300000000001,"15min":132.35300000000001},"last":1.1459999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:29 2021","interfaces":[{"interface":"back","average":{"1min":45.155999999999999,"5min":17.600000000000001,"15min":6.7450000000000001},"min":{"1min":0.83999999999999997,"5min":0.752,"15min":0.752},"max":{"1min":749.81700000000001,"5min":749.81700000000001,"15min":749.81700000000001},"last":1.0229999999999999},{"interface":"front","average":{"1min":1.1399999999999999,"5min":1.4530000000000001,"15min":1.3979999999999999},"min":{"1min":0.85199999999999998,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":1.4790000000000001,"5min":5.9450000000000003,"15min":5.9450000000000003},"last":1.216}]}]},{"osd":3,"up_from":15,"seq":64424509508,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":3443368,"kb_used_data":3391712,"kb_used_omap":0,"kb_used_meta":51648,"kb_avail":90928472,"statfs":{"total":96636764160,"available":93110755328,"internally_reserved":0,"allocated":3473113088,"data_stored":3742649427,"data_compressed":29735076,"data_compressed_allocated":290086912,"data_compressed_original":580173824,"omap_allocated":0,"internal_metadata":52887552},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":29.826000000000001,"5min":29.826000000000001,"15min":29.826000000000001},"min":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":301.69099999999997,"5min":301.69099999999997,"15min":301.69099999999997},"last":0.70399999999999996},{"interface":"front","average":{"1min":0.93300000000000005,"5min":0.93300000000000005,"15min":0.93300000000000005},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.613,"5min":1.613,"15min":1.613},"last":0.66800000000000004}]},{"osd":1,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":0.83599999999999997,"5min":0.96599999999999997,"15min":0.91000000000000003},"min":{"1min":0.57699999999999996,"5min":0.48399999999999999,"15min":0.48399999999999999},"max":{"1min":1.1339999999999999,"5min":2.5819999999999999,"15min":2.5819999999999999},"last":0.93000000000000005},{"interface":"front","average":{"1min":0.86499999999999999,"5min":10.300000000000001,"15min":4.0890000000000004},"min":{"1min":0.59899999999999998,"5min":0.496,"15min":0.496},"max":{"1min":1.0600000000000001,"5min":977.78200000000004,"15min":977.78200000000004},"last":0.88500000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":0.89700000000000002,"5min":1.181,"15min":1.079},"min":{"1min":0.65700000000000003,"5min":0.60999999999999999,"15min":0.60999999999999999},"max":{"1min":1.3919999999999999,"5min":5.7539999999999996,"15min":5.7539999999999996},"last":0.86199999999999999},{"interface":"front","average":{"1min":1.0509999999999999,"5min":1.3009999999999999,"15min":1.407},"min":{"1min":0.82999999999999996,"5min":0.68999999999999995,"15min":0.68999999999999995},"max":{"1min":1.2190000000000001,"5min":6.4509999999999996,"15min":6.4509999999999996},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:15 2021","interfaces":[{"interface":"back","average":{"1min":1.0820000000000001,"5min":11.065,"15min":4.5490000000000004},"min":{"1min":0.71099999999999997,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4890000000000001,"5min":916.09500000000003,"15min":916.09500000000003},"last":0.99399999999999999},{"interface":"front","average":{"1min":1.131,"5min":11.628,"15min":4.859},"min":{"1min":0.81899999999999995,"5min":0.69099999999999995,"15min":0.69099999999999995},"max":{"1min":1.46,"5min":977.91499999999996,"15min":977.91499999999996},"last":1.0169999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.099,"5min":6.8769999999999998,"15min":3.1320000000000001},"min":{"1min":0.88500000000000001,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":1.3460000000000001,"5min":503.93000000000001,"15min":503.93000000000001},"last":1.2270000000000001},{"interface":"front","average":{"1min":1.0269999999999999,"5min":6.7670000000000003,"15min":3.0150000000000001},"min":{"1min":0.83999999999999997,"5min":0.751,"15min":0.751},"max":{"1min":1.2569999999999999,"5min":503.74299999999999,"15min":503.74299999999999},"last":0.96199999999999997}]},{"osd":6,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.1970000000000001,"5min":1.4279999999999999,"15min":1.3440000000000001},"min":{"1min":1.0249999999999999,"5min":0.751,"15min":0.751},"max":{"1min":1.4710000000000001,"5min":4.7539999999999996,"15min":4.7539999999999996},"last":1.2649999999999999},{"interface":"front","average":{"1min":1.141,"5min":10.393000000000001,"15min":34.238},"min":{"1min":0.876,"5min":0.876,"15min":0.876},"max":{"1min":1.3899999999999999,"5min":851.89099999999996,"15min":851.89099999999996},"last":1.1419999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:31 2021","interfaces":[{"interface":"back","average":{"1min":1.2450000000000001,"5min":1.514,"15min":1.4910000000000001},"min":{"1min":1.0109999999999999,"5min":0.79400000000000004,"15min":0.79400000000000004},"max":{"1min":1.629,"5min":6.4240000000000004,"15min":6.4240000000000004},"last":1.2050000000000001},{"interface":"front","average":{"1min":1.2989999999999999,"5min":1.6830000000000001,"15min":1.917},"min":{"1min":1.038,"5min":0.80700000000000005,"15min":0.80700000000000005},"max":{"1min":1.6639999999999999,"5min":15.597,"15min":15.597},"last":1.246}]}]},{"osd":4,"up_from":42,"seq":180388626490,"num_pgs":8,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4411548,"kb_used_data":4364052,"kb_used_omap":0,"kb_used_meta":47487,"kb_avail":89960292,"statfs":{"total":96636764160,"available":92119339008,"internally_reserved":0,"allocated":4468789248,"data_stored":5613909741,"data_compressed":118370768,"data_compressed_allocated":1155686400,"data_compressed_original":2311372800,"omap_allocated":972,"internal_metadata":48626740},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:36 2021","interfaces":[{"interface":"back","average":{"1min":0.90000000000000002,"5min":0.90000000000000002,"15min":0.90000000000000002},"min":{"1min":0.622,"5min":0.622,"15min":0.622},"max":{"1min":1.276,"5min":1.276,"15min":1.276},"last":0.89700000000000002},{"interface":"front","average":{"1min":0.95999999999999996,"5min":0.95999999999999996,"15min":0.95999999999999996},"min":{"1min":0.63900000000000001,"5min":0.63900000000000001,"15min":0.63900000000000001},"max":{"1min":1.3560000000000001,"5min":1.3560000000000001,"15min":1.3560000000000001},"last":1.095}]},{"osd":1,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":9.0939999999999994,"5min":31.199000000000002,"15min":58.671999999999997},"min":{"1min":0.747,"5min":0.45900000000000002,"15min":0.45900000000000002},"max":{"1min":177.846,"5min":924.63300000000004,"15min":924.63300000000004},"last":1.0649999999999999},{"interface":"front","average":{"1min":1.151,"5min":15.670999999999999,"15min":5.9130000000000003},"min":{"1min":0.79300000000000004,"5min":0.52700000000000002,"15min":0.52700000000000002},"max":{"1min":1.637,"5min":898.86900000000003,"15min":898.86900000000003},"last":1.4630000000000001}]},{"osd":2,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.083,"5min":11.949,"15min":4.7149999999999999},"min":{"1min":0.71299999999999997,"5min":0.57299999999999995,"15min":0.57299999999999995},"max":{"1min":1.6020000000000001,"5min":857.78899999999999,"15min":857.78899999999999},"last":1.395},{"interface":"front","average":{"1min":0.95099999999999996,"5min":9.8019999999999996,"15min":4.0369999999999999},"min":{"1min":0.76300000000000001,"5min":0.59999999999999998,"15min":0.59999999999999998},"max":{"1min":1.198,"5min":779.38400000000001,"15min":779.38400000000001},"last":0.86399999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.002,"5min":9.625,"15min":13.391},"min":{"1min":0.69799999999999995,"5min":0.57899999999999996,"15min":0.57899999999999996},"max":{"1min":1.423,"5min":311.68299999999999,"15min":311.68299999999999},"last":1.032},{"interface":"front","average":{"1min":35.929000000000002,"5min":8.1660000000000004,"15min":3.5739999999999998},"min":{"1min":0.83999999999999997,"5min":0.71699999999999997,"15min":0.71699999999999997},"max":{"1min":765.98299999999995,"5min":765.98299999999995,"15min":765.98299999999995},"last":1.4319999999999999}]},{"osd":5,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":0.96099999999999997,"5min":3.7069999999999999,"15min":1.956},"min":{"1min":0.61899999999999999,"5min":0.55700000000000005,"15min":0.55700000000000005},"max":{"1min":1.238,"5min":239.99199999999999,"15min":239.99199999999999},"last":1.012},{"interface":"front","average":{"1min":1.1200000000000001,"5min":1.1639999999999999,"15min":1.1579999999999999},"min":{"1min":0.84499999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"max":{"1min":1.464,"5min":3.1749999999999998,"15min":3.1749999999999998},"last":1.141}]},{"osd":6,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.1839999999999999,"5min":1.2370000000000001,"15min":1.2050000000000001},"min":{"1min":0.73599999999999999,"5min":0.66700000000000004,"15min":0.66700000000000004},"max":{"1min":1.657,"5min":5.5890000000000004,"15min":5.5890000000000004},"last":1.492},{"interface":"front","average":{"1min":1.113,"5min":1.2110000000000001,"15min":1.282},"min":{"1min":0.86599999999999999,"5min":0.67600000000000005,"15min":0.67600000000000005},"max":{"1min":1.6719999999999999,"5min":3.6880000000000002,"15min":3.6880000000000002},"last":1.1220000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:19 2021","interfaces":[{"interface":"back","average":{"1min":1.214,"5min":1.2869999999999999,"15min":1.2809999999999999},"min":{"1min":0.98299999999999998,"5min":0.91200000000000003,"15min":0.91200000000000003},"max":{"1min":1.5620000000000001,"5min":3.0169999999999999,"15min":3.0169999999999999},"last":1.236},{"interface":"front","average":{"1min":33.942,"5min":7.8579999999999997,"15min":3.5139999999999998},"min":{"1min":1.0109999999999999,"5min":0.82899999999999996,"15min":0.82899999999999996},"max":{"1min":719.03700000000003,"5min":719.03700000000003,"15min":719.03700000000003},"last":1.5209999999999999}]}]},{"osd":5,"up_from":15,"seq":64424509507,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":765928,"kb_used_data":751904,"kb_used_omap":0,"kb_used_meta":14016,"kb_avail":93605912,"statfs":{"total":96636764160,"available":95852453888,"internally_reserved":0,"allocated":769949696,"data_stored":1055829374,"data_compressed":29380114,"data_compressed_allocated":286253056,"data_compressed_original":572506112,"omap_allocated":0,"internal_metadata":14352384},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:39 2021","interfaces":[{"interface":"back","average":{"1min":24.538,"5min":24.538,"15min":24.538},"min":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"max":{"1min":474.77499999999998,"5min":474.77499999999998,"15min":474.77499999999998},"last":0.66400000000000003},{"interface":"front","average":{"1min":0.97699999999999998,"5min":0.97699999999999998,"15min":0.97699999999999998},"min":{"1min":0.59099999999999997,"5min":0.59099999999999997,"15min":0.59099999999999997},"max":{"1min":1.4330000000000001,"5min":1.4330000000000001,"15min":1.4330000000000001},"last":0.98799999999999999}]},{"osd":1,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":0.98099999999999998,"5min":0.96799999999999997,"15min":0.87},"min":{"1min":0.58299999999999996,"5min":0.498,"15min":0.498},"max":{"1min":1.2350000000000001,"5min":3.1819999999999999,"15min":3.1819999999999999},"last":0.69799999999999995},{"interface":"front","average":{"1min":1.1499999999999999,"5min":11.096,"15min":4.2889999999999997},"min":{"1min":0.84999999999999998,"5min":0.51800000000000002,"15min":0.51800000000000002},"max":{"1min":1.518,"5min":732.80700000000002,"15min":732.80700000000002},"last":0.91200000000000003}]},{"osd":2,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":12.396000000000001,"5min":10.401999999999999,"15min":4.2919999999999998},"min":{"1min":0.81599999999999995,"5min":0.63800000000000001,"15min":0.63800000000000001},"max":{"1min":225.11799999999999,"5min":649.82899999999995,"15min":649.82899999999995},"last":0.89100000000000001},{"interface":"front","average":{"1min":1.0609999999999999,"5min":1.125,"15min":1.056},"min":{"1min":0.81799999999999995,"5min":0.623,"15min":0.623},"max":{"1min":1.256,"5min":4.1799999999999997,"15min":4.1799999999999997},"last":1.2010000000000001}]},{"osd":3,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":1.0249999999999999,"5min":1.1160000000000001,"15min":1.1259999999999999},"min":{"1min":0.67700000000000005,"5min":0.61499999999999999,"15min":0.61499999999999999},"max":{"1min":1.4730000000000001,"5min":4.0890000000000004,"15min":4.0890000000000004},"last":0.86099999999999999},{"interface":"front","average":{"1min":1.1899999999999999,"5min":1.27,"15min":1.228},"min":{"1min":0.92300000000000004,"5min":0.69199999999999995,"15min":0.69199999999999995},"max":{"1min":1.7350000000000001,"5min":4.827,"15min":4.827},"last":0.95499999999999996}]},{"osd":4,"last update":"Fri Jan 29 13:57:18 2021","interfaces":[{"interface":"back","average":{"1min":1.1799999999999999,"5min":13.199,"15min":16.175999999999998},"min":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"max":{"1min":1.6000000000000001,"5min":514.74199999999996,"15min":514.74199999999996},"last":1.228},{"interface":"front","average":{"1min":39.335999999999999,"5min":8.8729999999999993,"15min":3.7469999999999999},"min":{"1min":0.83599999999999997,"5min":0.70099999999999996,"15min":0.70099999999999996},"max":{"1min":762.10699999999997,"5min":762.10699999999997,"15min":762.10699999999997},"last":1.1499999999999999}]},{"osd":6,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":37.015999999999998,"5min":16.678000000000001,"15min":6.4059999999999997},"min":{"1min":1.0900000000000001,"5min":0.622,"15min":0.622},"max":{"1min":714.803,"5min":714.803,"15min":714.803},"last":1.1830000000000001},{"interface":"front","average":{"1min":1.3879999999999999,"5min":1.4630000000000001,"15min":1.27},"min":{"1min":1.119,"5min":0.69699999999999995,"15min":0.69699999999999995},"max":{"1min":1.8320000000000001,"5min":4.8700000000000001,"15min":4.8700000000000001},"last":1.2669999999999999}]},{"osd":7,"last update":"Fri Jan 29 13:57:21 2021","interfaces":[{"interface":"back","average":{"1min":1.304,"5min":1.423,"15min":1.5049999999999999},"min":{"1min":1.0409999999999999,"5min":0.72699999999999998,"15min":0.72699999999999998},"max":{"1min":1.851,"5min":9.0109999999999992,"15min":9.0109999999999992},"last":1.282},{"interface":"front","average":{"1min":1.419,"5min":1.6479999999999999,"15min":1.758},"min":{"1min":1.1319999999999999,"5min":0.89000000000000001,"15min":0.89000000000000001},"max":{"1min":1.96,"5min":9.593,"15min":9.593},"last":1.3340000000000001}]}]},{"osd":6,"up_from":15,"seq":64424509507,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":4180812,"kb_used_data":4117700,"kb_used_omap":0,"kb_used_meta":63104,"kb_avail":90191028,"statfs":{"total":96636764160,"available":92355612672,"internally_reserved":0,"allocated":4216524800,"data_stored":4766177222,"data_compressed":58393750,"data_compressed_allocated":570441728,"data_compressed_original":1140883456,"omap_allocated":0,"internal_metadata":64618496},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Fri Jan 29 13:57:35 2021","interfaces":[{"interface":"back","average":{"1min":0.93999999999999995,"5min":0.93999999999999995,"15min":0.93999999999999995},"min":{"1min":0.504,"5min":0.504,"15min":0.504},"max":{"1min":1.5740000000000001,"5min":1.5740000000000001,"15min":1.5740000000000001},"last":1.1299999999999999},{"interface":"front","average":{"1min":31.253,"5min":31.253,"15min":31.253},"min":{"1min":0.50800000000000001,"5min":0.50800000000000001,"15min":0.50800000000000001},"max":{"1min":729.27700000000004,"5min":729.27700000000004,"15min":729.27700000000004},"last":0.96599999999999997}]},{"osd":1,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":0.97599999999999998,"5min":8.0850000000000009,"15min":26.884},"min":{"1min":0.626,"5min":0.52200000000000002,"15min":0.52200000000000002},"max":{"1min":1.5029999999999999,"5min":684.42700000000002,"15min":684.42700000000002},"last":0.81299999999999994},{"interface":"front","average":{"1min":0.98399999999999999,"5min":1.26,"15min":1.1619999999999999},"min":{"1min":0.69699999999999995,"5min":0.56100000000000005,"15min":0.56100000000000005},"max":{"1min":1.319,"5min":6.1360000000000001,"15min":6.1360000000000001},"last":1.157}]},{"osd":2,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.141,"5min":1.167,"15min":1.234},"min":{"1min":0.91800000000000004,"5min":0.498,"15min":0.498},"max":{"1min":1.383,"5min":7.2329999999999997,"15min":7.2329999999999997},"last":1.3480000000000001},{"interface":"front","average":{"1min":1.0349999999999999,"5min":8.3000000000000007,"15min":3.6179999999999999},"min":{"1min":0.60499999999999998,"5min":0.54200000000000004,"15min":0.54200000000000004},"max":{"1min":1.542,"5min":607.71000000000004,"15min":607.71000000000004},"last":0.86699999999999999}]},{"osd":3,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":29.053999999999998,"5min":6.9160000000000004,"15min":3.1040000000000001},"min":{"1min":0.77700000000000002,"5min":0.61199999999999999,"15min":0.61199999999999999},"max":{"1min":501.613,"5min":501.613,"15min":501.613},"last":1.325},{"interface":"front","average":{"1min":1.1919999999999999,"5min":6.8719999999999999,"15min":3.0489999999999999},"min":{"1min":0.88500000000000001,"5min":0.66000000000000003,"15min":0.66000000000000003},"max":{"1min":1.4199999999999999,"5min":480.87299999999999,"15min":480.87299999999999},"last":1.1819999999999999}]},{"osd":4,"last update":"Fri Jan 29 13:57:13 2021","interfaces":[{"interface":"back","average":{"1min":1.075,"5min":4.6059999999999999,"15min":2.4380000000000002},"min":{"1min":0.71799999999999997,"5min":0.62,"15min":0.62},"max":{"1min":1.6439999999999999,"5min":263.584,"15min":263.584},"last":1.1040000000000001},{"interface":"front","average":{"1min":1.1279999999999999,"5min":1.238,"15min":1.3939999999999999},"min":{"1min":0.82699999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"max":{"1min":1.6200000000000001,"5min":7.3449999999999998,"15min":7.3449999999999998},"last":1.423}]},{"osd":5,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.238,"5min":1.27,"15min":1.3400000000000001},"min":{"1min":1.0049999999999999,"5min":0.74199999999999999,"15min":0.74199999999999999},"max":{"1min":1.6020000000000001,"5min":4.0069999999999997,"15min":4.0069999999999997},"last":1.27},{"interface":"front","average":{"1min":1.25,"5min":1.569,"15min":1.492},"min":{"1min":1.012,"5min":0.82499999999999996,"15min":0.82499999999999996},"max":{"1min":1.5409999999999999,"5min":7.3140000000000001,"15min":7.3140000000000001},"last":1.5940000000000001}]},{"osd":7,"last update":"Fri Jan 29 13:57:26 2021","interfaces":[{"interface":"back","average":{"1min":1.3009999999999999,"5min":1.4159999999999999,"15min":1.3380000000000001},"min":{"1min":0.91100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"max":{"1min":1.581,"5min":10.795,"15min":10.795},"last":1.655},{"interface":"front","average":{"1min":1.278,"5min":1.365,"15min":1.3839999999999999},"min":{"1min":0.99299999999999999,"5min":0.78200000000000003,"15min":0.78200000000000003},"max":{"1min":1.722,"5min":4.0579999999999998,"15min":4.0579999999999998},"last":1.383}]}]}]}} , 2021-01-29T13:57:47.178 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json , 2021-01-29T13:57:47.465 INFO:teuthology.orchestra.run.smithi183.stdout: Ignoring malparsed backtrace: 2021-01-29T13:58:10.671 INFO:teuthology.orchestra.run.smithi183.stdout:} , 2021-01-29T13:58:10.682 DEBUG:teuthology.orchestra.run.smithi183:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 , instructed osd(s) 2 to deep-scrub Ignoring malparsed backtrace: File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/orchestra/run.py", line 179, in _raise_for_status , raise CommandCrashedError(command=self.command) , teuthology.exceptions.CommandCrashedError: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 10000 --objects 6600 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 1200 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' Ignoring malparsed backtrace: 2021-01-29T13:59:00.217 DEBUG:teuthology.orchestra.run.smithi183:> sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- , 2021-01-29T14:01:20.328 INFO:tasks.ceph:Archiving logs... , 2021-01-29T14:01:20.329 DEBUG:teuthology.misc:Transferring archived files from smithi183:/var/log/ceph to /home/teuthworker/archive/kchai-2021-01-29_12:57:23-rados-wip-kefu-testing-2021-01-29-1713-distro-basic-smithi/5840036/remote/smithi183/log Ignoring malparsed backtrace: Traceback (most recent call last): , File "/home/teuthworker/src/git.ceph.com_git_teuthology_master/teuthology/task/internal/__init__.py", line 368, in archive , yield Found 9 distinct failure reasons Failure: Command failed (workunit test mon/misc.sh) on smithi007 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27dc1eb32728beb0c69aa65131bc609ef680c0aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/standalone/mon/misc.sh' 2 jobs: ['5840169', '5840388'] suites intersection: ['workloads/mon}'] suites union: ['rados/standalone/{mon_election/classic', 'rados/standalone/{mon_election/connectivity', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}', 'workloads/mon}'] Failure: Exiting scrub checking -- not all pgs scrubbed. 2 jobs: ['5840339', '5840141'] suites intersection: ['1-pg-log-overrides/short_pg_log', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/morepggrow', 'thrashosds-health'] suites union: ['1-pg-log-overrides/short_pg_log', '2-recovery-overrides/{more-async-recovery}', '2-recovery-overrides/{more-partial-recovery}', 'backoff/normal', 'ceph', 'clusters/{fixed-2', 'crc-failures/default', 'd-balancer/crush-compat', 'mon_election/classic', 'msgr-failures/fastclose', 'msgr/async', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-comp-zlib', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/3-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'thrashers/morepggrow', 'thrashosds-health', 'workloads/cache-pool-snaps-readproxy}', 'workloads/cache-snaps-balanced}'] Dead: b'2021-01-30T03:47:08.841 DEBUG:teuthology.exit:Finished running handlers' 8 jobs: ['5840201', '5840076', '5840359', '5840022', '5840182', '5840158', '5839984', '5840379'] suites intersection: [] suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-active-recovery}', '2-recovery-overrides/{more-async-recovery}', 'backoff/normal', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'fixed-2', 'mode/packaged', 'mode/root', 'mon_election/classic', 'mon_election/connectivity', 'msgr-failures/fastclose', 'msgr-failures/osd-delay', 'msgr/async', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-bitmap', 'objectstore/bluestore-low-osd-mem-target', 'objectstore/bluestore-stupid', 'objectstore/filestore-xfs', 'openstack', 'openstack}', 'rados', 'rados/cephadm/with-work/{distro/ubuntu_20.04', 'rados/perf/{ceph', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'scheduler/dmclock_default_shards', 'scheduler/wpq_default_shards', 'settings/optimized', 'start', 'supported-random-distro$/{ubuntu_latest}', 'tasks/rados_api_tests}', 'tasks/rados_python}', 'thrashers/careful', 'thrashers/mapgap', 'thrashosds-health', 'ubuntu_latest', 'workloads/cosbench_64K_read_write}', 'workloads/cosbench_64K_write}', 'workloads/radosbench-high-concurrency}', 'workloads/radosbench_omap_write}'] Failure: Command crashed: 'CEPH_CLIENT_ID=0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph_test_rados --max-ops 400000 --objects 10000 --max-in-flight 16 --size 4000000 --min-stride-size 400000 --max-stride-size 800000 --max-seconds 600 --op read 100 --op write 50 --op delete 50 --op copy_from 50 --op write_excl 50 --pool base' 3 jobs: ['5840243', '5840187', '5840036'] suites intersection: ['mon_election/connectivity', 'rados'] suites union: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-partial-recovery}', '2-recovery-overrides/{more-partial-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/many', 'msgr-failures/osd-delay', 'msgr/async-v1only', 'msgr/async-v2only', 'objectstore/bluestore-comp-snappy', 'objectstore/bluestore-comp-zstd', 'openstack}', 'rados', 'rados/singleton/{all/thrash_cache_writeback_proxy_none', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{rhel_8}', 'supported-random-distro$/{ubuntu_latest}}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/cache-agent-big}', 'workloads/redirect_set_object}'] Failure: Command failed on smithi013 with status 2: 'git archive --remote=git://git.ceph.com/ceph-ci.git pacific src/cephadm/cephadm | tar -xO src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm' 2 jobs: ['5840045', '5840266'] suites intersection: ['1-tasks', 'rados/upgrade/pacific-x/parallel/{0-start', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] suites union: ['1-tasks', 'distro1$/{centos_8.0}', 'distro1$/{ubuntu_18.04}', 'mon_election/classic', 'mon_election/connectivity', 'rados/upgrade/pacific-x/parallel/{0-start', 'rados_api', 'rados_loadgenbig', 'rbd_import_export', 'test_rbd_api', 'test_rbd_python}}', 'upgrade-sequence', 'workload/{ec-rados-default'] Failure: SSH connection to smithi107 was lost: 'sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 74b1d184-625c-11eb-8fa5-001a4aab830c --force' 1 jobs: ['5840332'] suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_20.04}', 'fixed-2', 'mon_election/connectivity}', 'rados/cephadm/upgrade/{1-start'] Failure: [Errno 113] No route to host 1 jobs: ['5840171'] suites: ['2-repo_digest/repo_digest', '3-start-upgrade', '4-wait', 'distro$/{ubuntu_20.04}', 'fixed-2', 'mon_election/classic}', 'rados/cephadm/upgrade/{1-start'] Failure: "2021-01-29T13:35:11.838843+0000 mon.a (mon.0) 11 : cluster [WRN] Health check failed: 1/3 mons down, quorum a,b (MON_DOWN)" in cluster log 1 jobs: ['5840011'] suites: ['1-pg-log-overrides/normal_pg_log', '2-recovery-overrides/{more-async-recovery}', 'backoff/peering_and_degraded', 'ceph', 'clusters/{fixed-2', 'crc-failures/bad_map_crc_failure', 'd-balancer/on', 'mon_election/connectivity', 'msgr-failures/osd-delay', 'msgr/async-v2only', 'objectstore/bluestore-hybrid', 'openstack}', 'rados', 'rados/thrash/{0-size-min-size-overrides/2-size-2-min-size', 'supported-random-distro$/{ubuntu_latest}', 'thrashers/mapgap', 'thrashosds-health', 'workloads/small-objects}'] Failure: Command failed (workunit test cephtool/test.sh) on smithi003 with status 1: 'mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=27dc1eb32728beb0c69aa65131bc609ef680c0aa TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/cephtool/test.sh' 1 jobs: ['5840263'] suites: ['mon_election/classic', 'msgr-failures/few', 'msgr/async', 'objectstore/bluestore-bitmap', 'rados', 'rados/singleton-bluestore/{all/cephtool', 'supported-random-distro$/{centos_8}}']